Concept mining

Concept mining is an activity that results in the extraction of concepts from artifacts. Solutions to the task typically involve aspects of artificial intelligence and statistics, such as data mining and text mining.[1][2] Because artifacts are typically a loosely structured sequence of words and other symbols (rather than concepts), the problem is nontrivial, but it can provide powerful insights into the meaning, provenance and similarity of documents.

Methods

Traditionally, the conversion of words to concepts has been performed using a thesaurus,[3] and for computational techniques the tendency is to do the same. The thesauri used are either specially created for the task, or a pre-existing language model, usually related to Princeton's WordNet.

The mappings of words to concepts[4] are often ambiguous. Typically each word in a given language will relate to several possible concepts. Humans use context to disambiguate the various meanings of a given piece of text, where available machine translation systems cannot easily infer context.

For the purposes of concept mining, however, these ambiguities tend to be less important than they are with machine translation, for in large documents the ambiguities tend to even out, much as is the case with text mining.

There are many techniques for disambiguation that may be used. Examples are linguistic analysis of the text and the use of word and concept association frequency information that may be inferred from large text corpora. Recently, techniques that base on semantic similarity between the possible concepts and the context have appeared and gained interest in the scientific community.

Applications

Detecting and indexing similar documents in large corpora

One of the spin-offs of calculating document statistics in the concept domain, rather than the word domain, is that concepts form natural tree structures based on hypernymy and meronymy. These structures can be used to generate simple tree membership statistics, that can be used to locate any document in a Euclidean concept space. If the size of a document is also considered as another dimension of this space then an extremely efficient indexing system can be created. This technique is currently in commercial use locating similar legal documents in a 2.5 million document corpus.

Clustering documents by topic

Standard numeric clustering techniques may be used in "concept space" as described above to locate and index documents by the inferred topic. These are numerically far more efficient than their text mining cousins, and tend to behave more intuitively, in that they map better to the similarity measures a human would generate.

See also

References

  1. ^ Yuen-Hsien Tseng, Chun-Yen Chang, Shu-Nu Chang Rundgren, and Carl-Johan Rundgren, " Mining Concept Maps from News Stories for Measuring Civic Scientific Literacy in Media[dead link‍]", Computers and Education, Vol. 55, No. 1, August 2010, pp. 165-177.
  2. ^ Li, Keqian; Zha, Hanwen; Su, Yu; Yan, Xifeng (November 2018). "Concept Mining via Embedding". 2018 IEEE International Conference on Data Mining (ICDM). IEEE. pp. 267–276. doi:10.1109/icdm.2018.00042. ISBN 978-1-5386-9159-5. S2CID 52841398.
  3. ^ Yuen-Hsien Tseng, " Automatic Thesaurus Generation for Chinese Documents", Journal of the American Society for Information Science and Technology, Vol. 53, No. 13, Nov. 2002, pp. 1130-1138.
  4. ^ Yuen-Hsien Tseng, " Generic Title Labeling for Clustered Documents", Expert Systems With Applications, Vol. 37, No. 3, 15 March 2010, pp. 2247-2254 .

Read other articles:

Consumed (novel)

2014 novel by David Cronenberg Consumed First edition coverAuthorDavid CronenbergCover artistChip KiddCountryCanadaLanguageEnglishGenreHorrorPublisherScribnerPublication date2014Media typePrint (hardcover)Pages308ISBN978-1-4165-9614-1OCLC862347743 Consumed is the first novel by the Canadian filmmaker, screenwriter and actor David Cronenberg.[1] The novel is driven by a globe-trotting, photojournalist couple, that pursue stories featuring rather unusual people. Reviews Cronen...

 

 

Malene Schwartz

Artikel ini sebatang kara, artinya tidak ada artikel lain yang memiliki pranala balik ke halaman ini.Bantulah menambah pranala ke artikel ini dari artikel yang berhubungan atau coba peralatan pencari pranala.Tag ini diberikan pada Desember 2022. Malene SchwartzLahir10 Agustus 1936 (umur 87)Frederiksberg, DenmarkKebangsaanDenmarkPekerjaanPemeranTahun aktif1955–kini Malene Schwartz (lahir 10 Agustus 1936) adalah seorang pemeran film Denmark.[1] Ia tampil dalam 38 film sejak ...

 

 

Grogol, Limo, Depok

Untuk tempat lain yang bernama sama, lihat Grogol (disambiguasi). GrogolKelurahanNegara IndonesiaProvinsiJawa BaratKotaDepokKecamatanLimoKodepos16533Kode Kemendagri32.76.04.1002 Kode BPS3276060002 Luas3,64 km²Jumlah penduduk26.868 jiwaKepadatan7.381 jiwa/km² Grogol adalah sebuah kelurahan di Kecamatan Limo, Kota Depok, Jawa Barat, Indonesia. Toponimi Secara toponimi, nama Grogol disebut berasal dari Bahasa Sunda garogol yang berarti perangkap hewan buas dari kayu yang berbentuk tombak....

Ernest-Auguste de Hanovre (1954)

Pour les articles homonymes, voir Ernest-Auguste. Ernest-Auguste de Hanovre Succession Prétendant aux trônes de Hanovre et de Brunswick Depuis le 9 décembre 1987(36 ans, 3 mois et 24 jours) Données clés Nom revendiqué Ernest-Auguste V Prédécesseur Ernest-Auguste de Hanovre Biographie Titulature prince de Hanovreduc de Brunswick-Lunebourg Dynastie maison de Hanovre Nom de naissance Ernst August Albert Paul Otto Rupprecht Oskar Berthold Friedrich-Ferdinand Christian-Ludw...

 

 

Avarua

Avarua, Kepulauan Cook Avarua adalah ibu kota negara Kepulauan Cook. Penduduknya berjumlah 2.000 jiwa (2005). lbsIbu kota negara di OseaniaIbu kota negara-tidak berdaulat ditulis secara KapitalKecilAustralasiaMelanesiaMikronesiaPolinesia Canberra, Australia Wellington, Selandia Baru 1 Negara tidak berdaulat Flying Fish Cove, Pulau Natal4 Kingston, Pulau Norfolk4 West Island, Kepulauan Cocos (Keeling)4 Dili, Timor Leste 2 Honiara, Kepulauan Salomo Port Moresby, Papua Nugini Port Vila...

 

 

Agamidae

Agamidae Periode Senomanium–Sekarang PreЄ Є O S D C P T J K Pg N Agama mwanzae (en) TaksonomiKerajaanAnimaliaFilumChordataKelasReptiliaOrdoSquamataUpaordoIguaniaFamiliAgamidae Spix Anak suku6, lihat tekslbs Agamidae adalah suku kadal yang terdiri lebih dari 300 spesies yang tersebar luas di Afrika, Asia, Australia, dan sebagian Eropa selatan. Banyak spesies dari suku ini yang diberi nama naga (walaupun istilah naga dalam literatur lebih banyak merujuk ke ular) atau kadal naga.[1]...

Roi (song)

2019 single by Bilal Hassani For other uses, see Roi (disambiguation). RoiSingle by Bilal Hassanifrom the album Kingdom Released11 January 2019Length2:57Songwriter(s)Bilal HassaniMadame MonsieurMedelineProducer(s)Bilal HassaniMadame MonsieurMedelineBilal Hassani singles chronology Mash Up (2018) Roi (2019) Jaloux (2019) Eurovision Song Contest 2019 entryCountryFranceArtist(s)Bilal HassaniLanguagesFrench, EnglishComposer(s)Bilal HassaniMadame MonsieurMedelineLyricist(s)Bilal HassaniMadame Mons...

 

 

Amenemhat I

Amenemhat IFiraunMasa pemerintahan1991–1962 SM (Dinasti ke-12)PendahuluMentuhotep IVPenggantiSenusret IGelar kerajaan Prenomen  (Praenomen) Sehetepibre Nomen Amenemhat Nama Horus Wehemmesut Nama Nebty Wehemmesut Horus emas Wehemmesut[1] Repeating of births PasanganNeferitatjenenAnakSenusret I, Neferu III, Neferusherit, KayetAyahSenusretIbuNeferetMakamPiramida di el-Lisht The ruined pyramid of Amenemhet I at Lisht. Amenemhat I, juga disebut Amenemhet I, adalah penguasa pertama d...

 

 

Ulisse Giuseppe Gozzadini

Questa voce o sezione sull'argomento vescovi italiani non cita le fonti necessarie o quelle presenti sono insufficienti. Puoi migliorare questa voce aggiungendo citazioni da fonti attendibili secondo le linee guida sull'uso delle fonti. Segui i suggerimenti del progetto di riferimento. Questa voce o sezione sull'argomento vescovi non è ancora formattata secondo gli standard. Contribuisci a migliorarla secondo le convenzioni di Wikipedia. Ulisse Giuseppe Gozzadinicardinale di Santa...

Unione Sportiva Arezzo 1984-1985

Voce principale: Unione Sportiva Dilettantistica Arezzo. Unione Sportiva ArezzoStagione 1984-1985 Sport calcio Squadra Arezzo Allenatore Enzo Riccomini (1ª-23ª) Giuseppe Chiappella (24ª-32ª) Mario Rossi (33ª-38ª) Presidente Narciso Terziani Serie B14º posto Coppa ItaliaPrimo turno Maggiori presenzeCampionato: Bertoni, Colantuono, Pellicanò (36) Miglior marcatoreCampionato: Tovalieri (10) 1983-1984 1985-1986 Si invita a seguire il modello di voce Questa voce raccoglie le informaz...

 

 

12 Heures de Sebring 1958

12 Heures de Sebring 1958 Généralités Sport Endurance Édition 7e Lieu(x) Sebring International Raceway Date 22 mars 1958 Palmarès Vainqueur Scuderia Ferrari Navigation Édition précédente Édition suivante modifier Les 12 Heures de Sebring 1958 sont la 7e édition de l'épreuve et la 2e manche du championnat du monde des voitures de sport 1958. Elles ont été remportées le 22 mars 1958 par la Ferrari 250 Testa Rossa no 14 de la Scuderia Ferrari pilotée par Phil Hill ...

 

 

Martin Short

Canadian and American actor and comedian (born 1950) For the author, see Martin Short (author). Martin ShortOCShort in 2014BornMartin Hayter Short (1950-03-26) March 26, 1950 (age 74)Hamilton, Ontario, CanadaCitizenship Canada United States EducationMcMaster University (BA)OccupationsActorcomedianwriterYears active1972–presentSpouse Nancy Dolman ​ ​(m. 1980; died 2010)​Children3Comedy careerMediumFilmtelevisiontheatreGenresImprovisat...

缅族

本页面有缅文字母，操作系统及浏览器須支持特殊字母与符号才能正確显示为缅文字母，否则可能變成乱码、问号、空格等其它符号。 緬人總人口約3300萬－3600萬人分佈地區 緬甸      30,110,000 泰國2,500,000 新加坡72,368 澳大利亞107,112 美国96,420 日本15,800 韩国22,000 马来西亚66,500 英国9,800 德国7,300 香港5,400 柬埔�...

 

 

Горица и Градишка

Историческое государствоГорица и Градишка Флаг Герб 1754 — 1919 Столица Гориция  Медиафайлы на Викискладе Карта Горицы и Триеста XVIII века Горица и Градишка (нем. Görz und Gradisca, итал. Gorizia e Gradisca, словен. Goriška in Gradiščanska, фриульск.: Gurize e Gardiscje) — графство (позднее, княжеск...

 

 

Hans A. Hansen

United States Navy Medal of Honor recipient Hans A. HansenNavy Medal of HonorBorn(1877-04-09)April 9, 1877Korsør, DenmarkDiedAugust 23, 1949(1949-08-23) (aged 72)Toms River, New Jersey, USPlace of burialRiverside CemeteryToms River, New JerseyAllegiance United States of AmericaService/branchUnited States NavyYears of service1899–1903RankSeamanUnitUSS Newark (C-1)Battles/warsBoxer RebellionAwards Medal of Honor Hans Anton Hansen (April 9, 1877 – August 23, 194...

A Bit of Tom Jones?

Artikel ini sebatang kara, artinya tidak ada artikel lain yang memiliki pranala balik ke halaman ini.Bantulah menambah pranala ke artikel ini dari artikel yang berhubungan atau coba peralatan pencari pranala.Tag ini diberikan pada Maret 2023. A Bit of Tom Jones?SutradaraPeter Watkins-HughesProduserPeter Watkins-HughesPemeranJonny OwenRoger EvansEve MylesMatt BerryPenata musikStuart FoxSinematograferJon ReesPenyuntingRichard Jon MicklewrightPerusahaanproduksiTred filmsDistributorTred fil...

 

 

Ansar Dine

Pour les articles homonymes, voir Ansar Dine (homonymie). Ansar Dine Idéologie Salafisme djihadiste Objectifs Établir un État islamique au Mali régi par la charia Fondation Date de formation 2012 Pays d'origine Mali Dissolution Date de dissolution 1er mars 2017 Causes Fusion avec AQMI au Sahel, la katiba Macina et la katiba Al-Mourabitoune pour former le Groupe de soutien à l'islam et aux musulmans Actions Mode opératoire Lutte armée, guérilla Zone d'opération Mali Organisation Chef...

 

 

ルッジェーロ2世

ルッジェーロ2世Ruggero II シチリア国王 在位 1130年 - 1154年出生 (1095-12-22) 1095年12月22日 シチリア伯領、ミレート死去 (1154-02-26) 1154年2月26日（58歳没） シチリア王国、パレルモ埋葬 シチリア王国、パレルモ大聖堂配偶者 エルビラ・デ・カスティーリャ  シビラ・ディ・ボルゴーニャ  ベアトリーチェ・ディ・レテル子女 一覧参照家名 オートヴィル家王朝 オートヴィ�...

حزاز خنازيري

حزاز خنازيري معلومات عامة الاختصاص أمراض معدية  من أنواع طفحة سلية  تعديل مصدري - تعديل   الحزاز الخنازيري (بالإنجليزية: Lichen scrofulosorum)‏ أو السل الجلدي الحزازي (بالإنجليزية: Tuberculosis cutis lichenoides)‏ هو طفحة سلية نادرة تظهر على شكل طفح حزازي على شكل حطاطات دقيقة في الأطفال وا...

 

 

瀬谷区

日本 > 関東地方 > 神奈川県 > 横浜市 > 瀬谷区 せやく 瀬谷区 長屋門公園区庁舎位置 瀬谷区旗 国 日本地方 関東地方都道府県 神奈川県市 横浜市市町村コード 14114-3面積 17.17km2総人口 121,184人 [編集]（推計人口、2024年9月1日）人口密度 7,058人/km2隣接自治体隣接行政区 横浜市（旭区、緑区、泉区）大和市東京都町田市区の木 ケヤキ区の花 アジサ�...