Cultural heritage in CLEF (CHiC) 2013 - Multilingual task overview

Vivien Petras, Toine Bogers, Nicola Ferro, Ivano Masiero

Research output: Journal Article or Conference Article in JournalConference articleResearchpeer-review


The Cultural Heritage in CLEF 2013 multilingual task comprised two sub-tasks: multilingual ad-hoc retrieval and semantic enrichment. The multilin-gual ad-hoc retrieval sub-task evaluated retrieval experiments in 13 languages (Dutch, English, German, Greek, Finnish, French, Hungarian, Italian; Norwe-gian, Polish, Slovenian, Spanish, Swedish). More than 140,000 documents were assessed for relevance on a tertiary scale. The ad-hoc task had 7 participants submitting 30 multilingual and 41 monolingual runs. The semantic enrichment task evaluated monolingual and multilingual semantic enrichments (suggestions based on a query) in the same 13 languages. Two participants submitted 10 runs. Results indicated that different languages contribute differently to the overall retrieval effectiveness, probably dependent on collection size. Experi-ments showed that using more or all of the provided languages usually increas-es retrieval effectiveness, but not always. For a multilingual task of this scale (13 languages), more participants are necessary in order to provide enough var-iations in runs to allow for comparative analyses.

Original languageEnglish
JournalCEUR Workshop Proceedings
Publication statusPublished - 1 Jan 2013
Externally publishedYes
Event2013 Cross Language Evaluation Forum Conference, CLEF 2013 - Valencia, Spain
Duration: 23 Sept 201326 Sept 2013


Conference2013 Cross Language Evaluation Forum Conference, CLEF 2013


Dive into the research topics of 'Cultural heritage in CLEF (CHiC) 2013 - Multilingual task overview'. Together they form a unique fingerprint.

Cite this