Overview of INEX 2014

Patrice Bellot; Toine Bogers; Shlomo Geva; Mark Hall; Hugo Huurdeman; Jaap Kamps; Gabriella Kazai; Marijn Koolen; Veronique Moriceau; Josiane Mothe; Michael Preminger; Eric SanJuan; Ralf Schenkel; Mette Skov; Xavier Tannier; David Walsh

doi:10.1007/978-3-319-11382-1_19

Overview of INEX 2014

Patrice Bellot, Toine Bogers, Shlomo Geva, Mark Hall, Hugo Huurdeman, Jaap Kamps, Gabriella Kazai, Marijn Koolen, Veronique Moriceau, Josiane Mothe, Michael Preminger, Eric SanJuan, Ralf Schenkel, Mette Skov, Xavier Tannier, David Walsh

Research output: Conference Article in Proceeding or Book/Report chapter › Article in proceedings › Research › peer-review

Abstract

INEX investigates focused retrieval from structured documents by providing large test collections of structured documents, uniform evaluation measures, and a forum for organizations to compare their results. This paper reports on the INEX 2014 evaluation campaign, which consisted of three tracks: The Interactive Social Book Search Track investigated user information seeking behavior when interacting with various sources of information, for realistic task scenarios, and how the user interface impacts search and the search experience. The Social Book Search Track investigated the relative value of authoritative metadata and user-generated content for search and recommendation using a test collection with data from Amazon and LibraryThing, including user profiles and personal catalogues. The Tweet Contextualization Track investigated tweet contextualization, helping a user to understand a tweet by providing him with a short background summary generated from relevant Wikipedia passages aggregated into a coherent summary. INEX 2014 was an exciting year for INEX in which we for the third time ran our workshop as part of the CLEF labs. This paper gives an overview of all the INEX 2014 tracks, their aims and task, the built test-collections, the participants, and gives an initial analysis of the results.

Original language	English
Title of host publication	Information Access Evaluation. Multilinguality, Multimodality, and Interaction
Editors	Evangelos Kanoulas, Mihai Lupu, Paul Clough, Mark Sanderson, Mark Hall, Allan Hanbury, Elaine Toms
Number of pages	17
Place of Publication	Germany
Publisher	Springer VS
Publication date	1 Sept 2014
Pages	212-228
ISBN (Print)	978-3-319-11381-4
DOIs	https://doi.org/10.1007/978-3-319-11382-1_19
Publication status	Published - 1 Sept 2014

Series	Lecture Notes in Computer Science
ISSN	0302-9743

Keywords

Focused Retrieval
Structured Documents
Evaluation Measures
User Information Seeking Behavior
Tweet Contextualization

Access to Document

10.1007/978-3-319-11382-1_19

Cite this

Bellot, P., Bogers, T., Geva, S., Hall, M., Huurdeman, H., Kamps, J., Kazai, G., Koolen, M., Moriceau, V., Mothe, J., Preminger, M., SanJuan, E., Schenkel, R., Skov, M., Tannier, X., & Walsh, D. (2014). Overview of INEX 2014. In E. Kanoulas, M. Lupu, P. Clough, M. Sanderson, M. Hall, A. Hanbury, & E. Toms (Eds.), Information Access Evaluation. Multilinguality, Multimodality, and Interaction (pp. 212-228). Springer VS. https://doi.org/10.1007/978-3-319-11382-1_19

@inproceedings{43589efa13084f9db2135b8bb0993a39,

title = "Overview of INEX 2014",

abstract = "INEX investigates focused retrieval from structured documents by providing large test collections of structured documents, uniform evaluation measures, and a forum for organizations to compare their results. This paper reports on the INEX 2014 evaluation campaign, which consisted of three tracks: The Interactive Social Book Search Track investigated user information seeking behavior when interacting with various sources of information, for realistic task scenarios, and how the user interface impacts search and the search experience. The Social Book Search Track investigated the relative value of authoritative metadata and user-generated content for search and recommendation using a test collection with data from Amazon and LibraryThing, including user profiles and personal catalogues. The Tweet Contextualization Track investigated tweet contextualization, helping a user to understand a tweet by providing him with a short background summary generated from relevant Wikipedia passages aggregated into a coherent summary. INEX 2014 was an exciting year for INEX in which we for the third time ran our workshop as part of the CLEF labs. This paper gives an overview of all the INEX 2014 tracks, their aims and task, the built test-collections, the participants, and gives an initial analysis of the results.",

keywords = "Focused Retrieval, Structured Documents, Evaluation Measures, User Information Seeking Behavior, Tweet Contextualization, Focused Retrieval, Structured Documents, Evaluation Measures, User Information Seeking Behavior, Tweet Contextualization",

author = "Patrice Bellot and Toine Bogers and Shlomo Geva and Mark Hall and Hugo Huurdeman and Jaap Kamps and Gabriella Kazai and Marijn Koolen and Veronique Moriceau and Josiane Mothe and Michael Preminger and Eric SanJuan and Ralf Schenkel and Mette Skov and Xavier Tannier and David Walsh",

note = "null ; Conference date: 15-09-2014 Through 18-09-2014",

year = "2014",

month = sep,

day = "1",

doi = "10.1007/978-3-319-11382-1_19",

language = "English",

isbn = "978-3-319-11381-4",

series = "Lecture Notes in Computer Science",

publisher = "Springer VS",

pages = "212--228",

editor = "Evangelos Kanoulas and Mihai Lupu and Paul Clough and Mark Sanderson and Mark Hall and Allan Hanbury and Elaine Toms",

booktitle = "Information Access Evaluation. Multilinguality, Multimodality, and Interaction",

}

Bellot, P, Bogers, T, Geva, S, Hall, M, Huurdeman, H, Kamps, J, Kazai, G, Koolen, M, Moriceau, V, Mothe, J, Preminger, M, SanJuan, E, Schenkel, R, Skov, M, Tannier, X & Walsh, D 2014, Overview of INEX 2014. in E Kanoulas, M Lupu, P Clough, M Sanderson, M Hall, A Hanbury & E Toms (eds), Information Access Evaluation. Multilinguality, Multimodality, and Interaction. Springer VS, Germany, Lecture Notes in Computer Science, pp. 212-228. https://doi.org/10.1007/978-3-319-11382-1_19

Overview of INEX 2014. / Bellot, Patrice; Bogers, Toine; Geva, Shlomo et al.
Information Access Evaluation. Multilinguality, Multimodality, and Interaction. ed. / Evangelos Kanoulas; Mihai Lupu; Paul Clough; Mark Sanderson; Mark Hall; Allan Hanbury; Elaine Toms. Germany: Springer VS, 2014. p. 212-228 (Lecture Notes in Computer Science).

Research output: Conference Article in Proceeding or Book/Report chapter › Article in proceedings › Research › peer-review

TY - GEN

T1 - Overview of INEX 2014

AU - Bellot, Patrice

AU - Bogers, Toine

AU - Geva, Shlomo

AU - Hall, Mark

AU - Huurdeman, Hugo

AU - Kamps, Jaap

AU - Kazai, Gabriella

AU - Koolen, Marijn

AU - Moriceau, Veronique

AU - Mothe, Josiane

AU - Preminger, Michael

AU - SanJuan, Eric

AU - Schenkel, Ralf

AU - Skov, Mette

AU - Tannier, Xavier

AU - Walsh, David

N1 - null ; Conference date: 15-09-2014 Through 18-09-2014

PY - 2014/9/1

Y1 - 2014/9/1

N2 - INEX investigates focused retrieval from structured documents by providing large test collections of structured documents, uniform evaluation measures, and a forum for organizations to compare their results. This paper reports on the INEX 2014 evaluation campaign, which consisted of three tracks: The Interactive Social Book Search Track investigated user information seeking behavior when interacting with various sources of information, for realistic task scenarios, and how the user interface impacts search and the search experience. The Social Book Search Track investigated the relative value of authoritative metadata and user-generated content for search and recommendation using a test collection with data from Amazon and LibraryThing, including user profiles and personal catalogues. The Tweet Contextualization Track investigated tweet contextualization, helping a user to understand a tweet by providing him with a short background summary generated from relevant Wikipedia passages aggregated into a coherent summary. INEX 2014 was an exciting year for INEX in which we for the third time ran our workshop as part of the CLEF labs. This paper gives an overview of all the INEX 2014 tracks, their aims and task, the built test-collections, the participants, and gives an initial analysis of the results.

AB - INEX investigates focused retrieval from structured documents by providing large test collections of structured documents, uniform evaluation measures, and a forum for organizations to compare their results. This paper reports on the INEX 2014 evaluation campaign, which consisted of three tracks: The Interactive Social Book Search Track investigated user information seeking behavior when interacting with various sources of information, for realistic task scenarios, and how the user interface impacts search and the search experience. The Social Book Search Track investigated the relative value of authoritative metadata and user-generated content for search and recommendation using a test collection with data from Amazon and LibraryThing, including user profiles and personal catalogues. The Tweet Contextualization Track investigated tweet contextualization, helping a user to understand a tweet by providing him with a short background summary generated from relevant Wikipedia passages aggregated into a coherent summary. INEX 2014 was an exciting year for INEX in which we for the third time ran our workshop as part of the CLEF labs. This paper gives an overview of all the INEX 2014 tracks, their aims and task, the built test-collections, the participants, and gives an initial analysis of the results.

KW - Focused Retrieval

KW - Structured Documents

KW - Evaluation Measures

KW - User Information Seeking Behavior

KW - Tweet Contextualization

KW - Focused Retrieval

KW - Structured Documents

KW - Evaluation Measures

KW - User Information Seeking Behavior

KW - Tweet Contextualization

U2 - 10.1007/978-3-319-11382-1_19

DO - 10.1007/978-3-319-11382-1_19

M3 - Article in proceedings

SN - 978-3-319-11381-4

T3 - Lecture Notes in Computer Science

SP - 212

EP - 228

BT - Information Access Evaluation. Multilinguality, Multimodality, and Interaction

A2 - Kanoulas, Evangelos

A2 - Lupu, Mihai

A2 - Clough, Paul

A2 - Sanderson, Mark

A2 - Hall, Mark

A2 - Hanbury, Allan

A2 - Toms, Elaine

PB - Springer VS

CY - Germany

ER -

Overview of INEX 2014

Abstract

Keywords

Access to Document

Fingerprint

Cite this