Overview of INEX 2014

Patrice Bellot, Toine Bogers, Shlomo Geva, Mark Hall, Hugo Huurdeman, Jaap Kamps, Gabriella Kazai, Marijn Koolen, Véronique Moriceau, Josiane Mothe, Michael Preminger, Eric SanJuan, Ralf Schenkel, Mette Skov, Xavier Tannier, David Walsh

Research output: Chapter in Book/Report/Conference proceedingChapter

12 Citations (Scopus)
54 Downloads (Pure)

Abstract

INEX investigates focused retrieval from structured docu- ments by providing large test collections of structured documents, uni- form evaluation measures, and a forum for organizations to compare their results. This paper reports on the INEX 2014 evaluation campaign, which consisted of three tracks: The Interactive Social Book Search Track inves- tigated user information seeking behavior when interacting with various sources of information, for realistic task scenarios, and how the user in- terface impacts search and the search experience. The Social Book Search Track investigated the relative value of authoritative metadata and user- generated content for search and recommendation using a test collection with data from Amazon and LibraryThing, and user profiles and personal catalogues. The Tweet Contextualization Track investigated tweet con- textualization, helping a user to understand a tweet by providing him with a short background summary generated from relevant Wikipedia passages aggregated into a coherent summary. INEX 2014 was an excit- ing year for INEX in which we for the third time ran our workshop as part of the CLEF labs in order to facilitate knowledge transfer between the evaluation forums. This paper gives an overview of all the INEX 2014 tracks, their aims and task, the built test-collections, the participants, and gives an initial analysis of the results.
Original languageEnglish
Title of host publicationInformation Access Evaluation. Multilinguality, Multimodality, and Interaction
PublisherSpringer International Publishing
Pages212-228
Volume8685
ISBN (Print)9783319113814
Publication statusPublished - 2014

Publication series

NameLecture Notes in Computer Science

Fingerprint Dive into the research topics of 'Overview of INEX 2014'. Together they form a unique fingerprint.

  • Cite this

    Bellot, P., Bogers, T., Geva, S., Hall, M., Huurdeman, H., Kamps, J., Kazai, G., Koolen, M., Moriceau, V., Mothe, J., Preminger, M., SanJuan, E., Schenkel, R., Skov, M., Tannier, X., & Walsh, D. (2014). Overview of INEX 2014. In Information Access Evaluation. Multilinguality, Multimodality, and Interaction (Vol. 8685, pp. 212-228). (Lecture Notes in Computer Science). Springer International Publishing. http://dx.doi.org/10.1007/978-3-319-11382-1_19