Overview of INEX 2014

INEX investigates focused retrieval from structured docu- ments by providing large test collections of structured documents, uni- form evaluation measures, and a forum for organizations to compare their results. This paper reports on the INEX 2014 evaluation campaign, which consisted of three tracks: The Interactive Social Book Search Track inves- tigated user information seeking behavior when interacting with various sources of information, for realistic task scenarios, and how the user in- terface impacts search and the search experience. The Social Book Search Track investigated the relative value of authoritative metadata and user- generated content for search and recommendation using a test collection with data from Amazon and LibraryThing, and user profiles and personal catalogues. The Tweet Contextualization Track investigated tweet con- textualization, helping a user to understand a tweet by providing him with a short background summary generated from relevant Wikipedia passages aggregated into a coherent summary. INEX 2014 was an excit- ing year for INEX in which we for the third time ran our workshop as part of the CLEF labs in order to facilitate knowledge transfer between the evaluation forums. This paper gives an overview of all the INEX 2014 tracks, their aims and task, the built test-collections, the participants, and gives an initial analysis of the results.