Overview of the SBS 2016 Mining Track

Toine Bogers, Iris Hendrickx, Marijn Koolen, Suzan Verberne

Research output: Conference Article in Proceeding or Book/Report chapterArticle in proceedingsResearchpeer-review

Abstract

In this paper we present an overview of the mining track in the Social Book Search (SBS) lab 2016. The mining track addressed two tasks: (1) classifying forum posts as book search requests, and (2) linking book title mentions in forum posts to unique book IDs in a database. Both tasks are important steps in the process of solving complex search tasks within online reader communities. We prepared two data collections for the classification task: posts from the LibraryThing (LT) forum and a smaller number of posts from Reddit. For the linking task we used annotated LT threads. We found that the classification task was relatively straightforward, achieving up to 94% classification accuracy. The book linking task on the other hand turned out to be a difficult task: here the best system achieved an accuracy of 41% and F-score of 33.5%. Both the automatic classification of book search requests as the automatic linking of book mentions could next year be part of the pipeline for processing complex book searches.
Original languageEnglish
Title of host publicationWorking Notes of CLEF 2016 - Conference and Labs of the Evaluation Forum
EditorsKrisztian Balog, Linda Capellato, Nicola Ferro, Craig McDonald
Number of pages11
PublisherCEUR Workshop Proceedings
Publication date5 Sept 2016
Pages1053-1063
Publication statusPublished - 5 Sept 2016
Externally publishedYes
EventConference and Labs of the Evaluation forum - Évora, Portugal
Duration: 5 Sept 20168 Sept 2016

Conference

ConferenceConference and Labs of the Evaluation forum
Country/TerritoryPortugal
CityÉvora
Period05/09/201608/09/2016
SeriesCEUR Workshop Proceedings
Volume1609
ISSN1613-0073

Keywords

  • Social Book Search
  • Mining track
  • Forum post classification
  • Book title linking
  • Online reader communities

Fingerprint

Dive into the research topics of 'Overview of the SBS 2016 Mining Track'. Together they form a unique fingerprint.

Cite this