Injecting Realism into Simulated Work Tasks: A Case Study of the Book Domain

Pia Borlund; Toine Bogers

Injecting Realism into Simulated Work Tasks: A Case Study of the Book Domain

Publikation: Konference artikel i Proceeding eller bog/rapport kapitel › Konferencebidrag i proceedings › Forskning › peer review

Abstract

Interactive IR studies are commonly conducted by assigning participants simulated work tasks situations (SWTS), predetermined textual descriptions of an information need and its context to motivate participants to perform realistic searches of the IR system in question. Despite their popularity, research has shown that formulating realistic and engaging SWTSs remains challenging. In this paper, we propose using the analyses of large samples of complex real-world search requests—with the specific case of book search—to inject realism into SWTSs by taking different relevance aspects and their relative frequencies into account when formulating them. This should make it easier for researchers to design realistic SWTSs in the future.

Originalsprog	Engelsk
Titel	Proceedings of the 81st Annual Meeting of the Association for Information Science and Technology (ASIST 2018)
Antal sider	3
Udgivelsessted	Vancouver, Canada
Forlag	Association for Information Science and Technology
Publikationsdato	10 nov. 2018
Sider	759-761
ISBN (Elektronisk)	978-0-578-41425-6
Status	Udgivet - 10 nov. 2018
Udgivet eksternt	Ja
Begivenhed	ASIST 2018: 81st Annual Meeting of the Association for Information Science and Technology - Vancouver, Canada, Vancouver, Canada Varighed: 10 nov. 2018 → 14 nov. 2018 Konferencens nummer: 81 https://www.asist.org/am18/

Konference

Konference	ASIST 2018: 81st Annual Meeting of the Association for Information Science and Technology
Nummer	81
Lokation	Vancouver, Canada
Land/Område	Canada
By	Vancouver
Periode	10/11/2018 → 14/11/2018
Internetadresse	https://www.asist.org/am18/

Navn	American Society for Information Science & Technology. Annual Meeting Proceedings
ISSN	0044-7870

Adgang til dokumentet

Camera-ready versionAccepteret manuskript, 126 KB

Citationsformater

Borlund, Pia ; Bogers, Toine. / Injecting Realism into Simulated Work Tasks : A Case Study of the Book Domain. Proceedings of the 81st Annual Meeting of the Association for Information Science and Technology (ASIST 2018). Vancouver, Canada : Association for Information Science and Technology, 2018. s. 759-761 (American Society for Information Science & Technology. Annual Meeting Proceedings).

@inproceedings{b49369a20b6c4a88a98899fc832332ef,

title = "Injecting Realism into Simulated Work Tasks: A Case Study of the Book Domain",

abstract = "Interactive IR studies are commonly conducted by assigning participants simulated work tasks situations (SWTS), predetermined textual descriptions of an information need and its context to motivate participants to perform realistic searches of the IR system in question. Despite their popularity, research has shown that formulating realistic and engaging SWTSs remains challenging. In this paper, we propose using the analyses of large samples of complex real-world search requests—with the specific case of book search—to inject realism into SWTSs by taking different relevance aspects and their relative frequencies into account when formulating them. This should make it easier for researchers to design realistic SWTSs in the future.",

keywords = "Interactive Information Retrieval, Simulated Work Task Situations, Realistic Search Tasks, Information Need Context, Book Search Relevance",

author = "Pia Borlund and Toine Bogers",

year = "2018",

month = nov,

day = "10",

language = "English",

series = "American Society for Information Science & Technology. Annual Meeting Proceedings",

pages = "759--761",

booktitle = "Proceedings of the 81st Annual Meeting of the Association for Information Science and Technology (ASIST 2018)",

publisher = "Association for Information Science and Technology",

note = "ASIST 2018: 81st Annual Meeting of the Association for Information Science and Technology, ASIST 2018 ; Conference date: 10-11-2018 Through 14-11-2018",

url = "https://www.asist.org/am18/",

}

Borlund, P & Bogers, T 2018, Injecting Realism into Simulated Work Tasks: A Case Study of the Book Domain. i Proceedings of the 81st Annual Meeting of the Association for Information Science and Technology (ASIST 2018). Association for Information Science and Technology, Vancouver, Canada, American Society for Information Science & Technology. Annual Meeting Proceedings, s. 759-761, ASIST 2018: 81st Annual Meeting of the Association for Information Science and Technology, Vancouver, Britisk Columbia, Canada, 10/11/2018.

Injecting Realism into Simulated Work Tasks: A Case Study of the Book Domain. / Borlund, Pia; Bogers, Toine.
Proceedings of the 81st Annual Meeting of the Association for Information Science and Technology (ASIST 2018). Vancouver, Canada: Association for Information Science and Technology, 2018. s. 759-761 (American Society for Information Science & Technology. Annual Meeting Proceedings).

Publikation: Konference artikel i Proceeding eller bog/rapport kapitel › Konferencebidrag i proceedings › Forskning › peer review

TY - GEN

T1 - Injecting Realism into Simulated Work Tasks

T2 - ASIST 2018: 81st Annual Meeting of the Association for Information Science and Technology

AU - Borlund, Pia

AU - Bogers, Toine

N1 - Conference code: 81

PY - 2018/11/10

Y1 - 2018/11/10

N2 - Interactive IR studies are commonly conducted by assigning participants simulated work tasks situations (SWTS), predetermined textual descriptions of an information need and its context to motivate participants to perform realistic searches of the IR system in question. Despite their popularity, research has shown that formulating realistic and engaging SWTSs remains challenging. In this paper, we propose using the analyses of large samples of complex real-world search requests—with the specific case of book search—to inject realism into SWTSs by taking different relevance aspects and their relative frequencies into account when formulating them. This should make it easier for researchers to design realistic SWTSs in the future.

AB - Interactive IR studies are commonly conducted by assigning participants simulated work tasks situations (SWTS), predetermined textual descriptions of an information need and its context to motivate participants to perform realistic searches of the IR system in question. Despite their popularity, research has shown that formulating realistic and engaging SWTSs remains challenging. In this paper, we propose using the analyses of large samples of complex real-world search requests—with the specific case of book search—to inject realism into SWTSs by taking different relevance aspects and their relative frequencies into account when formulating them. This should make it easier for researchers to design realistic SWTSs in the future.

KW - Interactive Information Retrieval

KW - Simulated Work Task Situations

KW - Realistic Search Tasks

KW - Information Need Context

KW - Book Search Relevance

UR - https://www.asist.org/wp-content/uploads/2018/12/Final-81st-Annual-Meeting-Proceedings.pdf

M3 - Article in proceedings

T3 - American Society for Information Science & Technology. Annual Meeting Proceedings

SP - 759

EP - 761

BT - Proceedings of the 81st Annual Meeting of the Association for Information Science and Technology (ASIST 2018)

PB - Association for Information Science and Technology

CY - Vancouver, Canada

Y2 - 10 November 2018 through 14 November 2018

ER -

Borlund P, Bogers T. Injecting Realism into Simulated Work Tasks: A Case Study of the Book Domain. I Proceedings of the 81st Annual Meeting of the Association for Information Science and Technology (ASIST 2018). Vancouver, Canada: Association for Information Science and Technology. 2018. s. 759-761. (American Society for Information Science & Technology. Annual Meeting Proceedings).

Injecting Realism into Simulated Work Tasks: A Case Study of the Book Domain

Abstract

Konference

Adgang til dokumentet

Fingeraftryk

Citationsformater