Creating Gaze Annotations in Head Mounted Displays

Diako Mardanbeigi; Pernilla Qvarfordt

doi:10.1145/2802083.2808404

Creating Gaze Annotations in Head Mounted Displays

Diako Mardanbeigi, Pernilla Qvarfordt

Research output: Conference Article in Proceeding or Book/Report chapter › Article in proceedings › Research › peer-review

Abstract

To facilitate distributed communication in mobile settings, we developed GazeNote for creating and sharing gaze annotations in head mounted displays (HMDs). With gaze annotations it possible to point out objects of interest within an image and add a verbal description. To create an annota- tion, the user simply captures an image using the HMD’s camera, looks at an object of interest in the image, and speaks out the information to be associated with the object. The gaze location is recorded and visualized with a marker. The voice is transcribed using speech recognition. Gaze annotations can be shared. Our study showed that users found that gaze annotations add precision and expressive- ness compared to annotations of the image as a whole

Original language	English
Title of host publication	ISWC '15 Proceedings of the 2015 ACM International Symposium on Wearable Computers
Publisher	Association for Computing Machinery
Publication date	2015
Pages	161-162
ISBN (Print)	978-1-4503-3578-2
DOIs	https://doi.org/10.1145/2802083.2808404
Publication status	Published - 2015

Keywords

Gaze annotations
Head mounted displays
Spatial communication
Speech recognition
Multimodal interaction

Access to Document

10.1145/2802083.2808404

http://dl.acm.org/citation.cfm?id=2808404

Cite this

@inproceedings{d5cf8b695f47499695e88b794c8c2a84,

title = "Creating Gaze Annotations in Head Mounted Displays",

abstract = "To facilitate distributed communication in mobile settings, we developed GazeNote for creating and sharing gaze annotations in head mounted displays (HMDs). With gaze annotations it possible to point out objects of interest within an image and add a verbal description. To create an annota- tion, the user simply captures an image using the HMD{\textquoteright}s camera, looks at an object of interest in the image, and speaks out the information to be associated with the object. The gaze location is recorded and visualized with a marker. The voice is transcribed using speech recognition. Gaze annotations can be shared. Our study showed that users found that gaze annotations add precision and expressive- ness compared to annotations of the image as a whole",

keywords = "Gaze annotations, Head mounted displays, Spatial communication, Speech recognition, Multimodal interaction, Gaze annotations, Head mounted displays, Spatial communication, Speech recognition, Multimodal interaction",

author = "Diako Mardanbeigi and Pernilla Qvarfordt",

year = "2015",

doi = "10.1145/2802083.2808404",

language = "English",

isbn = "978-1-4503-3578-2",

pages = "161--162",

booktitle = "ISWC '15 Proceedings of the 2015 ACM International Symposium on Wearable Computers",

publisher = "Association for Computing Machinery",

address = "United States",

}

TY - GEN

T1 - Creating Gaze Annotations in Head Mounted Displays

AU - Mardanbeigi, Diako

AU - Qvarfordt, Pernilla

PY - 2015

Y1 - 2015

N2 - To facilitate distributed communication in mobile settings, we developed GazeNote for creating and sharing gaze annotations in head mounted displays (HMDs). With gaze annotations it possible to point out objects of interest within an image and add a verbal description. To create an annota- tion, the user simply captures an image using the HMD’s camera, looks at an object of interest in the image, and speaks out the information to be associated with the object. The gaze location is recorded and visualized with a marker. The voice is transcribed using speech recognition. Gaze annotations can be shared. Our study showed that users found that gaze annotations add precision and expressive- ness compared to annotations of the image as a whole

AB - To facilitate distributed communication in mobile settings, we developed GazeNote for creating and sharing gaze annotations in head mounted displays (HMDs). With gaze annotations it possible to point out objects of interest within an image and add a verbal description. To create an annota- tion, the user simply captures an image using the HMD’s camera, looks at an object of interest in the image, and speaks out the information to be associated with the object. The gaze location is recorded and visualized with a marker. The voice is transcribed using speech recognition. Gaze annotations can be shared. Our study showed that users found that gaze annotations add precision and expressive- ness compared to annotations of the image as a whole

KW - Gaze annotations

KW - Head mounted displays

KW - Spatial communication

KW - Speech recognition

KW - Multimodal interaction

KW - Gaze annotations

KW - Head mounted displays

KW - Spatial communication

KW - Speech recognition

KW - Multimodal interaction

U2 - 10.1145/2802083.2808404

DO - 10.1145/2802083.2808404

M3 - Article in proceedings

SN - 978-1-4503-3578-2

SP - 161

EP - 162

BT - ISWC '15 Proceedings of the 2015 ACM International Symposium on Wearable Computers

PB - Association for Computing Machinery

ER -

Creating Gaze Annotations in Head Mounted Displays

Abstract

Keywords

Access to Document

Fingerprint

Cite this