A Robotic Home Assistant with Memory Aid Functionality

Iris Wieser; Sibel Toprak; Andreas Grenzing; Tobias Hinz; Sayantan Auddy; Ethem Can Karaoguz; Abhilash Chandran; Melanie Remmels; Ahmed El Shinawi; Josip Josifovski; Leena Chennuru Vankadara; Faiz Ul Wahab; Alireza M. Bahnemiri; Debasish Sahu; Stefan Heinrich; Nicolás Navarro-Guerrero; Erik Strahl; Johannes Twiefel; Stefan Wermter

A Robotic Home Assistant with Memory Aid Functionality

Iris Wieser
, Sibel Toprak
, Andreas Grenzing
, Tobias Hinz
, Sayantan Auddy
, Ethem Can Karaoguz
, Abhilash Chandran
, Melanie Remmels
, Ahmed El Shinawi
, Josip Josifovski
, Leena Chennuru Vankadara
, Faiz Ul Wahab
, Alireza M. Bahnemiri
, Debasish Sahu
, Stefan Heinrich
, Nicolás Navarro-Guerrero
, Erik Strahl
, Johannes Twiefel
, Stefan Wermter

University of Hamburg

Research output: Conference Article in Proceeding or Book/Report chapter › Conference abstract in proceedings › Research › peer-review

Abstract

We present the robotic system IRMA (Interactive Robotic Memory Aid) that assists humans in their search for misplaced belongings within a natural home-like environment. Our stand-alone system integrates state-of-the-art approaches in a novel manner to achieve a seamless and intuitive human-robot interaction. IRMA directs its gaze toward the speaker and understands the person’s verbal instructions independent of specific grammatical constructions. It determines the positions of relevant objects and navigates collision-free within the environment. In addition, IRMA produces natural language descriptions for the objects’ positions by using furniture as reference points. To evaluate IRMA’s usefulness, a user study with 20 participants has been conducted. IRMA achieves an overall user satisfaction score of 4.05 and a perceived accuracy rating of 4.15 on a scale from 1-5 with 5 being the best

Original language	English
Title of host publication	KI 2016: Advances in Artificial Intelligence, Lecture Notes in Artificial Intelligence : Proceedings of the 39th German Conference on Artificial Intelligence (KI2016)
Number of pages	14
Volume	9904
Publisher	Springer
Publication date	26 Sept 2016
Pages	102-115
Publication status	Published - 26 Sept 2016
Externally published	Yes
Event	Annual German Conference on AI - Duration: 26 Sept 2016 → 30 Sept 2016 Conference number: 39

Conference

Conference	Annual German Conference on AI
Number	39
Period	26/09/2016 → 30/09/2016

Keywords

Social Robotics
Person Detection
Robotic Home Assistant
Human-Robot Interaction
Memory Service System
Object Detection
Speech Recognition · Natural Language Understanding

Access to Document

https://stefanheinrich.net/files/2016_PHRI_KI.pdfLicence: Unspecified

Cite this

Wieser, I., Toprak, S., Grenzing, A., Hinz, T., Auddy, S., Karaoguz, E. C., Chandran, A., Remmels, M., El Shinawi, A., Josifovski, J., Chennuru Vankadara, L., Wahab, F. U., Bahnemiri, A. M., Sahu, D., Heinrich, S., Navarro-Guerrero, N., Strahl, E., Twiefel, J., & Wermter, S. (2016). A Robotic Home Assistant with Memory Aid Functionality. In KI 2016: Advances in Artificial Intelligence, Lecture Notes in Artificial Intelligence: Proceedings of the 39th German Conference on Artificial Intelligence (KI2016) (Vol. 9904, pp. 102-115). Springer. https://stefanheinrich.net/files/2016_PHRI_KI.pdf

@inbook{a7d86adbb5c045d3ae33e4adf7054b32,

title = "A Robotic Home Assistant with Memory Aid Functionality",

abstract = " We present the robotic system IRMA (Interactive Robotic Memory Aid) that assists humans in their search for misplaced belongings within a natural home-like environment. Our stand-alone system integrates state-of-the-art approaches in a novel manner to achieve a seamless and intuitive human-robot interaction. IRMA directs its gaze toward the speaker and understands the person{\textquoteright}s verbal instructions independent of specific grammatical constructions. It determines the positions of relevant objects and navigates collision-free within the environment. In addition, IRMA produces natural language descriptions for the objects{\textquoteright} positions by using furniture as reference points. To evaluate IRMA{\textquoteright}s usefulness, a user study with 20 participants has been conducted. IRMA achieves an overall user satisfaction score of 4.05 and a perceived accuracy rating of 4.15 on a scale from 1-5 with 5 being the best",

keywords = "Social Robotics, Person Detection, Robotic Home Assistant, Human-Robot Interaction, Memory Service System, Object Detection, Speech Recognition · Natural Language Understanding",

author = "Iris Wieser and Sibel Toprak and Andreas Grenzing and Tobias Hinz and Sayantan Auddy and Karaoguz, \{Ethem Can\} and Abhilash Chandran and Melanie Remmels and \{El Shinawi\}, Ahmed and Josip Josifovski and \{Chennuru Vankadara\}, Leena and Wahab, \{Faiz Ul\} and Bahnemiri, \{Alireza M.\} and Debasish Sahu and Stefan Heinrich and Nicol{\'a}s Navarro-Guerrero and Erik Strahl and Johannes Twiefel and Stefan Wermter",

year = "2016",

month = sep,

day = "26",

language = "English",

volume = "9904",

pages = "102--115",

booktitle = "KI 2016: Advances in Artificial Intelligence, Lecture Notes in Artificial Intelligence",

publisher = "Springer",

address = "Germany",

note = "Annual German Conference on AI ; Conference date: 26-09-2016 Through 30-09-2016",

}

Wieser, I, Toprak, S, Grenzing, A, Hinz, T, Auddy, S, Karaoguz, EC, Chandran, A, Remmels, M, El Shinawi, A, Josifovski, J, Chennuru Vankadara, L, Wahab, FU, Bahnemiri, AM, Sahu, D, Heinrich, S, Navarro-Guerrero, N, Strahl, E, Twiefel, J & Wermter, S 2016, A Robotic Home Assistant with Memory Aid Functionality. in KI 2016: Advances in Artificial Intelligence, Lecture Notes in Artificial Intelligence: Proceedings of the 39th German Conference on Artificial Intelligence (KI2016). vol. 9904, Springer, pp. 102-115, Annual German Conference on AI, 26/09/2016. <https://stefanheinrich.net/files/2016_PHRI_KI.pdf>

A Robotic Home Assistant with Memory Aid Functionality. / Wieser, Iris; Toprak, Sibel; Grenzing, Andreas et al.
KI 2016: Advances in Artificial Intelligence, Lecture Notes in Artificial Intelligence: Proceedings of the 39th German Conference on Artificial Intelligence (KI2016). Vol. 9904 Springer, 2016. p. 102-115.

Research output: Conference Article in Proceeding or Book/Report chapter › Conference abstract in proceedings › Research › peer-review

TY - ABST

T1 - A Robotic Home Assistant with Memory Aid Functionality

AU - Wieser, Iris

AU - Toprak, Sibel

AU - Grenzing, Andreas

AU - Hinz, Tobias

AU - Auddy, Sayantan

AU - Karaoguz, Ethem Can

AU - Chandran, Abhilash

AU - Remmels, Melanie

AU - El Shinawi, Ahmed

AU - Josifovski, Josip

AU - Chennuru Vankadara, Leena

AU - Wahab, Faiz Ul

AU - Bahnemiri, Alireza M.

AU - Sahu, Debasish

AU - Heinrich, Stefan

AU - Navarro-Guerrero, Nicolás

AU - Strahl, Erik

AU - Twiefel, Johannes

AU - Wermter, Stefan

N1 - Conference code: 39

PY - 2016/9/26

Y1 - 2016/9/26

N2 - We present the robotic system IRMA (Interactive Robotic Memory Aid) that assists humans in their search for misplaced belongings within a natural home-like environment. Our stand-alone system integrates state-of-the-art approaches in a novel manner to achieve a seamless and intuitive human-robot interaction. IRMA directs its gaze toward the speaker and understands the person’s verbal instructions independent of specific grammatical constructions. It determines the positions of relevant objects and navigates collision-free within the environment. In addition, IRMA produces natural language descriptions for the objects’ positions by using furniture as reference points. To evaluate IRMA’s usefulness, a user study with 20 participants has been conducted. IRMA achieves an overall user satisfaction score of 4.05 and a perceived accuracy rating of 4.15 on a scale from 1-5 with 5 being the best

AB - We present the robotic system IRMA (Interactive Robotic Memory Aid) that assists humans in their search for misplaced belongings within a natural home-like environment. Our stand-alone system integrates state-of-the-art approaches in a novel manner to achieve a seamless and intuitive human-robot interaction. IRMA directs its gaze toward the speaker and understands the person’s verbal instructions independent of specific grammatical constructions. It determines the positions of relevant objects and navigates collision-free within the environment. In addition, IRMA produces natural language descriptions for the objects’ positions by using furniture as reference points. To evaluate IRMA’s usefulness, a user study with 20 participants has been conducted. IRMA achieves an overall user satisfaction score of 4.05 and a perceived accuracy rating of 4.15 on a scale from 1-5 with 5 being the best

KW - Social Robotics

KW - Person Detection

KW - Robotic Home Assistant

KW - Human-Robot Interaction

KW - Memory Service System

KW - Object Detection

KW - Speech Recognition · Natural Language Understanding

M3 - Conference abstract in proceedings

VL - 9904

SP - 102

EP - 115

BT - KI 2016: Advances in Artificial Intelligence, Lecture Notes in Artificial Intelligence

PB - Springer

T2 - Annual German Conference on AI

Y2 - 26 September 2016 through 30 September 2016

ER -

A Robotic Home Assistant with Memory Aid Functionality

Abstract

Conference

Keywords

Access to Document

Fingerprint

Cite this