Towards An Affective Robot Companion for Audiology Rehabilitation: How Does Pepper Feel Today?

Pinar Uluer; Hatice Kose; Bulent Koray Oz; Turgut Can Aydinalev; Duygun Erol Barkana

doi:10.1109/RO-MAN47096.2020.9223534

Towards An Affective Robot Companion for Audiology Rehabilitation: How Does Pepper Feel Today?

Pinar Uluer, Hatice Kose, Bulent Koray Oz, Turgut Can Aydinalev, Duygun Erol Barkana

Department of Artificial Intelligence and Data Engineering

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

14 Citations (Scopus)

Abstract

The motivation of this work is to develop an affective robot companion for audiology rehabilitation and to test the system with the deaf or hard of hearing children. Two robot modules are developed which are the multimodal stress/emotion/motivation recognition module for the robot to understand how the children feel, and behaviour and feedback module of the robot to show the children how the robot feels. In this study we only focus on the behaviour and feedback module of the robot. The selected affective/affirmative behaviours are tested by means of tablet games and employed on the robot during an audiology test, as a feedback mechanism. Facial data are used together with the surveys to evaluate the children's perception of the robot and the behaviour set.

Original language	English
Title of host publication	29th IEEE International Conference on Robot and Human Interactive Communication, RO-MAN 2020
Publisher	Institute of Electrical and Electronics Engineers Inc.
Pages	567-572
Number of pages	6
ISBN (Electronic)	9781728160757
DOIs	https://doi.org/10.1109/RO-MAN47096.2020.9223534
Publication status	Published - Aug 2020
Event	29th IEEE International Conference on Robot and Human Interactive Communication, RO-MAN 2020 - Virtual, Naples, Italy Duration: 31 Aug 2020 → 4 Sept 2020

Publication series

Name	29th IEEE International Conference on Robot and Human Interactive Communication, RO-MAN 2020

Conference

Conference	29th IEEE International Conference on Robot and Human Interactive Communication, RO-MAN 2020
Country/Territory	Italy
City	Virtual, Naples
Period	31/08/20 → 4/09/20

Bibliographical note

Publisher Copyright:
© 2020 IEEE.

Funding

*This work is supported by The Scientific and Technological Research Council of Turkey (TUBITAK) under the Grant number 118E214 1Department of Computer Engineering, Galatasaray University, Turkey [email protected] 2Department of Computer Engineering, Istanbul Technical University, Turkey {pinar.uluer, hatice.kose, ozbul, aydinalev}@itu.edu.tr 3Department of Electrical and Electronics Engineering, Yeditepe University, Turkey [email protected]

Funders	Funder number
TUBITAK	118E214
Galatasaray Üniversitesi
Türkiye Bilimsel ve Teknolojik Araştirma Kurumu
Istanbul Teknik Üniversitesi

Keywords

affective computing
Child-robot interaction
humanoids
socially assistive robots

Access to Document

10.1109/RO-MAN47096.2020.9223534

Cite this

Uluer, P., Kose, H., Oz, B. K., Can Aydinalev, T., & Barkana, D. E. (2020). Towards An Affective Robot Companion for Audiology Rehabilitation: How Does Pepper Feel Today? In 29th IEEE International Conference on Robot and Human Interactive Communication, RO-MAN 2020 (pp. 567-572). Article 9223534 (29th IEEE International Conference on Robot and Human Interactive Communication, RO-MAN 2020). Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/RO-MAN47096.2020.9223534

Uluer, Pinar ; Kose, Hatice ; Oz, Bulent Koray et al. / Towards An Affective Robot Companion for Audiology Rehabilitation : How Does Pepper Feel Today?. 29th IEEE International Conference on Robot and Human Interactive Communication, RO-MAN 2020. Institute of Electrical and Electronics Engineers Inc., 2020. pp. 567-572 (29th IEEE International Conference on Robot and Human Interactive Communication, RO-MAN 2020).

@inproceedings{10f6d144e72a4e28bdc69967744c18d7,

title = "Towards An Affective Robot Companion for Audiology Rehabilitation: How Does Pepper Feel Today?",

abstract = "The motivation of this work is to develop an affective robot companion for audiology rehabilitation and to test the system with the deaf or hard of hearing children. Two robot modules are developed which are the multimodal stress/emotion/motivation recognition module for the robot to understand how the children feel, and behaviour and feedback module of the robot to show the children how the robot feels. In this study we only focus on the behaviour and feedback module of the robot. The selected affective/affirmative behaviours are tested by means of tablet games and employed on the robot during an audiology test, as a feedback mechanism. Facial data are used together with the surveys to evaluate the children's perception of the robot and the behaviour set.",

keywords = "affective computing, Child-robot interaction, humanoids, socially assistive robots",

author = "Pinar Uluer and Hatice Kose and Oz, \{Bulent Koray\} and \{Can Aydinalev\}, Turgut and Barkana, \{Duygun Erol\}",

note = "Publisher Copyright: {\textcopyright} 2020 IEEE.; 29th IEEE International Conference on Robot and Human Interactive Communication, RO-MAN 2020 ; Conference date: 31-08-2020 Through 04-09-2020",

year = "2020",

month = aug,

doi = "10.1109/RO-MAN47096.2020.9223534",

language = "English",

series = "29th IEEE International Conference on Robot and Human Interactive Communication, RO-MAN 2020",

publisher = "Institute of Electrical and Electronics Engineers Inc.",

pages = "567--572",

booktitle = "29th IEEE International Conference on Robot and Human Interactive Communication, RO-MAN 2020",

address = "United States",

}

Uluer, P, Kose, H, Oz, BK, Can Aydinalev, T & Barkana, DE 2020, Towards An Affective Robot Companion for Audiology Rehabilitation: How Does Pepper Feel Today? in 29th IEEE International Conference on Robot and Human Interactive Communication, RO-MAN 2020., 9223534, 29th IEEE International Conference on Robot and Human Interactive Communication, RO-MAN 2020, Institute of Electrical and Electronics Engineers Inc., pp. 567-572, 29th IEEE International Conference on Robot and Human Interactive Communication, RO-MAN 2020, Virtual, Naples, Italy, 31/08/20. https://doi.org/10.1109/RO-MAN47096.2020.9223534

Towards An Affective Robot Companion for Audiology Rehabilitation: How Does Pepper Feel Today? / Uluer, Pinar; Kose, Hatice; Oz, Bulent Koray et al.
29th IEEE International Conference on Robot and Human Interactive Communication, RO-MAN 2020. Institute of Electrical and Electronics Engineers Inc., 2020. p. 567-572 9223534 (29th IEEE International Conference on Robot and Human Interactive Communication, RO-MAN 2020).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

TY - GEN

T1 - Towards An Affective Robot Companion for Audiology Rehabilitation

T2 - 29th IEEE International Conference on Robot and Human Interactive Communication, RO-MAN 2020

AU - Uluer, Pinar

AU - Kose, Hatice

AU - Oz, Bulent Koray

AU - Can Aydinalev, Turgut

AU - Barkana, Duygun Erol

PY - 2020/8

Y1 - 2020/8

N2 - The motivation of this work is to develop an affective robot companion for audiology rehabilitation and to test the system with the deaf or hard of hearing children. Two robot modules are developed which are the multimodal stress/emotion/motivation recognition module for the robot to understand how the children feel, and behaviour and feedback module of the robot to show the children how the robot feels. In this study we only focus on the behaviour and feedback module of the robot. The selected affective/affirmative behaviours are tested by means of tablet games and employed on the robot during an audiology test, as a feedback mechanism. Facial data are used together with the surveys to evaluate the children's perception of the robot and the behaviour set.

AB - The motivation of this work is to develop an affective robot companion for audiology rehabilitation and to test the system with the deaf or hard of hearing children. Two robot modules are developed which are the multimodal stress/emotion/motivation recognition module for the robot to understand how the children feel, and behaviour and feedback module of the robot to show the children how the robot feels. In this study we only focus on the behaviour and feedback module of the robot. The selected affective/affirmative behaviours are tested by means of tablet games and employed on the robot during an audiology test, as a feedback mechanism. Facial data are used together with the surveys to evaluate the children's perception of the robot and the behaviour set.

KW - affective computing

KW - Child-robot interaction

KW - humanoids

KW - socially assistive robots

UR - https://www.scopus.com/pages/publications/85095760253

U2 - 10.1109/RO-MAN47096.2020.9223534

DO - 10.1109/RO-MAN47096.2020.9223534

M3 - Conference contribution

AN - SCOPUS:85095760253

T3 - 29th IEEE International Conference on Robot and Human Interactive Communication, RO-MAN 2020

SP - 567

EP - 572

BT - 29th IEEE International Conference on Robot and Human Interactive Communication, RO-MAN 2020

PB - Institute of Electrical and Electronics Engineers Inc.

Y2 - 31 August 2020 through 4 September 2020

ER -

Uluer P, Kose H, Oz BK, Can Aydinalev T, Barkana DE. Towards An Affective Robot Companion for Audiology Rehabilitation: How Does Pepper Feel Today? In 29th IEEE International Conference on Robot and Human Interactive Communication, RO-MAN 2020. Institute of Electrical and Electronics Engineers Inc. 2020. p. 567-572. 9223534. (29th IEEE International Conference on Robot and Human Interactive Communication, RO-MAN 2020). doi: 10.1109/RO-MAN47096.2020.9223534

Towards An Affective Robot Companion for Audiology Rehabilitation: How Does Pepper Feel Today?

Abstract

Publication series

Conference

Bibliographical note

Funding

Keywords

Access to Document

Other files and links

Fingerprint

Cite this