Robostar: An interaction game with humanoid robots for learning sign language

Ahmet Özkul; Hatice Köse; Rabia Yorganci; Gökhan Ince

doi:10.1109/ROBIO.2014.7090384

Robostar: An interaction game with humanoid robots for learning sign language

Ahmet Özkul, Hatice Köse, Rabia Yorganci, Gökhan Ince

Istanbul Technical University

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

10 Citations (Scopus)

Abstract

This paper presents results from interactive robotic games based on a multimodal user interface. This game is intended to be used as part of children's education and therapy, within a project based on human-robot and humancomputer interaction games featuring non-verbal gestures and imitation for the purpose of teaching sign language. The humanoid robot acts as a social peer and assistant in the games to motivate the child, teach non verbal signs, evaluate the child's effort, and give appropriate feedback to improve the learning and recognition rate of children. In the games, videos of the robot are used, and the performance of the children with hearing impairment are assessed in terms of subjective and objective evaluation criteria. We verified that the results of the tests using the robot's video-based games are in accordance with the physical robots performing same word sets and test setups.

Original language	English
Title of host publication	2014 IEEE International Conference on Robotics and Biomimetics, IEEE ROBIO 2014
Publisher	Institute of Electrical and Electronics Engineers Inc.
Pages	522-527
Number of pages	6
ISBN (Electronic)	9781479973965
DOIs	https://doi.org/10.1109/ROBIO.2014.7090384
Publication status	Published - 20 Apr 2014
Event	2014 IEEE International Conference on Robotics and Biomimetics, IEEE ROBIO 2014 - Bali, Indonesia Duration: 5 Dec 2014 → 10 Dec 2014

Publication series

Name	2014 IEEE International Conference on Robotics and Biomimetics, IEEE ROBIO 2014

Conference

Conference	2014 IEEE International Conference on Robotics and Biomimetics, IEEE ROBIO 2014
Country/Territory	Indonesia
City	Bali
Period	5/12/14 → 10/12/14

Bibliographical note

Publisher Copyright:
© 2014 IEEE.

Access to Document

10.1109/ROBIO.2014.7090384

Cite this

Özkul, A., Köse, H., Yorganci, R., & Ince, G. (2014). Robostar: An interaction game with humanoid robots for learning sign language. In 2014 IEEE International Conference on Robotics and Biomimetics, IEEE ROBIO 2014 (pp. 522-527). Article 7090384 (2014 IEEE International Conference on Robotics and Biomimetics, IEEE ROBIO 2014). Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/ROBIO.2014.7090384

Özkul, Ahmet ; Köse, Hatice ; Yorganci, Rabia et al. / Robostar : An interaction game with humanoid robots for learning sign language. 2014 IEEE International Conference on Robotics and Biomimetics, IEEE ROBIO 2014. Institute of Electrical and Electronics Engineers Inc., 2014. pp. 522-527 (2014 IEEE International Conference on Robotics and Biomimetics, IEEE ROBIO 2014).

@inproceedings{da49548f6de74d8b80aacfe43b07f8e3,

title = "Robostar: An interaction game with humanoid robots for learning sign language",

abstract = "This paper presents results from interactive robotic games based on a multimodal user interface. This game is intended to be used as part of children's education and therapy, within a project based on human-robot and humancomputer interaction games featuring non-verbal gestures and imitation for the purpose of teaching sign language. The humanoid robot acts as a social peer and assistant in the games to motivate the child, teach non verbal signs, evaluate the child's effort, and give appropriate feedback to improve the learning and recognition rate of children. In the games, videos of the robot are used, and the performance of the children with hearing impairment are assessed in terms of subjective and objective evaluation criteria. We verified that the results of the tests using the robot's video-based games are in accordance with the physical robots performing same word sets and test setups.",

author = "Ahmet {\"O}zkul and Hatice K{\"o}se and Rabia Yorganci and G{\"o}khan Ince",

note = "Publisher Copyright: {\textcopyright} 2014 IEEE.; 2014 IEEE International Conference on Robotics and Biomimetics, IEEE ROBIO 2014 ; Conference date: 05-12-2014 Through 10-12-2014",

year = "2014",

month = apr,

day = "20",

doi = "10.1109/ROBIO.2014.7090384",

language = "English",

series = "2014 IEEE International Conference on Robotics and Biomimetics, IEEE ROBIO 2014",

publisher = "Institute of Electrical and Electronics Engineers Inc.",

pages = "522--527",

booktitle = "2014 IEEE International Conference on Robotics and Biomimetics, IEEE ROBIO 2014",

address = "United States",

}

Özkul, A, Köse, H, Yorganci, R & Ince, G 2014, Robostar: An interaction game with humanoid robots for learning sign language. in 2014 IEEE International Conference on Robotics and Biomimetics, IEEE ROBIO 2014., 7090384, 2014 IEEE International Conference on Robotics and Biomimetics, IEEE ROBIO 2014, Institute of Electrical and Electronics Engineers Inc., pp. 522-527, 2014 IEEE International Conference on Robotics and Biomimetics, IEEE ROBIO 2014, Bali, Indonesia, 5/12/14. https://doi.org/10.1109/ROBIO.2014.7090384

Robostar: An interaction game with humanoid robots for learning sign language. / Özkul, Ahmet; Köse, Hatice; Yorganci, Rabia et al.
2014 IEEE International Conference on Robotics and Biomimetics, IEEE ROBIO 2014. Institute of Electrical and Electronics Engineers Inc., 2014. p. 522-527 7090384 (2014 IEEE International Conference on Robotics and Biomimetics, IEEE ROBIO 2014).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

TY - GEN

T1 - Robostar

T2 - 2014 IEEE International Conference on Robotics and Biomimetics, IEEE ROBIO 2014

AU - Özkul, Ahmet

AU - Köse, Hatice

AU - Yorganci, Rabia

AU - Ince, Gökhan

PY - 2014/4/20

Y1 - 2014/4/20

N2 - This paper presents results from interactive robotic games based on a multimodal user interface. This game is intended to be used as part of children's education and therapy, within a project based on human-robot and humancomputer interaction games featuring non-verbal gestures and imitation for the purpose of teaching sign language. The humanoid robot acts as a social peer and assistant in the games to motivate the child, teach non verbal signs, evaluate the child's effort, and give appropriate feedback to improve the learning and recognition rate of children. In the games, videos of the robot are used, and the performance of the children with hearing impairment are assessed in terms of subjective and objective evaluation criteria. We verified that the results of the tests using the robot's video-based games are in accordance with the physical robots performing same word sets and test setups.

AB - This paper presents results from interactive robotic games based on a multimodal user interface. This game is intended to be used as part of children's education and therapy, within a project based on human-robot and humancomputer interaction games featuring non-verbal gestures and imitation for the purpose of teaching sign language. The humanoid robot acts as a social peer and assistant in the games to motivate the child, teach non verbal signs, evaluate the child's effort, and give appropriate feedback to improve the learning and recognition rate of children. In the games, videos of the robot are used, and the performance of the children with hearing impairment are assessed in terms of subjective and objective evaluation criteria. We verified that the results of the tests using the robot's video-based games are in accordance with the physical robots performing same word sets and test setups.

UR - http://www.scopus.com/inward/record.url?scp=84949927054&partnerID=8YFLogxK

U2 - 10.1109/ROBIO.2014.7090384

DO - 10.1109/ROBIO.2014.7090384

M3 - Conference contribution

AN - SCOPUS:84949927054

T3 - 2014 IEEE International Conference on Robotics and Biomimetics, IEEE ROBIO 2014

SP - 522

EP - 527

BT - 2014 IEEE International Conference on Robotics and Biomimetics, IEEE ROBIO 2014

PB - Institute of Electrical and Electronics Engineers Inc.

Y2 - 5 December 2014 through 10 December 2014

ER -

Özkul A, Köse H, Yorganci R, Ince G. Robostar: An interaction game with humanoid robots for learning sign language. In 2014 IEEE International Conference on Robotics and Biomimetics, IEEE ROBIO 2014. Institute of Electrical and Electronics Engineers Inc. 2014. p. 522-527. 7090384. (2014 IEEE International Conference on Robotics and Biomimetics, IEEE ROBIO 2014). doi: 10.1109/ROBIO.2014.7090384

Robostar: An interaction game with humanoid robots for learning sign language

Abstract

Publication series

Conference

Bibliographical note

Access to Document

Other files and links

Fingerprint

Cite this