Tale of a robot: Humanoid robot assisted sign language tutoring

Hatice Kose*, Rabia Yorganci

*Corresponding author for this work

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

39 Citations (Scopus)

Abstract

There is an on-going study which aims to assist in teaching Sign Language (SL) to hearing impaired children by means of non-verbal communication and imitation based interaction games between a humanoid robot and the child. In this study, the robot will be able to express a word in SL among a set of chosen words using hand movements, body and face gestures. Having comprehended the word, the child will give relevant feedback to the robot. In the current study, we propose an interactive story telling game between a NAO H25 humanoid robot and preschool children based on Turkish Sign Language (TSL). Since most of the children do not know how to read and write, and they are not familiar with sign language, we prepared a short story including specially selected words which is performed by the robot verbally and with sign language as well. The children are expected to give feedback to the robot with matching colour flashcards when it implements a word in sign language. The robotic event covered 106 preschool children. The aim is to evaluate the children's sign language learning ability from a robot, and comparison of these results with the results of video based studies.

Original languageEnglish
Title of host publication2011 11th IEEE-RAS International Conference on Humanoid Robots, HUMANOIDS 2011
Pages105-111
Number of pages7
DOIs
Publication statusPublished - 2011
Event2011 11th IEEE-RAS International Conference on Humanoid Robots, HUMANOIDS 2011 - Bled, Slovenia
Duration: 26 Oct 201128 Oct 2011

Publication series

NameIEEE-RAS International Conference on Humanoid Robots
ISSN (Print)2164-0572
ISSN (Electronic)2164-0580

Conference

Conference2011 11th IEEE-RAS International Conference on Humanoid Robots, HUMANOIDS 2011
Country/TerritorySlovenia
CityBled
Period26/10/1128/10/11

Keywords

  • Humanoid Robots
  • Interaction games
  • Non-verbal communication
  • Sign Language

Fingerprint

Dive into the research topics of 'Tale of a robot: Humanoid robot assisted sign language tutoring'. Together they form a unique fingerprint.

Cite this