Gesture recognition for humanoid assisted interactive sign language tutoring

Bekir Sitki Ertuǧrul, Cemal Gurpinar, Hasan Kivrak, Ajla Kulaglic, Hatice Kose

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

4 Citations (Scopus)

Abstract

This work is part of an ongoing work for sign language tutoring with imitation based turn-taking and interaction games (iSign) with humanoid robots and children with communication impairments. The paper focuses on the extension of the game, mainly for children with autism. Autism Spectrum Disorder (ASD) involves communication impairments, limited social interaction, and limited imagination. Many such children show interest in robots and find them engaging. Robots can facilitate social interaction between the child and teacher. In this work, a Nao H25 Humanoid robot assisted the human teacher to teach some signs and basic upper torso actions which were observed and imitated by the participants. Kinect camera based system was used to recognize the signs and other actions, and the robot gave visual and audial feedback to the participants based on the performance.

Original languageEnglish
Title of host publicationACHI 2013 - 6th International Conference on Advances in Computer-Human Interactions
EditorsLeslie Miller
PublisherInternational Academy, Research and Industry Association, IARIA
Pages135-140
Number of pages6
ISBN (Electronic)9781612082509
Publication statusPublished - 2013
Event6th International Conference on Advances in Computer-Human Interactions, ACHI 2013 - Nice, France
Duration: 24 Feb 20131 Mar 2013

Publication series

NameACHI 2013 - 6th International Conference on Advances in Computer-Human Interactions

Conference

Conference6th International Conference on Advances in Computer-Human Interactions, ACHI 2013
Country/TerritoryFrance
CityNice
Period24/02/131/03/13

Bibliographical note

Publisher Copyright:
© Copyright IARIA, 2013.

Keywords

  • Autism
  • Human-robot interaction
  • Imitation games
  • Sign language

Fingerprint

Dive into the research topics of 'Gesture recognition for humanoid assisted interactive sign language tutoring'. Together they form a unique fingerprint.

Cite this