Insansi robot destekli interaktif isaret dili egitimi için isaret tanima

Translated title of the contribution: Gesture recognition for humanoid assisted interactive sign language tutoring

Bekir Sitki Ertugrul, Cemal Gurpinar, Hasan Kivrak, Hatice Kose

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

17 Citations (Scopus)

Abstract

This work is part of an ongoing work for sign language tutoring with imitation based turn-taking and interaction games (iSign) with humanoid robots and children with communication impairments. The paper focuses on the extension of the game, mainly for children with autism. Autism Spektrum Disorder (ASD) involves communication impairments, limited social interaction, and limited imagination. Many such children show interest in robots and find them engaging. Robots can facilitate social interaction between the child and teacher. In this work, a Nao H25 Humanoid robot assisted the human teacher to teach some signs and basic upper torso actions which were observed and imitated by the participants. Kinect camera based system was used to recognize the signs and other actions, and the robot gave visual and audial feedback to the participants based on the performance.

Translated title of the contributionGesture recognition for humanoid assisted interactive sign language tutoring
Original languageTurkish
Title of host publication2013 21st Signal Processing and Communications Applications Conference, SIU 2013
DOIs
Publication statusPublished - 2013
Event2013 21st Signal Processing and Communications Applications Conference, SIU 2013 - Haspolat, Turkey
Duration: 24 Apr 201326 Apr 2013

Publication series

Name2013 21st Signal Processing and Communications Applications Conference, SIU 2013

Conference

Conference2013 21st Signal Processing and Communications Applications Conference, SIU 2013
Country/TerritoryTurkey
CityHaspolat
Period24/04/1326/04/13

Fingerprint

Dive into the research topics of 'Gesture recognition for humanoid assisted interactive sign language tutoring'. Together they form a unique fingerprint.

Cite this