TY - GEN
T1 - Ispy-usign humanoid assisted interactive sign language tutoring games
AU - Akalin, Neziha
AU - Uluer, Pinar
AU - Kose, Hatice
PY - 2013
Y1 - 2013
N2 - The work presented in this paper was carried out within an on-going project which aims to assist in Sign language tutoring to children with communication problems by means of interaction games with a humanoid robot. In this project, the robot is able to express words in the Turkish Sign language (TSL) and American Sign Language (ASL), and having comprehended the word, the child is motivated to give relevant feedback to the robot with colored flashcards, signs and sound. Within the multi-modal turn-taking games, child both learns the semantic and the realization of the words, besides have chance to test this information through imitation based interaction games. The performance of the children is also verified with flash card based activities as a part of the game, as a feedback for the teacher/parent. Child's performance is recognized and evaluated by the robot through an RGB-D camera based system. This paper summarizes a longitudinal exploratory study from a classroom work, where children were taught 6 gestures including signs from ASL and TSL with the assistance of a Nao H25 humanoid robot. The performances of the children and robot are presented and discussed in terms of children's subjective and objective evaluations.
AB - The work presented in this paper was carried out within an on-going project which aims to assist in Sign language tutoring to children with communication problems by means of interaction games with a humanoid robot. In this project, the robot is able to express words in the Turkish Sign language (TSL) and American Sign Language (ASL), and having comprehended the word, the child is motivated to give relevant feedback to the robot with colored flashcards, signs and sound. Within the multi-modal turn-taking games, child both learns the semantic and the realization of the words, besides have chance to test this information through imitation based interaction games. The performance of the children is also verified with flash card based activities as a part of the game, as a feedback for the teacher/parent. Child's performance is recognized and evaluated by the robot through an RGB-D camera based system. This paper summarizes a longitudinal exploratory study from a classroom work, where children were taught 6 gestures including signs from ASL and TSL with the assistance of a Nao H25 humanoid robot. The performances of the children and robot are presented and discussed in terms of children's subjective and objective evaluations.
UR - https://www.scopus.com/pages/publications/84889575163
U2 - 10.1109/ROMAN.2013.6628428
DO - 10.1109/ROMAN.2013.6628428
M3 - Conference contribution
AN - SCOPUS:84889575163
SN - 9781479905072
T3 - Proceedings - IEEE International Workshop on Robot and Human Interactive Communication
SP - 290
EP - 291
BT - 22nd IEEE International Symposium on Robot and Human Interactive Communication
T2 - 22nd IEEE International Symposium on Robot and Human Interactive Communication: "Living Together, Enjoying Together, and Working Together with Robots!", IEEE RO-MAN 2013
Y2 - 26 August 2013 through 29 August 2013
ER -