RPPG Detection in Children with Autism Spectrum Disorder during Robot-child Interaction Studies

Şeyma Takır, Hatice Kose, Buket Coskun, Duygun Erol Barkana

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

1 Citation (Scopus)

Abstract

Children with ASD (Autism spectrum disorder) have difficulties in expressing their emotions and social interaction with their environment. In recent studies, asistive robots are used to support children's social skills and emotion recognition is performed to improve the quality of the interaction between the robot and the child. In this study, rPPG(remote photoplethysmography) signals were extracted using face images that were captured through camera during the interaction between the robot and children with ASD. These signals were then compared with the physiological data obtained through Empatica E4 wristwatch. The results were evaluated and the reasons that might affect the results were discussed. Although the correlation between these data was low, some advantages were found in the results compared to both the E4 wristwatch and emotion recognition from face. Unlike the signals obtained from E4, rPPG signals can be found when the child moves. In addition, although no emotion can be detected from the child's face, rPPG signals can be obtained. The aim of the study is to use rPPG signals in emotion recognition as an alternative method since other emotion recognition modalities face with challenges during robot child interaction in children with ASD.

Original languageEnglish
Title of host publication2022 International Conference on Digital Image Computing
Subtitle of host publicationTechniques and Applications, DICTA 2022
PublisherInstitute of Electrical and Electronics Engineers Inc.
ISBN (Electronic)9781665456425
DOIs
Publication statusPublished - 2022
Event2022 International Conference on Digital Image Computing: Techniques and Applications, DICTA 2022 - Sydney, Australia
Duration: 30 Nov 20222 Dec 2022

Publication series

Name2022 International Conference on Digital Image Computing: Techniques and Applications, DICTA 2022

Conference

Conference2022 International Conference on Digital Image Computing: Techniques and Applications, DICTA 2022
Country/TerritoryAustralia
CitySydney
Period30/11/222/12/22

Bibliographical note

Publisher Copyright:
© 2022 IEEE.

Keywords

  • autism spectrum disorder
  • child-robot interaction
  • emotion recognition
  • rPPG

Fingerprint

Dive into the research topics of 'RPPG Detection in Children with Autism Spectrum Disorder during Robot-child Interaction Studies'. Together they form a unique fingerprint.

Cite this