Emotion recognition using EEG and physiological data for robot-assisted rehabilitation systems

Elif Gümüslü, Duygun Erol Barkana, Hatice Köse

Araştırma sonucu: ???type-name???Konferans katkısıbilirkişi

20 Atıf (Scopus)

Özet

Robot-assisted rehabilitation systems are developed to monitor the performance of the patients and adapt the rehabilitation task intensity and difficulty level accordingly to meet the needs of the patients. The robot-assisted rehabilitation systems can be more prosperous if they are able to recognize the emotions of patients, and modify the difficulty level of task considering these emotions to increase patient's engagement. We aim to develop an emotion recognition model using electroencephalography (EEG) and physiological signals (blood volume pulse (BVP), skin temperature (ST) and skin conductance (SC)) for a robot-assisted rehabilitation system. The emotions are grouped into three categories, which are positive (pleasant), negative (unpleasant) or neutral. A machine-learning algorithm called Gradient Boosting Machines (GBM) and a deep learning algorithm called Convolutional Neural Networks (CNN) are used to classify pleasant, unpleasant and neutral emotions from the recorded EEG and physiological signals. We ask the subjects to look at pleasant, unpleasant and neutral images from IAPS database and collect EEG and physiological signals during the experiments. The classification accuracies are compared for both GBM and CNN methods when only one sensory data (EEG, BVP, SC and ST) or the combination of the sensory data from both EEG and physiological signals are used.

Orijinal dilİngilizce
Ana bilgisayar yayını başlığıICMI 2020 Companion - Companion Publication of the 2020 International Conference on Multimodal Interaction
YayınlayanAssociation for Computing Machinery, Inc
Sayfalar379-387
Sayfa sayısı9
ISBN (Elektronik)9781450380027
DOI'lar
Yayın durumuYayınlandı - 25 Eki 2020
Etkinlik2020 International Conference on Multimodal Interaction, ICMI 2020 - Virtual, Online, Netherlands
Süre: 25 Eki 202029 Eki 2020

Yayın serisi

AdıICMI 2020 Companion - Companion Publication of the 2020 International Conference on Multimodal Interaction

???event.eventtypes.event.conference???

???event.eventtypes.event.conference???2020 International Conference on Multimodal Interaction, ICMI 2020
Ülke/BölgeNetherlands
ŞehirVirtual, Online
Periyot25/10/2029/10/20

Bibliyografik not

Publisher Copyright:
© 2020 ACM.

Finansman

This study is supported by the Turkish Academy of Sciences in scheme of the Outstanding Young Scientist Award (TÜBA-GEBİP).

FinansörlerFinansör numarası
TÜBA-GEBİP
Türkiye Bilimler Akademisi

    Parmak izi

    Emotion recognition using EEG and physiological data for robot-assisted rehabilitation systems' araştırma başlıklarına git. Birlikte benzersiz bir parmak izi oluştururlar.

    Alıntı Yap