Aktif Robot Algilamasi Için Görsel-Işitsel Insan Takibi

Baris Bayram; Gokhan Ince

doi:10.1109/SIU.2015.7130068

Aktif Robot Algilamasi Için Görsel-Işitsel Insan Takibi

Translated title of the contribution: Audio-visual human tracking for active robot perception

Baris Bayram, Gokhan Ince

Department of Computer Engineering

Istanbul Technical University

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

3 Citations (Scopus)

Abstract

In this paper, a multimodal system is designed in the form of an active audio-vision in order to improve the perceptual capability of a robot in a noisy environment. The system running in real-time consists of 1) audition modality, 2) a complementary vision modality and 3) motion modality incorporating intelligent behaviors based on the data obtained from both modalities. The tasks of audition and vision are to detect, localize and track a speaker independently. The aim of motion modality is to enable a robot to have intelligent and human-like behaviors by using localization results from the sensor fusion. The system is implemented on a mobile robot platform in a real-time environment and the speaker tracking performance of the fusion is confirmed to be improved compared to each of sensory modalities.

Translated title of the contribution	Audio-visual human tracking for active robot perception
Original language	Turkish
Title of host publication	2015 23rd Signal Processing and Communications Applications Conference, SIU 2015 - Proceedings
Publisher	Institute of Electrical and Electronics Engineers Inc.
Pages	1264-1267
Number of pages	4
ISBN (Electronic)	9781467373869
DOIs	https://doi.org/10.1109/SIU.2015.7130068
Publication status	Published - 19 Jun 2015
Event	2015 23rd Signal Processing and Communications Applications Conference, SIU 2015 - Malatya, Turkey Duration: 16 May 2015 → 19 May 2015

Publication series

Name	2015 23rd Signal Processing and Communications Applications Conference, SIU 2015 - Proceedings

Conference

Conference	2015 23rd Signal Processing and Communications Applications Conference, SIU 2015
Country/Territory	Turkey
City	Malatya
Period	16/05/15 → 19/05/15

Bibliographical note

Publisher Copyright:
© 2015 IEEE.

Access to Document

10.1109/SIU.2015.7130068

Cite this

Bayram, B., & Ince, G. (2015). Aktif Robot Algilamasi Için Görsel-Işitsel Insan Takibi. In 2015 23rd Signal Processing and Communications Applications Conference, SIU 2015 - Proceedings (pp. 1264-1267). Article 7130068 (2015 23rd Signal Processing and Communications Applications Conference, SIU 2015 - Proceedings). Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/SIU.2015.7130068

@inproceedings{4b0fd06f3dd049a3b7a813a557970345,

title = "Aktif Robot Algilamasi I{\c c}in G{\"o}rsel-I{\c s}itsel Insan Takibi",

abstract = "In this paper, a multimodal system is designed in the form of an active audio-vision in order to improve the perceptual capability of a robot in a noisy environment. The system running in real-time consists of 1) audition modality, 2) a complementary vision modality and 3) motion modality incorporating intelligent behaviors based on the data obtained from both modalities. The tasks of audition and vision are to detect, localize and track a speaker independently. The aim of motion modality is to enable a robot to have intelligent and human-like behaviors by using localization results from the sensor fusion. The system is implemented on a mobile robot platform in a real-time environment and the speaker tracking performance of the fusion is confirmed to be improved compared to each of sensory modalities.",

keywords = "Active audiovision, Multimodal perception, Robotics, Sensor fusion, Sound source localization, Speaker tracking",

author = "Baris Bayram and Gokhan Ince",

note = "Publisher Copyright: {\textcopyright} 2015 IEEE.; 2015 23rd Signal Processing and Communications Applications Conference, SIU 2015 ; Conference date: 16-05-2015 Through 19-05-2015",

year = "2015",

month = jun,

day = "19",

doi = "10.1109/SIU.2015.7130068",

language = "T{\"u}rk{\c c}e",

series = "2015 23rd Signal Processing and Communications Applications Conference, SIU 2015 - Proceedings",

publisher = "Institute of Electrical and Electronics Engineers Inc.",

pages = "1264--1267",

booktitle = "2015 23rd Signal Processing and Communications Applications Conference, SIU 2015 - Proceedings",

address = "United States",

}

Bayram, B & Ince, G 2015, Aktif Robot Algilamasi Için Görsel-Işitsel Insan Takibi. in 2015 23rd Signal Processing and Communications Applications Conference, SIU 2015 - Proceedings., 7130068, 2015 23rd Signal Processing and Communications Applications Conference, SIU 2015 - Proceedings, Institute of Electrical and Electronics Engineers Inc., pp. 1264-1267, 2015 23rd Signal Processing and Communications Applications Conference, SIU 2015, Malatya, Turkey, 16/05/15. https://doi.org/10.1109/SIU.2015.7130068

Aktif Robot Algilamasi Için Görsel-Işitsel Insan Takibi. / Bayram, Baris; Ince, Gokhan.
2015 23rd Signal Processing and Communications Applications Conference, SIU 2015 - Proceedings. Institute of Electrical and Electronics Engineers Inc., 2015. p. 1264-1267 7130068 (2015 23rd Signal Processing and Communications Applications Conference, SIU 2015 - Proceedings).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

TY - GEN

T1 - Aktif Robot Algilamasi Için Görsel-Işitsel Insan Takibi

AU - Bayram, Baris

AU - Ince, Gokhan

PY - 2015/6/19

Y1 - 2015/6/19

N2 - In this paper, a multimodal system is designed in the form of an active audio-vision in order to improve the perceptual capability of a robot in a noisy environment. The system running in real-time consists of 1) audition modality, 2) a complementary vision modality and 3) motion modality incorporating intelligent behaviors based on the data obtained from both modalities. The tasks of audition and vision are to detect, localize and track a speaker independently. The aim of motion modality is to enable a robot to have intelligent and human-like behaviors by using localization results from the sensor fusion. The system is implemented on a mobile robot platform in a real-time environment and the speaker tracking performance of the fusion is confirmed to be improved compared to each of sensory modalities.

AB - In this paper, a multimodal system is designed in the form of an active audio-vision in order to improve the perceptual capability of a robot in a noisy environment. The system running in real-time consists of 1) audition modality, 2) a complementary vision modality and 3) motion modality incorporating intelligent behaviors based on the data obtained from both modalities. The tasks of audition and vision are to detect, localize and track a speaker independently. The aim of motion modality is to enable a robot to have intelligent and human-like behaviors by using localization results from the sensor fusion. The system is implemented on a mobile robot platform in a real-time environment and the speaker tracking performance of the fusion is confirmed to be improved compared to each of sensory modalities.

KW - Active audiovision

KW - Multimodal perception

KW - Robotics

KW - Sensor fusion

KW - Sound source localization

KW - Speaker tracking

UR - https://www.scopus.com/pages/publications/84939192703

U2 - 10.1109/SIU.2015.7130068

DO - 10.1109/SIU.2015.7130068

M3 - Konferans katkısı

AN - SCOPUS:84939192703

T3 - 2015 23rd Signal Processing and Communications Applications Conference, SIU 2015 - Proceedings

SP - 1264

EP - 1267

BT - 2015 23rd Signal Processing and Communications Applications Conference, SIU 2015 - Proceedings

PB - Institute of Electrical and Electronics Engineers Inc.

T2 - 2015 23rd Signal Processing and Communications Applications Conference, SIU 2015

Y2 - 16 May 2015 through 19 May 2015

ER -

Bayram B, Ince G. Aktif Robot Algilamasi Için Görsel-Işitsel Insan Takibi. In 2015 23rd Signal Processing and Communications Applications Conference, SIU 2015 - Proceedings. Institute of Electrical and Electronics Engineers Inc. 2015. p. 1264-1267. 7130068. (2015 23rd Signal Processing and Communications Applications Conference, SIU 2015 - Proceedings). doi: 10.1109/SIU.2015.7130068

Aktif Robot Algilamasi Için Görsel-Işitsel Insan Takibi

Abstract

Publication series

Conference

Bibliographical note

Access to Document

Other files and links

Fingerprint

Cite this