Multi-lingual fingerspelling recognition for handicapped kiosk

A. A. Kindiroglu; H. Yalcin; O. Aran; M. Hruz; P. Campr; L. Akarun; A. Karpov

doi:10.1134/S1054661811020532

Multi-lingual fingerspelling recognition for handicapped kiosk

A. A. Kindiroglu
, H. Yalcin
, O. Aran
, M. Hruz
, P. Campr
, L. Akarun
, A. Karpov

Bogazici University
IDIAP Research Institute
University of West Bohemia
Russian Academy of Sciences

Araştırma sonucu: Dergiye katkı › Makale › bilirkişi

2 Atıf (Scopus)

Özet

This paper presents the design and evaluation of a multi-lingual fingerspelling recognition module that is designed for an information terminal. Through the use of multimodal input and output methods, the information terminal acts as a communication medium between deaf and blind people. The system converts fingerspelled words to speech and vice versa using fingerspelling recognition, fingerspelling synthesis, speech recognition and speech synthesis in Czech, Russian and Turkish Languages. We describe an adaptive skin color based fingersign recognition system with a close to real-time performance and present recognition results on 88 different letters signed by five different signers, using more than four hours of training and test videos.

Orijinal dil	İngilizce
Sayfa (başlangıç-bitiş)	402-406
Sayfa sayısı	5
Dergi	Pattern Recognition and Image Analysis
Hacim	21
Basın numarası	3
DOI'lar	https://doi.org/10.1134/S1054661811020532
Yayın durumu	Yayınlandı - Eyl 2011
Harici olarak yayınlandı	Evet

Finansman

RFBR no. 09 07 91220, Grant of the President of Russia (no. MK 64898.2010.8) The work has been supported by the grant of the UWB, project no. SGS 2010 054. This research was supported by the MECR, project no. ME08106. This work has been supported by TUBITAK Project 108E113.

Finansörler	Finansör numarası
MECR
TUBITAK	108E113
UWB

Belgeye Erişim

10.1134/S1054661811020532

Diğer Dosyalar ve Linkler

Link to publication in Scopus

Alıntı Yap

@article{567d7573916c43e594b3eef5a46dbd23,

title = "Multi-lingual fingerspelling recognition for handicapped kiosk",

abstract = "This paper presents the design and evaluation of a multi-lingual fingerspelling recognition module that is designed for an information terminal. Through the use of multimodal input and output methods, the information terminal acts as a communication medium between deaf and blind people. The system converts fingerspelled words to speech and vice versa using fingerspelling recognition, fingerspelling synthesis, speech recognition and speech synthesis in Czech, Russian and Turkish Languages. We describe an adaptive skin color based fingersign recognition system with a close to real-time performance and present recognition results on 88 different letters signed by five different signers, using more than four hours of training and test videos.",

author = "Kindiroglu, \{A. A.\} and H. Yalcin and O. Aran and M. Hruz and P. Campr and L. Akarun and A. Karpov",

year = "2011",

month = sep,

doi = "10.1134/S1054661811020532",

language = "English",

volume = "21",

pages = "402--406",

journal = "Pattern Recognition and Image Analysis",

issn = "1054-6618",

publisher = "Pleiades Publishing",

number = "3",

}

TY - JOUR

T1 - Multi-lingual fingerspelling recognition for handicapped kiosk

AU - Kindiroglu, A. A.

AU - Yalcin, H.

AU - Aran, O.

AU - Hruz, M.

AU - Campr, P.

AU - Akarun, L.

AU - Karpov, A.

PY - 2011/9

Y1 - 2011/9

N2 - This paper presents the design and evaluation of a multi-lingual fingerspelling recognition module that is designed for an information terminal. Through the use of multimodal input and output methods, the information terminal acts as a communication medium between deaf and blind people. The system converts fingerspelled words to speech and vice versa using fingerspelling recognition, fingerspelling synthesis, speech recognition and speech synthesis in Czech, Russian and Turkish Languages. We describe an adaptive skin color based fingersign recognition system with a close to real-time performance and present recognition results on 88 different letters signed by five different signers, using more than four hours of training and test videos.

AB - This paper presents the design and evaluation of a multi-lingual fingerspelling recognition module that is designed for an information terminal. Through the use of multimodal input and output methods, the information terminal acts as a communication medium between deaf and blind people. The system converts fingerspelled words to speech and vice versa using fingerspelling recognition, fingerspelling synthesis, speech recognition and speech synthesis in Czech, Russian and Turkish Languages. We describe an adaptive skin color based fingersign recognition system with a close to real-time performance and present recognition results on 88 different letters signed by five different signers, using more than four hours of training and test videos.

UR - https://www.scopus.com/pages/publications/80052635768

U2 - 10.1134/S1054661811020532

DO - 10.1134/S1054661811020532

M3 - Article

AN - SCOPUS:80052635768

SN - 1054-6618

VL - 21

SP - 402

EP - 406

JO - Pattern Recognition and Image Analysis

JF - Pattern Recognition and Image Analysis

IS - 3

ER -

Multi-lingual fingerspelling recognition for handicapped kiosk

Özet

Finansman

Belgeye Erişim

Diğer Dosyalar ve Linkler

Parmak izi

Alıntı Yap