Abstract
This paper presents the design and evaluation of a multi-lingual fingerspelling recognition module that is designed for an information terminal. Through the use of multimodal input and output methods, the information terminal acts as a communication medium between deaf and blind people. The system converts fingerspelled words to speech and vice versa using fingerspelling recognition, fingerspelling synthesis, speech recognition and speech synthesis in Czech, Russian and Turkish Languages. We describe an adaptive skin color based fingersign recognition system with a close to real-time performance and present recognition results on 88 different letters signed by five different signers, using more than four hours of training and test videos.
| Original language | English |
|---|---|
| Pages (from-to) | 402-406 |
| Number of pages | 5 |
| Journal | Pattern Recognition and Image Analysis |
| Volume | 21 |
| Issue number | 3 |
| DOIs | |
| Publication status | Published - Sept 2011 |
| Externally published | Yes |
Funding
RFBR no. 09 07 91220, Grant of the President of Russia (no. MK 64898.2010.8) The work has been supported by the grant of the UWB, project no. SGS 2010 054. This research was supported by the MECR, project no. ME08106. This work has been supported by TUBITAK Project 108E113.
| Funders | Funder number |
|---|---|
| MECR | |
| TUBITAK | 108E113 |
| UWB |