Automatic fingersign-to-speech translation system

Marek Hrúz*, Pavel Campr, E. Dikici, Ahmet Alp Kindiroǧlu, Zdeněk Krňoul, Alexander Ronzhin, Haşim Sak, Daniel Schorno, Hülya Yalçin, Lale Akarun, Oya Aran, Alexey Karpov, Murat Saraçlar, Milos Železný

*Corresponding author for this work

Research output: Contribution to journalArticlepeer-review

9 Citations (Scopus)

Abstract

The aim of this paper is to help the communication of two people, one hearing impaired and one visually impaired by converting speech to fingerspelling and fingerspelling to speech. Fingerspelling is a subset of sign language, and uses finger signs to spell letters of the spoken or written language. We aim to convert finger spelled words to speech and vice versa. Different spoken languages and sign languages such as English, Russian, Turkish and Czech are considered.

Original languageEnglish
Pages (from-to)61-79
Number of pages19
JournalJournal on Multimodal User Interfaces
Volume4
Issue number2
DOIs
Publication statusPublished - Jul 2011
Externally publishedYes

Keywords

  • Fingerspelling recognition
  • Fingerspelling synthesis
  • Speech recognition
  • Speech synthesis

Fingerprint

Dive into the research topics of 'Automatic fingersign-to-speech translation system'. Together they form a unique fingerprint.

Cite this