Automatic fingersign-to-speech translation system

Marek Hrúz; Pavel Campr; E. Dikici; Ahmet Alp Kindiroǧlu; Zdeněk Krňoul; Alexander Ronzhin; Haşim Sak; Daniel Schorno; Hülya Yalçin; Lale Akarun; Oya Aran; Alexey Karpov; Murat Saraçlar; Milos Železný

doi:10.1007/s12193-011-0059-3

Automatic fingersign-to-speech translation system

Marek Hrúz^*, Pavel Campr, E. Dikici, Ahmet Alp Kindiroǧlu, Zdeněk Krňoul, Alexander Ronzhin, Haşim Sak, Daniel Schorno, Hülya Yalçin, Lale Akarun, Oya Aran, Alexey Karpov, Murat Saraçlar, Milos Železný

^*Corresponding author for this work

Research output: Contribution to journal › Article › peer-review

9 Citations (Scopus)

Abstract

The aim of this paper is to help the communication of two people, one hearing impaired and one visually impaired by converting speech to fingerspelling and fingerspelling to speech. Fingerspelling is a subset of sign language, and uses finger signs to spell letters of the spoken or written language. We aim to convert finger spelled words to speech and vice versa. Different spoken languages and sign languages such as English, Russian, Turkish and Czech are considered.

Original language	English
Pages (from-to)	61-79
Number of pages	19
Journal	Journal on Multimodal User Interfaces
Volume	4
Issue number	2
DOIs	https://doi.org/10.1007/s12193-011-0059-3
Publication status	Published - Jul 2011
Externally published	Yes

Funding

Acknowledgements This work was developed in the eNTER-FACE’10 Summer Workshop on Multimodal Interfaces, Amsterdam, the Netherlands. This work has been supported by: the Scientific and Technological Research Council of Turkey (TUBITAK) project No. 108E113; Grant of the President of Russia No. MK-64898.2010.8; the Ministry of Education and Science of Russia contracts No. 2579 and No. 2360; RFBR project No. 09-07-91220-CT-a; UWB project No. SGS-2010-054; project No. GACˇ R 102/09/P609; MECR project No. ME08106 and by the Grant Agency of Academy of Sciences of the Czech Republic project No. 1ET101470416.

Funders	Funder number
Russian Foundation for Basic Research	GACˇ R 102/09/P609, 09-07-91220-CT-a, SGS-2010-054, ME08106
Ministry of Education and Science of the Russian Federation	2579, 2360
Akademie Věd České Republiky	1ET101470416
Türkiye Bilimsel ve Teknolojik Araştirma Kurumu	MK-64898.2010.8, 108E113

Keywords

Fingerspelling recognition
Fingerspelling synthesis
Speech recognition
Speech synthesis

Access to Document

10.1007/s12193-011-0059-3

Cite this

@article{5ebc685d2ecb466d8b1e48edd66286b8,

title = "Automatic fingersign-to-speech translation system",

abstract = "The aim of this paper is to help the communication of two people, one hearing impaired and one visually impaired by converting speech to fingerspelling and fingerspelling to speech. Fingerspelling is a subset of sign language, and uses finger signs to spell letters of the spoken or written language. We aim to convert finger spelled words to speech and vice versa. Different spoken languages and sign languages such as English, Russian, Turkish and Czech are considered.",

keywords = "Fingerspelling recognition, Fingerspelling synthesis, Speech recognition, Speech synthesis",

author = "Marek Hr{\'u}z and Pavel Campr and E. Dikici and Kindiroǧlu, {Ahmet Alp} and Zden{\v e}k Kr{\v n}oul and Alexander Ronzhin and Ha{\c s}im Sak and Daniel Schorno and H{\"u}lya Yal{\c c}in and Lale Akarun and Oya Aran and Alexey Karpov and Murat Sara{\c c}lar and Milos {\v Z}elezn{\'y}",

year = "2011",

month = jul,

doi = "10.1007/s12193-011-0059-3",

language = "English",

volume = "4",

pages = "61--79",

journal = "Journal on Multimodal User Interfaces",

issn = "1783-7677",

publisher = "Springer Verlag",

number = "2",

}

TY - JOUR

T1 - Automatic fingersign-to-speech translation system

AU - Hrúz, Marek

AU - Campr, Pavel

AU - Dikici, E.

AU - Kindiroǧlu, Ahmet Alp

AU - Krňoul, Zdeněk

AU - Ronzhin, Alexander

AU - Sak, Haşim

AU - Schorno, Daniel

AU - Yalçin, Hülya

AU - Akarun, Lale

AU - Aran, Oya

AU - Karpov, Alexey

AU - Saraçlar, Murat

AU - Železný, Milos

PY - 2011/7

Y1 - 2011/7

N2 - The aim of this paper is to help the communication of two people, one hearing impaired and one visually impaired by converting speech to fingerspelling and fingerspelling to speech. Fingerspelling is a subset of sign language, and uses finger signs to spell letters of the spoken or written language. We aim to convert finger spelled words to speech and vice versa. Different spoken languages and sign languages such as English, Russian, Turkish and Czech are considered.

AB - The aim of this paper is to help the communication of two people, one hearing impaired and one visually impaired by converting speech to fingerspelling and fingerspelling to speech. Fingerspelling is a subset of sign language, and uses finger signs to spell letters of the spoken or written language. We aim to convert finger spelled words to speech and vice versa. Different spoken languages and sign languages such as English, Russian, Turkish and Czech are considered.

KW - Fingerspelling recognition

KW - Fingerspelling synthesis

KW - Speech recognition

KW - Speech synthesis

UR - http://www.scopus.com/inward/record.url?scp=79960558234&partnerID=8YFLogxK

U2 - 10.1007/s12193-011-0059-3

DO - 10.1007/s12193-011-0059-3

M3 - Article

AN - SCOPUS:79960558234

SN - 1783-7677

VL - 4

SP - 61

EP - 79

JO - Journal on Multimodal User Interfaces

JF - Journal on Multimodal User Interfaces

IS - 2

ER -

Automatic fingersign-to-speech translation system

Abstract

Funding

Keywords

Access to Document

Other files and links

Fingerprint

Cite this