Detecting Code-Switching between Turkish-English Language Pair

Zeynep Yirmibeşoğlu; Gülşen Eryiğit

Detecting Code-Switching between Turkish-English Language Pair

Zeynep Yirmibeşoğlu
, Gülşen Eryiğit

Yapay Zeka ve Veri Mühendisliği Bölümü

Istanbul Technical University

Araştırma çıktısı: Kitap/Rapor/Konferans Bildirisinde Bölüm › Konferans katkısı › Hakemli

21 Atıf (Scopus)

Özet

Code-switching (usage of different languages within a single conversation context in an alternative manner) is a highly increasing phenomenon in social media and colloquial usage which poses different challenges for natural language processing. This paper introduces the first study for the detection of Turkish-English code-switching and also a small test data collected from social media in order to smooth the way for further studies. The proposed system using character level n-grams and conditional random fields (CRFs) obtains 95.6% micro-averaged F1-score on the introduced test data set.

Orijinal dil	İngilizce
Ana bilgisayar yayını başlığı	4th Workshop on Noisy User-Generated Text, W-NUT 2018 - Proceedings of the Workshop
Yayınlayan	Association for Computational Linguistics (ACL)
Sayfalar	110-115
Sayfa sayısı	6
ISBN (Elektronik)	9781948087797
Yayın durumu	Yayınlandı - 2018
Etkinlik	4th Workshop on Noisy User-Generated Text, W-NUT 2018 - Brussels, Belgium Süre: 1 Kas 2018 → …

Yayın serisi

Adı	4th Workshop on Noisy User-Generated Text, W-NUT 2018 - Proceedings of the Workshop

???event.eventtypes.event.conference???

???event.eventtypes.event.conference???	4th Workshop on Noisy User-Generated Text, W-NUT 2018
Ülke/Bölge	Belgium
Şehir	Brussels
Periyot	1/11/18 → …

Bibliyografik not

Publisher Copyright:
© 2018 Association for Computational Linguistics.

Diğer Dosyalar ve Linkler

Link to publication in Scopus

Alıntı Yap

@inproceedings{e9f23e20d5a14062af78ff9356357484,

title = "Detecting Code-Switching between Turkish-English Language Pair",

abstract = "Code-switching (usage of different languages within a single conversation context in an alternative manner) is a highly increasing phenomenon in social media and colloquial usage which poses different challenges for natural language processing. This paper introduces the first study for the detection of Turkish-English code-switching and also a small test data collected from social media in order to smooth the way for further studies. The proposed system using character level n-grams and conditional random fields (CRFs) obtains 95.6\% micro-averaged F1-score on the introduced test data set.",

author = "Zeynep Yirmibe{\c s}oğlu and G{\"u}l{\c s}en Eryiğit",

note = "Publisher Copyright: {\textcopyright} 2018 Association for Computational Linguistics.; 4th Workshop on Noisy User-Generated Text, W-NUT 2018 ; Conference date: 01-11-2018",

year = "2018",

language = "English",

series = "4th Workshop on Noisy User-Generated Text, W-NUT 2018 - Proceedings of the Workshop",

publisher = "Association for Computational Linguistics (ACL)",

pages = "110--115",

booktitle = "4th Workshop on Noisy User-Generated Text, W-NUT 2018 - Proceedings of the Workshop",

address = "United States",

}

Yirmibeşoğlu, Z & Eryiğit, G 2018, Detecting Code-Switching between Turkish-English Language Pair. in 4th Workshop on Noisy User-Generated Text, W-NUT 2018 - Proceedings of the Workshop. 4th Workshop on Noisy User-Generated Text, W-NUT 2018 - Proceedings of the Workshop, Association for Computational Linguistics (ACL), pp. 110-115, 4th Workshop on Noisy User-Generated Text, W-NUT 2018, Brussels, Belgium, 1/11/18.

Detecting Code-Switching between Turkish-English Language Pair. / Yirmibeşoğlu, Zeynep; Eryiğit, Gülşen.
4th Workshop on Noisy User-Generated Text, W-NUT 2018 - Proceedings of the Workshop. Association for Computational Linguistics (ACL), 2018. p. 110-115 (4th Workshop on Noisy User-Generated Text, W-NUT 2018 - Proceedings of the Workshop).

Araştırma çıktısı: Kitap/Rapor/Konferans Bildirisinde Bölüm › Konferans katkısı › Hakemli

TY - GEN

T1 - Detecting Code-Switching between Turkish-English Language Pair

AU - Yirmibeşoğlu, Zeynep

AU - Eryiğit, Gülşen

PY - 2018

Y1 - 2018

N2 - Code-switching (usage of different languages within a single conversation context in an alternative manner) is a highly increasing phenomenon in social media and colloquial usage which poses different challenges for natural language processing. This paper introduces the first study for the detection of Turkish-English code-switching and also a small test data collected from social media in order to smooth the way for further studies. The proposed system using character level n-grams and conditional random fields (CRFs) obtains 95.6% micro-averaged F1-score on the introduced test data set.

AB - Code-switching (usage of different languages within a single conversation context in an alternative manner) is a highly increasing phenomenon in social media and colloquial usage which poses different challenges for natural language processing. This paper introduces the first study for the detection of Turkish-English code-switching and also a small test data collected from social media in order to smooth the way for further studies. The proposed system using character level n-grams and conditional random fields (CRFs) obtains 95.6% micro-averaged F1-score on the introduced test data set.

UR - https://www.scopus.com/pages/publications/85084642799

M3 - Conference contribution

AN - SCOPUS:85084642799

T3 - 4th Workshop on Noisy User-Generated Text, W-NUT 2018 - Proceedings of the Workshop

SP - 110

EP - 115

BT - 4th Workshop on Noisy User-Generated Text, W-NUT 2018 - Proceedings of the Workshop

PB - Association for Computational Linguistics (ACL)

T2 - 4th Workshop on Noisy User-Generated Text, W-NUT 2018

Y2 - 1 November 2018

ER -

Detecting Code-Switching between Turkish-English Language Pair

Özet

Yayın serisi

???event.eventtypes.event.conference???

Bibliyografik not

Diğer Dosyalar ve Linkler

Parmak izi

Alıntı Yap