Abstract
Code-switching (usage of different languages within a single conversation context in an alternative manner) is a highly increasing phenomenon in social media and colloquial usage which poses different challenges for natural language processing. This paper introduces the first study for the detection of Turkish-English code-switching and also a small test data collected from social media in order to smooth the way for further studies. The proposed system using character level n-grams and conditional random fields (CRFs) obtains 95.6% micro-averaged F1-score on the introduced test data set.
Original language | English |
---|---|
Title of host publication | 4th Workshop on Noisy User-Generated Text, W-NUT 2018 - Proceedings of the Workshop |
Publisher | Association for Computational Linguistics (ACL) |
Pages | 110-115 |
Number of pages | 6 |
ISBN (Electronic) | 9781948087797 |
Publication status | Published - 2018 |
Event | 4th Workshop on Noisy User-Generated Text, W-NUT 2018 - Brussels, Belgium Duration: 1 Nov 2018 → … |
Publication series
Name | 4th Workshop on Noisy User-Generated Text, W-NUT 2018 - Proceedings of the Workshop |
---|
Conference
Conference | 4th Workshop on Noisy User-Generated Text, W-NUT 2018 |
---|---|
Country/Territory | Belgium |
City | Brussels |
Period | 1/11/18 → … |
Bibliographical note
Publisher Copyright:© 2018 Association for Computational Linguistics.