Challenges and Limitations with the Metrics Measuring the Complexity of Code-Mixed Text
Vivek Prakash Srivastava, Mayank Singh · 2021
Code-mixing is a frequent communication style among multilingual speakers where they mix words and phrases from two different languages in the same utterance of text or speech.Identifying and filtering code-mixed text is a challenging task due to its co-existence with monolingual and noisy text.Over the years, several code-mixing metrics have been extensively used to identify and validate codemixed text quality.This paper demonstrates several inherent limitations of code-mixing metrics with examples from the already existing datasets that are popularly used across various experiments.@user bus office me hn , Sat thora thanda hota hay kaam k point of view say you know :) Langdetect et id en nl vi unk tl en en cs so so sw fi en af tl sw en unk