Japanese Lexical Complexity for Non-Native Readers: A New Dataset
Yusuke Ide, Masato Mita, Adam Nohejl, Hiroki Ouchi, Taro Watanabe · 2023
Lexical complexity prediction (LCP) is the task of predicting the complexity of words in a text on a continuous scale.It plays a vital role in simplifying or annotating complex words to assist readers.To study lexical complexity in Japanese, we construct the first Japanese LCP dataset.Our dataset provides separate complexity scores for Chinese/Korean annotators and others to address the readers' L1-specific needs.In the baseline experiment, we demonstrate the effectiveness of a BERT-based system for Japanese LCP.