Evaluating Gender Bias in Pre-trained Filipino FastText Embeddings
Lance Calvin Lim Gamboa, Maria Regina Justina E. Estuar · 2023
Past studies show that word embeddings can learn gender biases introduced by human agents into the textual corpora used to train these models. However, it has also been shown that some non-English embeddings may actually not capture such biases in their word representations. This study, therefore, aimed to answer the question: Does the publicly available Filipino FastText word embedding contain gender bias? Various iterations of the Word Embedding Association Test and principal component analysis were conducted on the embedding to answer this question. Results show that the Tagalog FastText embedding not only represents gendered semantic information properly but also captures biases about masculinity and femininity collectively held by Filipinos. Specifically, the embedding most strongly associates the female with nouns pertaining to domestic and caregiving roles and the male with verbs relating to strength and their bodies. The study's findings can help determine what next steps need to be undertaken to reduce or eliminate bias from Filipino embeddings.