SEA-LION (Southeast Asian Languages In One Network): A Family of Southeast Asian Language Models
William Tjhi, David Ong, Peerat Limkonchotiwat · 2023
SEA-LION (Southeast Asian Languages In One Network) (Singapore, 2023) is a family of multilingual LLMs that is specifically pre-trained and instruct-tuned for the Southeast Asian (SEA) region, incorporating a custom SEABPETokenizer which is specially tailored for SEA languages.The first part of this talk will cover our design philosophy and pre-training methodology for SEA-LION.The second part of this talk will cover PyThaiNLP's (Phatthiyaphaibun et al., 2023) work on Wangchan-LION, an instruct-tuned version of SEA-LION for the Thai community.