Collecting and processing multimodal data
Lihe Huang · 2021
This work deals with speech acts and their corresponding illocutionary forces produced by Chinese illiterates in live speech to discover how speech content, prosodic features, and non-verbal acts interact with each other to produce a variety of live illocutionary forces. To fulfill this research task, researchers need to construct a multimodal corpus of speech acts. This chapter attempts to provide a general introduction to the collection, composition, transcription, and processing of raw corpus data by adopting a multimodal corpus approach. When all valid data was processed, the multimodal corpus of situated discourse began to take shape with the Chinese characters’ transcription.