Bilingual audio-subtitle extraction using automatic segmentation of movie audio
Andreas Tsiartas, Prasanta Ghosh, Panayiotis Georgiou, Shrikanth Shri Narayanan · 2011
Extraction of bilingual audio and text data is crucial for designing Speech to Speech (S2S) systems. In this work, we propose an automatic method to segment multilingual audio streams from movies. In addition, the audio streams are aligned with the corresponding subtitles. We found that the proposed method gives 89% perfectly segmented bilingual audio and 6% partially segmented bilingual audio. In addition, the mapping of the audio to the corresponding subtitles has accuracy 91%.