ST-LSTM-sports mind: a multimodal deep learning framework for intelligent sports analytics and automated journalism
Fangni Li, Yang He · International Journal of Computer Applications in Technology · 2026
This research introduces an AI-driven framework designed to automate the generation of sports highlights, optimising content creation for digital platforms.The framework utilises advanced deep learning techniques, including Spatial-Temporal Long Short-Term Memory (ST-LSTM) networks and convolutional neural networks (CNN), to address key challenges in sports classification, event detection, and player tracking.By incorporating multimodal data (audio and visual cues), the model achieves high accuracy rates, with 93% for goals, 90% for substitutions, and 86% for cards.However, further work is necessary to achieve 100% prediction accuracy for officially sanctioned events.The study also explores the integration of audio features to improve detection, particularly for dynamic events with strong audio cues, while acknowledging challenges with weak or ambiguous audio cues.Additionally, the research develops smart cropping techniques, automatic player detection, and an innovative multimodal game summarisation system aimed at enhancing sports content creation efficiency and engagement on digital platforms.