APPLICATION OF LARGE LANGUAGE MODELS IN HIGHLY LOADED INFORMATION SYSTEMS
L.N. Loginova, A.D. Domashkin · 2025
This study investigates the integration of large language models (LLMs) into high-throughput information systems designed to process exabytes of data in real time. The focus is on transformer-based architectures, including computational optimization through weight quantization, model distillation, and distributed query processing. Key challenges such as energy efficiency, scalability, and cybersecurity mechanisms for handling sensitive data are analyzed.