Neural Network Architectures for Real-Time Image and Video Processing Applications
Capital One, Deekshith Narsina, Nicholas Richardson, JPMorgan Chase, Arjun Kamisetty, Fannie Mae, Jaya Chandra Srikanth Gummadi, Krishna Devarapu · Engineering International · 2022
This research optimizes neural network topologies for real-time image and video processing to achieve high-speed, accurate performance in dynamic contexts. The project aims to find efficient optimization methodologies, track neural network model progress, and highlight visual media applications. A secondary data review synthesizes peer-reviewed literature, technical reports, neural network design, and optimization advances. The research found that lightweight neural network architectures like MobileNet and Transformer-based Vision Transformers (ViTs) boost the computing economy without losing accuracy. Real-time applications need model pruning, quantization, knowledge distillation, and hardware-aware design. From real-time object identification in surveillance and autonomous driving to medical imaging and creative media creation, neural networks have transformed many applications. Despite these advances, balancing accuracy and economy, addressing hardware variability, and assuring ethical usage in face recognition remain issues. The report emphasizes the need for privacy-friendly and egalitarian AI rules. These results may help future research improve real-time visual processing systems and legislators control their responsible use in real-world applications.