Beyond Sight: Distance-Aware LVMs for Smarter Navigation
Ikhlass Boukrouh, Faouzi Tayalati, Abdellah Azmani · Proceedings of the World Congress on Electrical Engineering and Computer Systems and Science · 2024
Large Vision Models (LVMs) have shown impressive skills in understanding and generating image descriptions.However, to further improve the decision-making abilities of self-driving cars and enable truly autonomous navigation, it is important to augment these models with reasoning and distance measurement capabilities.By integrating computer vision techniques that can accurately estimate distances to various objects from visual cues alone, LVMs handling perceptual inputs for self-driving cars would be able to provide more precise, detailed, and contextually relevant descriptions of the driving environment.This would allow the vehicle's decisionmaking system to make better-informed choices and efficiently navigate complex real-world scenarios.Descriptions include estimated distances between vehicles and objects like cars, pedestrians, traffic signs, and lane markings.Rather than just describing what an image shows, the LVM could depict the scene with numerical distance values between the key objects.With enhanced reasoning and metric spatial awareness from estimated distances, LVMs processing self-driving cars' images would support better-informed navigation and manoeuvre choices in diverse conditions.The vehicle would have a more quantitative understanding of its surroundings to assist autonomous decision-making.By applying this augmented perception, our assisted driving system may be able to improve road safety.It can gauge distances accurately in real time using camera inputs alone.This allows the system to make informed decisions regarding safe following distances and provide alerts to the driver.Our enhanced perception module has the potential to reduce accidents by helping drivers maintain a safer distance from vehicles ahead.Our assisted driving system could decrease collisions by monitoring the road ahead and advising the driver on safe distances.