SAMatch: training-free object detection for HMI screens
Kiruthika Kannan, Vijay Jaisankar, Akhil Pillai, Rakesh Tripathi · Discover Data · 2025
Recognising objects within graphical user interface (GUI) images presents unexpected challenges, particularly in cases of diverse objects and limited labelled data. In this paper, we enumerate the unique characteristics of GUI images from human-machine interface (HMI) screens and investigate several techniques for detecting appropriate objects present in them. We propose SAMatch , a novel training-free matching-based approach utilising a frozen foundation model, SAM for region proposal and a CNN-based model for deep template MATCH ing. Through experimental evaluation, this paper compares approaches toward efficient processing of HMI screens using Computer Vision.