Image Quality Difference Perception Ability: A BIQA model effectiveness metric based on model falsification method
Jinchi Zhu, Xiaoyu Ma, Dingguo Yu, Yuying Li, Yidan Zhao · Expert Systems with Applications · 2024
Blind Image Quality Assessment (BIQA) methods refer to algorithms that predict image quality scores without reference images. This challenging area is crucial for preprocessing and optimizing visual tasks. Since BIQA is a small-sample task, it has become a common practice to apply transfer learning by using models pre-trained on other visual tasks, such as semantic recognition, to BIQA. This paper is interested in whether a backbone that performs better in semantic recognition also improves predictive accuracy in BIQA tasks. Comparative experiments showed that different semantic backbones with varying precision exhibit minimal differences in PLCC (Pearson Linear Correlation Coefficient) and SRCC (Spearman Rank Order Correlation Coefficient). However, further comparison shows that the semantic backbone does enhance the model’s IQA abilities, which traditional metrics fail to capture due to their oversight of quality differences between images. We term this ability as Image Quality Difference Perception Ability (IQDP Ability). Based on this, we propose an IQDP comparison method and a new metric, which can effectively compare and measure a model’s IQDP Ability, supplementing traditional metrics and providing an effective means of identifying superior models. • Semantic backbones offer insignificant PLCC/SRCC improvement in IQA performance. • IQDP highlights ‘Image Quality Difference Perception Ability’ that PLCC/SRCC miss. • A new metric describes the quality difference perception ability of BIQA models.