Causal Interventional Training for Image Recognition
Wei Qin, Hanwang Zhang, Richang Hong, Ee‐Peng Lim, Qianru Sun · IEEE Transactions on Multimedia · 2021
Deep learning models often fit undesired dataset bias in training. In this paper, we formulate the bias usingcausal inference, which helps us uncover the ever-elusive causalities among the key factors in training, and thus pursue the desired causal effect without the bias. We start from revisiting the process of building a visual recognition system, and then propose a structural causal model (SCM) for the key variables involved in dataset collection and recognition model: object, common sense, bias, context, and label prediction. Based on the SCM, one can observe that there are “good” and “bad” biases. Intuitively, in the image where a car is driving on a high way in a desert, the “good” bias denoting the common-sense context is the highway, and the “bad” bias accounting for the noisy context factor is the desert. We tackle this problem with a novel causal interventional training (CIT) approach, where we control theobservedcontext in each object class. We offer theoretical justifications forCITand validate it with extensive classification experiments on CIFAR-10, CIFAR-100 and ImageNet,e.g., surpassing the standard deep neural networks ResNet-34 and ResNet-50, respectively, by 0.95% and 0.70% accuracies on the ImageNet. Our code is open-sourced on the GitHubhttps://github.com/qinwei-hfut/CIT.