Manipulating SHAP via Adversarial Data Perturbations (Student Abstract)
Hubert Baniecki, Przemysław Biecek · Proceedings of the AAAI Conference on Artificial Intelligence · 2022
We introduce a model-agnostic algorithm for manipulating SHapley Additive exPlanations (SHAP) with perturbation of tabular data. It is evaluated on predictive tasks from healthcare and financial domains to illustrate how crucial is the context of data distribution in interpreting machine learning models. Our method supports checking the stability of the explanations used by various stakeholders apparent in the domain of responsible AI; moreover, the result highlights the explanations' vulnerability that can be exploited by an adversary.