PGAI-Audit: A Precise and General Method to Audit Privacy Budget of Differentially Private Artificial Intelligence Models
Weixin Zhao, Zhishuo Zhang, Wen Cai Huang, Jian Peng, Wenzheng Xu, Yongjian Liao, Chang Liu · IEEE Transactions on Industrial Informatics · 2025
Auditing the privacy budget of differential privacy (DP) artificial intelligence (AI) models is necessary to ensure that industrial data are protected at the desired level by DP mechanisms. However, existing auditing methods are not general and precise enough to deal with various kinds of AI models, because the existing auditing methods require customizing audit frameworks and utilize information from model parameters insufficiently. In this article, we propose aprecise andgeneral method toauditthe privacy budget of DPAImodels precisely. Our method associates the parameters of the DP AI model with privacy budget through the Bayesian perspective, achieving tight auditing results with a limited number of DP AI models. Extensive experiments show that our method is more precise and general than existing methods. In particular, the experiments involve ten different datasets, five different models, and three different ways to achieve differential privacy, which indicates the generality of our method. According to empirical experiment results, in 35 out of 36 comparison experiments, our method demonstrates improvements in precision.