Fuzzy $k$kNN Entropy and its Anomaly Detection
Chang Liu, Zhong Yuan, Yuan Yuan, Hongmei Chen, Dezhong Peng, Xiaomin Song · IEEE Transactions on Knowledge and Data Engineering · 2025
With the successful application of granular computing in anomaly detection, a variety of tools including fuzzy information entropy can achieve superior detection results. However, fuzzy information entropy calculates fuzzy similarity through a global strategy, ignoring the local information in the data. To address this deficiency, this paper constructs a fuzzy$k$NN entropy theory and applies it to identify anomalies. Firstly, fuzzy$k$-similarity and fuzzy$k$NN are defined, and$k$NN entropy theory and the related information-theoretic metrics are proposed. Then, the relevant definitions and propositions of fuzzy$k$NN entropy, fuzzy$k$-joint entropy, fuzzy$k$-conditional information entropy, as well as fuzzy$k$-mutual information are elaborated. Based on the proposed theory, an anomaly detection model is constructed. At first, the fuzzy$k$-similarity relation matrix is constructed based on the fuzzy$k$-similarity in the proposed theory, and the relative fuzzy$k$NN entropy is calculated. Based on the relative fuzzy$k$NN entropy, the fuzzy$k$-relation anomaly degree is defined to characterize the anomaly intensity of fuzzy$k$NN information granules. Then, the anomaly factor based on fuzzy$k$NN entropy is built to represent the anomaly degree of data objects. Finally, the corresponding Fuzzy$k$NN Entropy-based Anomaly Detection algorithm (F$k$EAD) is designed. Comparative experiments are conducted with 11 state-of-the-art anomaly detection methods on thirty public datasets. The results reveal that the proposed method achieves better performance.