Decoding the Black Box through a Comparative Study on Clustering Features in Convolutional Neural Networks
<p>Ruiyi Zhang</p> · Academic Journal of Computing & Information Science · 2023
Over the years, as Convolutional Neural Networks (CNNs) have revolutionized the field of image processing by achieving state-of-the-art results, questions on their internal working mechanics have arisen. As of this moment in time, the internal workings of CNNs remain a “black box”, making it challenging to grasp and understand their decision-making processes. This study aims to unveil the mysteries of the black box by exploring how images are represented within CNNs. Accomplished with the TinyImageNet Data and VGG16 architecture, we extracted features from the penultimate layer and utilized K-means clustering to group the features. Through these clusters, we were able to uncover meaningful patterns and similarities among a vast amount of images, gaining insight into the internal mechanics of CNNs and the features they prioritize. Although parameters were adjusted to accommodate the purpose of understanding CNNs, a comparative analysis with other clustering methods is conducted to reveal more information about their efficacy and mechanics. This study has not only revealed more information about the internal workings of CNNs, but it also hopes to open the gates to more interpretable deep learning models in the future.