An Efficient Distributed Database Clustering Algorithm for Big Data Processing
Qiao Sun, Lan-Mei Fu, Buqiao Deng, Xubin Pei, Jiasong Sun · 2017
This paper proposes a distributed data clustering technique based on deep neural network.First, each record in the distributed database is taken as an input vector, and its characteristics are extracted and input to the input layer of the depth neural network.The weight of the connection is trained by BP algorithm, and the training of depth neural network output is realized by adjusting the weight.Finally, the data clustering results are judged according to the similarity of the current vector corresponding to the output data.Experimental results based on small-scale distributed systems show that this method has better test set accuracy than traditional k-means clustering method, and is more suitable for large-scale data clustering in the distributed environments.