Application research on application performance management system in big data of power grid
Deji Zhao, Bo Ning, Chao Yang · 2020
In order to solve the challenges brought by the operation and maintenance of power system in the era of big data, APM (Application Performance Management) system is introduced, which can monitor the operation of software and hardware system, show the health of system operation, and find the performance bottleneck. On the Hadoop platform, a big data deep mining and analysis platform based on map / reduce mode is built, integrating regression analysis, association analysis, data classification, data clustering, text mining, web mining and other data mining algorithms. It can complete 100TB level data retrieval in 30s, and then analyze; the system monitoring server can run stably in a cluster of 256 nodes. The use of APM system can prevent performance bottlenecks, greatly reduce the response time of performance problem processing, and quickly locate the location of performance problems, so as to ensure higher availability and stability of information system.