ODQ:A Real-Time Query of Big Data
Yang Zh · Computer and Digital Engineering · 2015
The distributed query is one of the research focus in the Big Data.Nowadays,with the development of electric power information,the business complexity continues to increase and the amount of data is increasing quickly which makes the real-time requirement(10s)cannot be met.In this paper a real-time query of big data with Objectification Parallel Computing(OPC)is provided to solve the above challenges.The data split from Big Data is distributed stored in memory of cluster in the OPC.In the Object Distributed Query(ODQ),making use of the thought of divide and rule and tree merging,there are two stages.The first stage is local data query.The intermediate query result can be obtained.The second stage is multistage summarizing.The final result can be returned to user.The solution has been applied to the power production management system(PMS)of State Grid of China.The results show that solution is efficiently reliable and meets real-time.