Big data partition management model and its application research
Zhang Weny · Harbin Gongcheng Daxue Xuebao/Journal of Harbin Engineering University · 2014
Because of the big data partition management technique's lack of a universally applicable formalized data partition model,this paper introduces a big data category that contains a trace algebra system,structural state relational algebra system and multi-structural state relational algebra system,as the basic theoretical model for supporting partition management and its application research. On this basis,this paper details a formalized data partition model known as trace-scene and entity-instance based partitioning strategy( TESI-PS) that supports big data partition management and rapid query response,with the goal of meeting local sufficiency. It is made up of the big data partitioning rules based on the activity-scenes and the identification of entity instances and the activity-scene-oriented partition allocating rules. So far,TSEI-PS has achieved success with unified information resource planning and national housing information system construction of the Ministry of Housing and Urban-Rural Development.