Storage Design and Implementation of Information Reconstruction System
Jiang Gaoyu, Pan Jingchang, Bo Zhang · 2019
With the development and popularization of the Internet and mobile devices, the production of information has grown into blowouts. The proliferation of data in different content provides sufficient conditions for big data analysis, and it also puts forward new requirements. The information reconstruction system aims to use natural language processing tools and information extraction algorithms to reconstruct the unstructured original information into structured information entities by extracting event elements according to the reconstruction model, and form a complete entity information database and connections database, which provides users structured data reconstruction, storage and query processing results. This paper proposes a reconstruction model of information objects. The model includes the characteristics of information objects evolved over time. It also includes the correlation and interaction between different but related information objects. A set of distributed storage based on Hbase is designed in the paper. The information reconstruction system uses the big data framework to provide efficient and stable storage for extracting entity information.