Research on Construction Pattern of Hadoop Data Warehouse
Wang Huan-hua · 2015
The to casepattern is a commonly used method for constructing Hadoop Hive data warehouse recently. Firstly,the to case pattern was introduced and its disadvantage was shown with an example. Then inspired by the Builder Patternwhich is one of design patterns in the area of software engineering,a pattern called metadata-driven builder patternwas put forward for constructing Hadoop Hive data warehouse and ETL process. This pattern has two advantages. One is that it is driven by the metadata and the metadata is operated by the relational database management( RDBMS). Doing so can achieve higher efficiency because the metadata of Hive is just stored in the RDBMS. The other one is that the general knowledgeand specific-object knowledgeare differentiated and the ETL process is designed and realized based on such differentiation. Doing so can avoid lots of repetitions that the to casepattern leads to.