Big Data Analysis System Based on Cloudera Distribution Hadoop
Alan Hong, Weidong Xiao, Jiangling Ge · 2021
With the development and popularization of big data and related technologies, people's demand for big data ecosystem consisting of data resources, API, open source platform, data infrastructure, big data analysis and application components is increasingly significant. In this paper, the application of big data ecosystem based on Cloudera Distribution Hadoop (CDH) is discussed. This article first describes the development trend of data scale in recent years and the state-of-the-art work on big data analysis systems. Then, it focuses on the technical architecture of the big data ecosystem based on CDH, which analyzes the hierarchical structure of the system. Finally, a detailed analysis is made on the performance tuning settings of the system.