Parameter Auto-tuning of Hadoop Clusters
Yanfeng Liu · Computer Knowledge and Technology · 2012
Hadoop platform as an open source cluster framework for running large-scale database processing by each company's favor,how.ever,run job on a Hadoop cluster must be set manually almost morethan 200 parameters,how to set these parameters for the ordinaryus.er is very diffic-ult.this paper proposes a solution for this problem,adding Hadoop Strategies perceived layer,that is use a sampling algo.rithm based strategic choice.the experimental results show that improved the Hadoop framework can automatically optimize the set.tings of these parameters,thereby improving the operating efficiency of the entire system.