Implementation of dynamic node management in Hadoop cluster
Wooseok Ryu · 2018 International Conference on Electronics, Information, and Communication (ICEIC) · 2018
Hadoop Distributed Filesystem provides great scalability of storing big data. However, it lacks dynamicity of node management because all nodes in a Hadoop cluster are tightly-coupled from each other. This feature interferes with reusing other computing resources to the Hadoop cluster when then are available. This paper presents a dynamic node management mechanism of Hadoop cluster with concrete implementations. The implementation result shows that any data node can be casually removed from the cluster whenever necessary, and be joined again when available.