SecHDFS: A Secure Data Allocation Scheme for Heterogenous Hadoop Systems
Bowen Tian, Yun Tian, Brandon Huebert, Yijie Sun, Trevor Hurt, Waymon Ho, Yuting Zhang, Danqi Chen, HwaSung Lee · 2016
Apache Hadoop is a widely used distributed computing framework and its file system is Hadoop Distributed File System (HDFS), which assumes that DataNodes in a system are homogeneous in nature. When a cloud system scales up, DataNodes are very likely to become heterogeneous. Thus, extensive research has been placed on improving performance for heterogeneous Hadoop systems, but little attention has been placed on security improvements. This motivates us to investigate a data allocation scheme called the Secure HDFS (SecHDFS) by integrating the secret sharing technique to improve storage security in a heterogeneous Hadoop system.