A Secured Method for accessing HDFS in Hadoop
Jolly Khurana · International Journal for Research in Applied Science and Engineering Technology · 2020
Since Big data is so huge that it's become difficult to handle it, so it requires special technology which can handle bigdata.Hadoop is Apache Foundation's Framework which aims to provide efficient storage and analytics of big data; also, it is open system software.Two core technologies are associated with Hadoop i.e.HDFS and Map Reduce.HDFS is abbreviated for Hadoop Distributed File Technology, it's a special file system which provides efficient storage for big data in cluster of commodity hardware and based on stream access pattern.HDFS cluster Architecture is based on distributed file system therefore has Client server architecture.Since in HDFS cluster, there is no way to check the authenticity of client, therefore a method to incorporate Kerberos protocol in between Client and HDFS cluster is purposed to make the system secured.Kerberos is network authentication protocol which provides secured communication between client and server over unsecured network.Moreover, an Agent has been incorporated which is authorized to access the client's buffer and takes data out from it and loads it into HDFS cluster.