On Handling Bigdata Efficiently and Securely with Customised Control-An Illustrative Study
Noman Hossain, Raihan Kibria, Niaz Ashraf Khan, Md. Ferdous Bin Hafiz, Shakib Mahmud Dipto, Sovon Chakraborty · 2024
At the age of big data, enormous data are being produced every second. It requires extended data security and efficiency in processing that data. Paid cloud services seem easier to use due to fewer management tasks involved in data processing and system organization, but they are not cost-effective for some organizations, and they might not always be secure for other clients. In such cases, a custom-made, self-owned cloud system would be the best solution to solve these issues. In this work, the authors aim to provide such a custom cloud solution, which is equally useful as paid cloud services, sound in data security, and efficient in energy and data processing. The authors provide a hands-on guideline to develop such a solution for small to large organizational data processing needs. This work can be seen as an illustrative reference for implementing a Hadoop-based big data platform incorporation.