Big Data Platforms
Sharmila Gaikwad, Jignesh Patil · 2022
Big data refers to huge datasets which gives the advanced analysis about the system. Information is increasing nowadays due to more advanced technology, tools, and techniques. When there is a huge increase in information, it has some merits and demerits like maintaining the data, data visualization, and securing the data. Big data offers various tools and techniques to maintain and secure data. This chapter focuses on two important parts of big data, namely, visualization and security. It is really challenging task to visualize data in simple way but big data makes easy to understand and interpret. This study explains different techniques such as 1D, 2D, and multidimensional with current pandemic case study on COVID-19 with a diagrammatic representation for easy understanding of the techniques. Data visualization makes communication insights from data through visual representation. Its main aim is to still the datasets into visual graphics to allow easy understanding with complex relationships within the data. Data visualization promotes that creative data exploration [3]. Data visualization is applied in every field of knowledge. Researchers use computer techniques to model complex events and visualize phenomena that cannot be observed directly such as weather patterns and medical conditions. Today, the world is facing pandemic situations like COVID-19, and big data has played vital role in analysis and predictions [1]. Visualization made great help to society to visualize the patients in different areas or in the world. By using plotly data visualization analysis, different datasets of COVID-19 are covered in this study. Today, almost every institute is thinking big data as they are seeing growth of big data using Hadoop, Spark, Pig, etc. HDFS (HADOOP Distributed File System) is distributed file system. All types of files can be stored in the HDFS. Biggest challenge for big data from a data security point of view is the protection's user details. As per studies, it is demonstrated the flow of big data is in three layers: incoming, stored, and outgoing data. The organizations may face the problem of encryption while storing huge data. There are some major issues while handling big data about security such as data breach, data access, and privacy violations. Due to larger data sets, there may serious data branches problem which can result more devastating consequences than normally seen in any system. This chapter covers part of data breaches in the year 2018 to 2019 and conclusion of 2020. This study also demonstrates an investigation about virtual reality which radically changes the world of big data.