OPTIMIZING REAL-TIME INTERNET OF THINGS DATA USING BIG DATA COMPUTING PLATFORM
SRM, Dharmita A · International Journal of Engineering Applied Sciences and Technology · 2022
— IOT offers the capability to connect and integrate both digital and physical entities of an appliance. A fundamental challenge center’s around managing big IOT data that these appliances produce, which is not only extremely large in scale and volume but also noisy and continuous. In our research we have explored Big Data based IOT driven technologies and the importance of preprocessing, meta data, data storage formats, data management and how big data is closely associated with IOT technologies. To achieve the objective of managing big data we are going to use the two most widely used framework namely Apache Hadoop and Apache Spark explained in detail in the research. Now some of the challenges faced by the IOT based appliances and the users are privacy, data storage and analysis, scalability, pre-processing. However, using the concepts of bigdata we can overcome these challenges. This paper finally helps in the implementation of combined efforts of IOT and bigdata altogether in the field of education, healthcare, urban planning, agriculture sector, and industries and also illustrates how these two technologies working simultaneously can not only improve the quality of the appliances but also enhances the experience of the users. This proposed methodology as per research will be easy and accurate compared to the existing methodology