Design and implementation of Hadoop platform for processing big data of logistics which is based on IoT
Nam Ho Kim · International Journal of Services Technology and Management · 2017
Due to a sudden increase of data when internet of things, which uses sensor network such as RFID and NFC, was applied, interest in collection, processing, analysis and utilisation of big data is increasing. These big data, which are mostly unstructured data, are showing a great degree of difference in the aspects of data movement speed, variety, speed, and quantity when compared to the existing typical relational data. Especially, as an open source platform, the Hadoop system, which is used for processing of big data that occurs in logistics which is a major utilisation field of internet of things in the technical perspective, is providing opportunities for anyone to build a platform with comparatively lower cost. This thesis attempts to provide data that can be referred to in introducing platform that is adequate to our company by designing various Hadoop platforms that can be utilised in processing big data which occurs in logistics based on IoT and conducting comparative evaluation of its performance. Also, we present the integrated verification results for the data analysis performance of the analysis software system running on top of realised prototypes by employing American Standard Association (ASA) dataset.