A Scalable Smart Farming Big Data Platform for Real-Time and Batch Processing Based on Lambda Architecture
Journal of System and Management Sciences · 2023
In recent years, the rise of big data technologies, the Internet of Things (IoT), and cloud computing has led to significant advances in data-driven strategies.However, despite the emergence of the concept of smart farming, the vast amounts of data generated by IoT devices remain largely underutilized due to a lack of effective data management systems.To fully exploit this data and take agriculture to the next level, it is crucial to implement a dedicated big data architecture that can capture and analyze data in real-time.In this paper, we propose a new architecture for managing big data in smart farming that is based on the data lake concept and the lambda architecture.Our proposed architecture aims to address the challenges of collecting, processing, and analyzing smart farming data in both batch and real-time modes.By combining smart farming and big data, our approach offers the possibility of real-time farm monitoring for agri-ecosystems stakeholders, which can help maximize productivity and quality while minimizing effort.Overall, our proposed architecture represents a significant step forward for smart farming and has the potential to revolutionize the agricultural industry.With the ability to capture and analyze data in real-time, our approach will enable farmers to make more informed decisions and optimize their operations for greater efficiency and profitability.