EdgeMQ: Towards a Message Queuing Processing System for Cloud-Edge Computing: (Use Cases on Water and Forest Monitoring)
Ion-Dorinel Filip, Bogdan Ghita, Florin Pop, George-Valentin Iordache, Cătălin Negru, Ciprian Dobre · 2018
With the increase of computational enabled devices spread around us, improving the efficiency of our Cloud-based software solutions frequently led us to use the closest available resources and many real-time processes cannot rely on traditional cloud architectures for all of theirs processing tasks anymore. This paper proposes a Cloud-Edge data processing architecture covering both real-time and batch processing models. We design our solution as a general architecture and propose an implementation schema using RabbitMQ as a queuing engine. Two use-cases are considered: one refers to monitoring a forest and the other consider water monitoring and management. Those scenarios include both batch and real-time processing components and they can be mapped on the proposed architecture. We describe a methodology for performance evaluation and give experimental results for using RabbitMQ in a Set-Top Box environment. Using Docker containers with limited resources, we obtained a message rate of 4k messages per second for 1KB sized messages.