ROS2-based Distributed System Implementation for Logging Indoor Human Activities

Kyohei Yoshida, Nobutaka Shimada, Tadashi Matsuo · The Proceedings of JSME annual Conference on Robotics and Mechatronics (Robomec) · 2021

This research implement a system that detects and records various human activities in indoor scenes. For example, It detects who brings in or takes out an object and the handled object’s image with the incident timestamp. It’s constructed over ROS2, a widely used distributed communication framework for robotic implementation based on microservices architecture, so that it can separate each subprocess of detection and improve the maintainability of each modules. This paper reports the constructed system with visual human and pose detection, object detection, and recognition of object handling activities. Since the system was able to separate hardware not only service process, it was able to employ computationally heavy machine learning models simultaneously on multiple PCs with GPU.

Read the paper · More papers on PaperTik