Development of Tomato Harvest Support System Using Mixed Reality Head Mounted Display
Ryota Goka, Kazuma Ueda, Shota Yamaguchi, Noriyuki Kimura, Kenji Iseya, Kazuma Kobayashi, Toyoaki Tomura, Satoshi Mitsui, Toshifumi SATAKE, Naoki Igo · 2022 IEEE 4th Global Conference on Life Sciences and Technologies (LifeTech) · 2022
At present, many Japanese tomato farmers harvest manually to select harvest candidates considering ripeness and blemishes of each fruit. Therefore, part-time workers and new farmers have problems such as stability of harvest quality and work efficiency because they do not have a good eye for harvest candidates. Thus, we propose a system using Head Mounted Display (HMD) and User Datagram Protocol (UDP) that a computer gets camera images of a subjective perspective in real-time and finally, HMD presents the information which is obtained by image processing in Mixed Reality (MR) space. This system enables to tell the information such as harvest candidates, sugar content, and acidity of tomatoes to workers without disturbing the harvesting operation. In this paper, we describe the adopted HMD and the original architecture that we devised to achieve harvesting support in mixed reality except for image processing part, and moreover, we validate the proposed system.