MARL-based calibration for cameras with large FOV

Xinyu Yang, Fuhan Chen, Jingwen Jiang, Hui Xie, Qiaofeng Ou · Journal of Modern Optics · 2024

Achieving high-precision measurements in a large field of view (FOV) is a challenging task. The accuracy of vision measurements is determined by the quality of camera calibration, which is influenced by the pose of the target. To obtain suitable target pose, a target pose optimization method based on multi-agent reinforcement learning (MARL) is proposed. Firstly, the target pose optimization problem is modelled as a Markov decision process (MDP). Secondly, a multi-agent proximal policy optimization (MAPPO) algorithm for target pose optimization is designed by parameter sharing mechanism. Finally, optimization algorithm is adopted to camera calibration process. The calibration experiment was carried out under the large FOV of 4600 mm × 2300 mm. The results show that the back-projection error was 0.198 mm, the relative error of the diagonal length of target (505.847 mm) was 0.789 mm, and the success rate of large FOV camera calibration was 98.5%.

Read the paper · More papers on PaperTik