Verifiably stable nonlinear control with reinforcement-learned diffractive optical networks
Mingliang Xie, Xiren Zhang, Jinghui Cai, Yisong Yue · Optics Express · 2025
Diffractive optical networks (DONs), characterized by light-speed computation and low power consumption, represent a promising platform for artificial intelligence (AI) implementation, with current applications primarily focused on object recognition and image classification. However, their potential for continuous, provably stable nonlinear control remains largely unexplored. This work introduces a Lyapunov-constrained reinforcement learning diffractive-optical network (LC-RLDON) framework designed for stability control of continuous nonlinear dynamical systems that challenge conventional control strategies. The proposed approach integrates reinforcement learning with differentiable Lyapunov conditions to iteratively optimize the DON toward an optimal Bellman policy, guaranteeing closed-loop stability while overcoming the cumulative drift problems inherent in behavior cloning methods. During deployment, the system requires only a passive DON and a lightweight electronic linear layer to form the optical Actor, enabling highly efficient real-time inference. Unlike previous DON-based controllers limited to binary tasks, LC-RLDON directly handles continuous-variable control scenarios. Experimental results on underactuated rotary inverted pendulums demonstrate LC-RLDON's superior performance by achieving stable equilibrium in 2.8 seconds and recovering within 2.1 seconds from a 1.1 N disturbance, while behavior cloning consistently fails. These findings establish DONs as capable of delivering real-time, formally safe control, paving the way for practical implementation in low-power, high-performance intelligent systems for agile robotics and autonomous vehicles.