Lifelong Learning Meets Dynamic Processes: An Emerging Streaming Process Prediction Framework With Delayed Process Output Measurement
Tong Liu, Sheng Chen, Po Yang, Yunpeng Zhu, Mehmet Mercangöz, Chris J. Harris · IEEE Transactions on Control Systems Technology · 2023
As an emerging machine learning technique, lifelong learning is capable of solving multiple consecutive tasks based on previously accumulated knowledge. Although this is highly desired for streaming process prediction in industry, lifelong learning methods have so far failed to gain applications to mainstream adaptive predictive modeling of time-varying industrial processes. This is because when faced with a new data batch, existing lifelong learning approaches need both input and output data to construct local predictors before knowledge transfer can succeed. But in many process industries, the process output data are hard to measure online and it often takes time to acquire them from off-site laboratory analysis. This delayed acquisition of target output data makes it challenging to apply lifelong learning and other existing adaptive mechanisms to dynamic industrial processes with delayed process output measurement. To overcome this difficulty, this article proposes a novel lifelong learning framework that can rapidly predict new data batches with input data only before the arrival of the process output measurement. Specifically, we propose to incorporate process input information into lifelong learning via coupled dictionary learning, to enable the prediction of new batches without target output data. The input feature is linked with a local predictor through two dictionaries that are coupled by a joint sparse representation. Because of the learned coupling between the two spaces, the local predictor for the new batch can be reconstructed by knowledge transfer given only process inputs. Two industrial case studies are used to evaluate the effectiveness of our proposed framework and reveal the intrinsic learning mechanism of our lifelong process modeling to perform knowledge base (KB) adaptation.