Expert Monitoring: Human-Centered Concept Drift Detection in Machine Learning Operations
Joran Leest, Claudia Raibulet, Ilias Gerostathopoulos, Patricia Lago · 2024
We propose Expert Monitoring, an approach that leverages domain expertise to enhance the detection and mitigation of concept drift in machine learning (ML) models. Our approach supports practitioners by consolidating domain expertise related to concept drift-inducing events, making this expertise accessible to on-call personnel, and enabling automatic adaptability with expert oversight.