EDSVM: A Novel Approach for Environment Drift Detection in Reinforcement Learning Using Synthetic Drifted Examples
In Reinforcement Learning (RL) environments, detecting environment drift is essential for maintaining robust policy performance in production systems, particularly within the context of MLOps. This paper proposes EDSVM, a novel environment drift detection method, which trains Support Vector Machines on undrifted and synthetic drifted examples generated by altering transition dynamics. By using decision function values as drift indicators, our method achieves competitive results compared to state-of-the-art baselines for the area-under-the-curve (AUC) metric. Additionally, we evaluate the performance of EDSVM when integrated with various Change Point Detection algorithms in terms of delay and false alarms, highlighting its potential for automating the monitoring of RL policies and supporting adaptive updates to production pipelines in MLOps workflows.

- Fang, Zhizhou
- Zdun, Uwe

Category |
Paper in Conference Proceedings or in Workshop Proceedings (Paper) |
Event Title |
28th European Conference on Artificial Intelligence (2025) |
Divisions |
Software Architecture |
Subjects |
Kuenstliche Intelligenz Angewandte Informatik |
Event Location |
Bologna, Italy |
Event Type |
Conference |
Event Dates |
25-30 October 2025 |
Date |
October 2025 |
Export |
