EDSVM: A Novel Approach for Environment Drift Detection in Reinforcement Learning Using Synthetic Drifted Examples

EDSVM: A Novel Approach for Environment Drift Detection in Reinforcement Learning Using Synthetic Drifted Examples

Abstract

In Reinforcement Learning (RL) environments, detecting environment drift is essential for maintaining robust policy performance in production systems, particularly within the context of MLOps. This paper proposes EDSVM, a novel environment drift detection method, which trains Support Vector Machines on undrifted and synthetic drifted examples generated by altering transition dynamics. By using decision function values as drift indicators, our method achieves competitive results compared to state-of-the-art baselines for the area-under-the-curve (AUC) metric. Additionally, we evaluate the performance of EDSVM when integrated with various Change Point Detection algorithms in terms of delay and false alarms, highlighting its potential for automating the monitoring of RL policies and supporting adaptive updates to production pipelines in MLOps workflows.

Grafik Top
Authors
  • Fang, Zhizhou
  • Zdun, Uwe
Grafik Top
Projects
Grafik Top
Shortfacts
Category
Paper in Conference Proceedings or in Workshop Proceedings (Paper)
Event Title
28th European Conference on Artificial Intelligence (2025)
Divisions
Software Architecture
Subjects
Kuenstliche Intelligenz
Angewandte Informatik
Event Location
Bologna, Italy
Event Type
Conference
Event Dates
25-30 October 2025
Date
October 2025
Export
Grafik Top