Collaborative Anomaly Detection in Log Data: Comparative Analysis and Evaluation Framework

Collaborative Anomaly Detection in Log Data: Comparative Analysis and Evaluation Framework

Abstract

Log Anomaly Collaborative Intrusion Detection Systems (CIDS) are designed to detect suspicious activities and security breaches by analyzing log files using anomaly detection techniques while leveraging collaboration between multiple entities (e.g., different systems, organizations, or network nodes). Unlike traditional Intrusion Detection Systems (IDS) that require centralized algorithm updates and data aggregation, CIDS enable decentralized updates without extensive data exchange, improving efficacy, scalability, and compliance with regulatory constraints. Additionally, inter-detector communication helps to reduce the number of false positives. These systems are particularly useful in distributed environments, where individual system have limited visibility into potential threats. This paper reviews the current landscape of Log Anomaly CIDS and introduces an open-source framework designed to create benchmark datasets for evaluating system performance. We categorize log anomaly detectors into three categories: Sequential-wise, Embedding-wise, and Graph-wise. Furthermore, our open framework facilitates rigorous evaluation against different challenges identifying weaknesses in existing methods like Deeplog and enhancing model robustness.

Grafik Top
Authors
  • García Gómez, André
  • Landauer, Max
  • Wurzenberger, Markus
  • Skopik, Florian
  • Weippl, Edgar
Grafik Top
Shortfacts
Category
Journal Paper
Divisions
Security and Privacy
Subjects
Computersicherheit
Angewandte Informatik
Journal or Publication Title
Future Generation Computer Systems
ISSN
0167-739X
Page Range
p. 108090
Date
17 August 2025
Official URL
https://www.sciencedirect.com/science/article/pii/...
Export
Grafik Top