AnomalyAdapters: Parameter-Efficient Multi-Anomaly Task Detection
Loading...
Files
Date
2022
Authors
Dag, Hasan
Journal Title
Journal ISSN
Volume Title
Publisher
IEEE-Inst Electrical Electronics Engineers Inc
Abstract
The emergence of technological innovations brings sophisticated threats. Cyberattacks are increasing day by day aligned with these innovations and entails rapid solutions for defense mechanisms. These attacks may hinder enterprise operations or more importantly, interrupt critical infrastructure systems, that are essential to safety, security, and well-being of a society. Anomaly detection, as a protection step, is significant for ensuring a system security. Logs, which are accepted sources universally, are utilized in system health monitoring and intrusion detection systems. Recent developments in Natural Language Processing (NLP) studies show that contextual information decreases false-positives yield in detecting anomalous behaviors. Transformers and their adaptations to various language understanding tasks exemplify the enhanced ability to extract this information. Deep network based anomaly detection solutions use generally feature-based transfer learning methods. This type of learning presents a new set of weights for each log type. It is unfeasible and a redundant way considering various log sources. Also, a vague representation of model decisions prevents learning from threat data and improving model capability. In this paper, we propose AnomalyAdapters (AAs) which is an extensible multi-anomaly task detection model. It uses pretrained transformers' variant to encode a log sequences and utilizes adapters to learn a log structure and anomaly types. Adapter-based approach collects contextual information, eliminates information loss in learning, and learns anomaly detection tasks from different log sources without overuse of parameters. Lastly, our work elucidates the decision making process of the proposed model on different log datasets to emphasize extraction of threat data via explainability experiments.
Description
Keywords
Task analysis, Anomaly detection, Adaptation models, Transformers, Security, Semantics, Monitoring, Anomaly detection, adapters, cyber threat intelligence, explainability, log, transfer learning
Turkish CoHE Thesis Center URL
Citation
4
WoS Q
Q2
Scopus Q
Q1
Source
Ieee Access
Volume
10
Issue
Start Page
5635
End Page
5646