Application of Deep Reinforcement Learning (DRL) for Malware Detection
Keywords:
Reinforcement Learning, Attack, Malware, Privacy, Malicious, Machine Learning.Abstract
Malware poses a significant threat to computer systems and networks, necessitating advanced detection methods to safeguard against potential cyber-attacks. This paper investigates the application of Deep Reinforcement Learning (DRL) for malware detection, leveraging its ability to learn complex patterns and behaviours from raw data. The study employs a DRL framework to train an agent to identify malicious software based on dynamic features extracted from executable files. A comprehensive evaluation is conducted using a diverse dataset, encompassing various types of malware samples. The experimental results demonstrate the effectiveness of the proposed DRL based approach in accurately detecting malware, achieving competitive performance compared to traditional methods and state-of-the-art techniques. Additionally, the paper discusses the interpretability and scalability of the model, along with potential challenges and future research directions in applying DRL to cybersecurity.
References
Sewak, Mohit, Sanjay K. Sahay, and Hemant Rathore. "Deep reinforcement learning for cybersecurity threat detection and protection: A review." International Conference On Secure Knowledge Management In Artificial Intelligence Era. Cham: Springer International Publishing, 2021.
Wang, Yu, Jack W. Stokes, and Mady Marinescu. "Neural malware control with deep reinforcement learning." MILCOM 2019-2019 IEEE military communications conference (MILCOM). IEEE, 2019.
Nguyen, Thanh Thi, and Vijay Janapa Reddi. "Deep reinforcement learning for cyber security." IEEE Transactions on Neural Networks and Learning Systems 34.8 (2021): 3779-3795.
Sewak, Mohit, Sanjay K. Sahay, and Hemant Rathore. "DRLDO: A novel DRL based de-ObfuscationSystem for defense against metamorphic malware." arXiv preprint arXiv:2102.00898 (2021).
Arif, Rahat Maqsood, et al. "A Deep Reinforcement Learning Framework to Evade Black-Box Machine Learning Based IoT Malware Detectors Using GAN-Generated Influential Features." IEEE Access 11 (2023): 133717-133729.
Luong, Nguyen Cong, et al. "Applications of deep reinforcement learning in communications and networking: A survey." IEEE communications surveys & tutorials 21.4 (2019): 3133-3174.
Birman, Yoni, et al. "Transferable Cost-Aware Security Policy Implementation for Malware Detection Using Deep Reinforcement Learning." arXiv preprint arXiv:1905.10517 (2019).
Birman, Yoni, et al. "Cost-effective malware detection as a service over serverless cloud using deep reinforcement learning." 2020 20th IEEE/ACM international symposium on cluster, cloud and internet computing (CCGRID). IEEE, 2020.
Wu, Di, et al. "Evading machine learning botnet detection models via deep reinforcement learning." ICC 2019-2019 IEEE International Conference on Communications (ICC). IEEE, 2019.
Chen, Jun, et al. "Generating adversarial examples for static PE malware detector based on deep reinforcement learning." Journal of Physics: Conference Series. Vol. 1575. No. IOP Publishing, 2020.
Chen, Wuhui, et al. "Deep reinforcement learning for Internet of Things: A comprehensive survey." IEEE Communications Surveys & Tutorials 23.3 (2021): 1659-1692.
Venturi, Andrea, et al. "Drelab-deep reinforcement learning adversarial botnet: A benchmark dataset for adversarial attacks against botnet intrusion detection systems." Data in Brief 34 (2021): 106631.
Apruzzese, Giovanni, et al. "Deep reinforcement adversarial learning against botnet evasion attacks." IEEE Transactions on Network and Service Management 17.4 (2020): 1975-1987. license.(http://creativecommons.org/licenses/by/4.0/) 34
Abou Ghaly, Mahmoud, and Shaikh Abdul Hannan. "Protecting Software Defined Networks with IoT and Deep Reinforcement Learning." International Journal of Intelligent Systems and Applications in Engineering 12.8s (2024): 138-147. license.(http://creativecommons.org/licenses/by/4.0/) 35
Published
How to Cite
Issue
Section
Copyright (c) 2024 Mangadevi Atti, Manas Kumar Yogi

This work is licensed under a Creative Commons Attribution 4.0 International License.