International Conference on Machine Learning and Applications
Knowledge guided Two-player Reinforcement Learning for Cyber Attacks and Defenses
December 12, 2022
Cyber defense exercises are an important way to understand organizations' technical capacity when facing cyber threats. Information from these exercises often reveals previously unseen ways to exploit an organization's vulnerabilities. These often lead to better defense mechanisms that can counter previously unknown exploits. With recent developments in cyber battle simulation platforms, we can generate a defense exercise environment and train reinforcement learning (RL) based autonomous agents to attack the system described by the simulated environment. In this paper, we describe a two-player game-based RL environment that simultaneously improves the performance of both the attacker and defender agents. We further accelerate the convergence of the RL agents by guiding them with expert knowledge from Cybersecurity Knowledge Graphs on attack and mitigation steps. We have implemented and integrated our proposed approaches into the CyberBattleSim system.
