International Conference on Machine Learning and Applications

Knowledge guided Two-player Reinforcement Learning for Cyber Attacks and Defenses

, , , , , and

Cyber defense exercises are an important way to understand organizations' technical capacity when facing cyber threats. Information from these exercises often reveals previously unseen ways to exploit an organization's vulnerabilities. These often lead to better defense mechanisms that can counter previously unknown exploits. With recent developments in cyber battle simulation platforms, we can generate a defense exercise environment and train reinforcement learning (RL) based autonomous agents to attack the system described by the simulated environment. In this paper, we describe a two-player game-based RL environment that simultaneously improves the performance of both the attacker and defender agents. We further accelerate the convergence of the RL agents by guiding them with expert knowledge from Cybersecurity Knowledge Graphs on attack and mitigation steps. We have implemented and integrated our proposed approaches into the CyberBattleSim system.


  • 600354 bytes

agent, ai, cybersecurity, knowledge graph, learning, rdf, reinforcement learning

InProceedings

IEEE

IEEE

DOI: 10.1109/ICMLA55696.2022.00213

Downloads: 2060 downloads

UMBC ebiquity