Two iCSS researchers from the University of Kent’s School of Computing, Joshua Sylvester (PhD student) and his supervisor Dr Rogério de Lemos (Senior Lecturer and Director of PGR Studies), won the Distinguished Paper Award at the 2nd International Workshop on Autonomous Cybersecurity (AutonomousCyber 2025), co-located with the 30th European Symposium on Research in Computer Security (ESORICS 2025), one of the top-tier cyber security research conferences.
The abstract of the award-winning paper, titled “Knowledge Retention for Generic Reinforcement Learning Policies in Autonomous Cyber Defence”, is as follows:
“Within autonomous cyber defence, building scalable agents that can generalise across attack behaviours is crucial to developing a truly autonomous system. These generic agents are pivotal, as over time, attackers will inevitably change their behaviour, requiring the defence mechanisms to adapt accordingly. Current approaches for generic agents use deep reinforcement learning policies to learn multiple attack behaviours and mitigate them. When a new attack behaviour is introduced, the generic policy is retrained to incorporate this behaviour and not forget previous attack behaviours. In this paper, we propose a novel solution based on a modified version of the Proximal Policy Optimisation (PPO) reinforcement learning algorithm that retains previously acquired knowledge, enabling a scalable and generic framework in which new attack behaviours can be incorporated modularly. The modified PPO algorithm demonstrates a 22.11% performance improvement compared to standard PPO when trained to sequentially learn two distinct attack behaviours. These results show a step towards building more scalable autonomous cyber defence systems capable of incorporating evolving cyber threats.”
The paper’s full citation information is the following:
- Joshua Sylvester and Rogério de Lemos (2025) Knowledge Retention for Generic Reinforcement Learning Policies in Autonomous Cyber Defence. Presented at the 2nd International Workshop on Autonomous Cybersecurity (AutonomousCyber 2025), co-located with the 30th European Symposium on Research in Computer Security (ESORICS 2025), to be published in a volume of Lecture Notes in Computer Science by Springer. Preprint available at https://kar.kent.ac.uk/111722/
Congratulations to Joshua and Rogério for the new achievement!