University of Surrey

Test tubes in the lab Research in the ATI Dance Research

Learning to Control Random Boolean Networks: A Deep Reinforcement Learning Approach

Papagiannis, Georgios and Moschoyiannis, Sotiris (2019) Learning to Control Random Boolean Networks: A Deep Reinforcement Learning Approach In: 8th International Conference on Complex Networks and their Applications (Complex Networks 2019), 10-12 Dec 2019, Lisbon, Portugal.

[img]
Preview
Text
Learning to Control Random Boolean Networks.pdf - Accepted version Manuscript

Download (485kB) | Preview

Abstract

In this paper we describe the application of a Deep Reinforcement Learning agent to the problem of control of Gene Regulatory Networks (GRNs). The proposed approach is applied to Random Boolean Networks (RBNs) which have extensively been used as a computational model for GRNs. The ability to control GRNs is central to therapeutic interventions for diseases such as cancer. That is, learning to make such interventions as to direct the GRN from some initial state towards a desired attractor, by allowing at most one intervention per time step. Our agent interacts directly with the environment; being an RBN, without any knowledge of the underlying dynamics, structure or connectivity of the network. We have implemented a Deep Q Network with Double Q Learning that is trained by sampling experiences from the environment using Prioritized Experience Replay. We show that the proposed novel approach develops a policy that successfully learns how to control RBNs significantly larger than previous learning implementations. We also discuss why learning to control an RBN with zero knowledge of its underlying dynamics is important and argue that the agent is encouraged to discover and perform optimal control interventions in regard to cost and number of interventions.

Item Type: Conference or Workshop Item (Conference Paper)
Divisions : Faculty of Engineering and Physical Sciences > Computer Science
Authors :
NameEmailORCID
Papagiannis, Georgiosg.papagiannis@surrey.ac.uk
Moschoyiannis, SotirisS.Moschoyiannis@surrey.ac.uk
Date : 2019
Related URLs :
Depositing User : Clive Harris
Date Deposited : 30 Oct 2019 13:56
Last Modified : 10 Dec 2019 02:08
URI: http://epubs.surrey.ac.uk/id/eprint/852995

Actions (login required)

View Item View Item

Downloads

Downloads per month over past year


Information about this web site

© The University of Surrey, Guildford, Surrey, GU2 7XH, United Kingdom.
+44 (0)1483 300800