University of Surrey

Test tubes in the lab Research in the ATI Dance Research

An Actor-Critic-Based UAV-BSs Deployment Method for Dynamic Environments

Chen, Zhiwei, Zhong, Yi, Ge, Xiaohu and Ma, Yi (2020) An Actor-Critic-Based UAV-BSs Deployment Method for Dynamic Environments In: IEEE ICC 2020, 7-11 June 2020, Dublin, Ireland.

Chen_ICC_2020_AI_optimisation.pdf - Accepted version Manuscript

Download (358kB) | Preview


In this paper, the real-time deployment of unmanned aerial vehicles (UAVs) as flying base stations (BSs) for optimizing the throughput of mobile users is investigated for UAV networks. This problem is formulated as a time-varying mixed-integer non-convex programming (MINP) problem, which is challenging to find an optimal solution in a short time with conventional optimization techniques. Hence, we propose an actor-critic-based (AC-based) deep reinforcement learning (DRL) method to find near-optimal UAV positions at every moment. In the proposed method, the process searching for the solution iteratively at a particular moment is modeled as a Markov decision process (MDP). To handle infinite state and action spaces and improve the robustness of decision process, two powerful neural networks (NNs) are configured to evaluate the UAV position adjustments and make decisions, respectively. Compared with heuristic, sequential least-squares programming and fixed methods, Simulation results have shown that the proposed method outperforms in terms of the throughput at every moment in UAV networks.

Item Type: Conference or Workshop Item (Conference Paper)
Divisions : Faculty of Engineering and Physical Sciences > Electronic Engineering
Authors :
Chen, Zhiwei
Zhong, Yi
Ge, Xiaohu
Date : 27 January 2020
Uncontrolled Keywords : UAV deployment, deep reinforcement learning, throughput maximization, dynamic user, actor-critic.
Depositing User : James Marshall
Date Deposited : 05 Feb 2020 16:56
Last Modified : 07 Jun 2020 02:08

Actions (login required)

View Item View Item


Downloads per month over past year

Information about this web site

© The University of Surrey, Guildford, Surrey, GU2 7XH, United Kingdom.
+44 (0)1483 300800