An Actor-Critic-Based UAV-BSs Deployment Method for Dynamic Environments

Chen, Zhiwei, Zhong, Yi, Ge, Xiaohu and Ma, Yi (2020) An Actor-Critic-Based UAV-BSs Deployment Method for Dynamic Environments In: IEEE ICC 2020, 7-11 June 2020, Dublin, Ireland.

Preview

Text Chen_ICC_2020_AI_optimisation.pdf - Accepted version Manuscript Download (358kB) | Preview

Abstract

In this paper, the real-time deployment of unmanned aerial vehicles (UAVs) as flying base stations (BSs) for optimizing the throughput of mobile users is investigated for UAV networks. This problem is formulated as a time-varying mixed-integer non-convex programming (MINP) problem, which is challenging to find an optimal solution in a short time with conventional optimization techniques. Hence, we propose an actor-critic-based (AC-based) deep reinforcement learning (DRL) method to find near-optimal UAV positions at every moment. In the proposed method, the process searching for the solution iteratively at a particular moment is modeled as a Markov decision process (MDP). To handle infinite state and action spaces and improve the robustness of decision process, two powerful neural networks (NNs) are configured to evaluate the UAV position adjustments and make decisions, respectively. Compared with heuristic, sequential least-squares programming and fixed methods, Simulation results have shown that the proposed method outperforms in terms of the throughput at every moment in UAV networks.

Item Type:	Conference or Workshop Item (Conference Paper)
Divisions :	Faculty of Engineering and Physical Sciences > Electronic Engineering
Authors :	Name Email ORCID Chen, Zhiwei Zhong, Yi Ge, Xiaohu Ma, Yi Y.Ma@surrey.ac.uk
Date :	27 January 2020
Uncontrolled Keywords :	UAV deployment, deep reinforcement learning, throughput maximization, dynamic user, actor-critic.
Depositing User :	James Marshall
Date Deposited :	05 Feb 2020 16:56
Last Modified :	07 Jun 2020 02:08
URI:	http://epubs.surrey.ac.uk/id/eprint/853669

Actions (login required)

View Item

Downloads