Computation offloading strategy for UAV-assisted fog computing emergency communication system based on deep reinforcement learning

Yichen Song; Wenle Bai; Qing Wei; Xintong Li

doi:10.1117/12.3023380

1 April 2024 Computation offloading strategy for UAV-assisted fog computing emergency communication system based on deep reinforcement learning

Yichen Song, Wenle Bai, Qing Wei, Xintong Li

Author Affiliations +

Proceedings Volume 12987, Third International Conference on Computer Technology, Information Engineering, and Electron Materials (CTIEEM 2023); 1298702 (2024) https://doi.org/10.1117/12.3023380
Event: Third International Conference on Computer Technology, Information Engineering, and Electron Materials (CTIEEM 2023), 2023, Zhengzhou, China

Abstract

With the continuous development of modern communication technologies, many computation-intensive and delay-sensitive applications have emerged. Unmanned Aerial Vehicle (UAV) can perform excellent and unique in emergency communication systems by virtue of its flexibility. In this paper, a UAV-assisted fog computing emergency communication system is designed, wherein a UAV that has computing capabilities can act as a UAV Fog Access Point (UAV-FAP) and offer surrounding mobile devices (MDs) computational offloading services. The objective is to minimize the maximum processing delay of the system. The optimization problem of jointly optimizing MD scheduling, distribution of resources and UAV flight direction is proposed under energy consumption constraints. Considering that the problem is a mixed integer nonlinear programming (MINLP) problem, a computational offloading algorithm based on Deep Deterministic Policy Gradient (DDPG) is proposed to solve the non-convex problem. And the Switches from Adam to SGD (SWATS) algorithm is also invoked to update the neural network parameters with the optimizer to avoid falling into local optima to some extent. Simulation results show that the DDPG-SWATS joint algorithm converges quickly and has a small processing delay compared with the benchmark algorithm.

(2024) Published by SPIE. Downloading of the abstract is permitted for personal use only.

Citation Download Citation

Yichen Song, Wenle Bai, Qing Wei, and Xintong Li "Computation offloading strategy for UAV-assisted fog computing emergency communication system based on deep reinforcement learning", Proc. SPIE 12987, Third International Conference on Computer Technology, Information Engineering, and Electron Materials (CTIEEM 2023), 1298702 (1 April 2024); https://doi.org/10.1117/12.3023380

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available