A priority experience replay method for 2V2 close air combat

Junchen Hou; Lang Chen; Xianrui He; Ruohong Gan; Jun Zhou

doi:10.1117/12.2639683

19 October 2022 A priority experience replay method for 2V2 close air combat

Junchen Hou, Lang Chen, Xianrui He, Ruohong Gan, Jun Zhou

Proceedings Volume 12294, 7th International Symposium on Advances in Electrical, Electronics, and Computer Engineering; 1229461 (2022) https://doi.org/10.1117/12.2639683
Event: 7th International Symposium on Advances in Electrical, Electronics and Computer Engineering (ISAEECE 2022), 2022, Xishuangbanna, China

Abstract

Close game is inevitable in air combat. It is far from enough to rely only on pilots to deal with complex decision-making information, so artificial intelligence is needed to make up for the lack of human decision-making. At present, there are some problems such as low sample utilization rate and difficult convergence. In this paper, an algorithm called Prioritized Experience Replay with Balance between Exploration and Exploitation (PER/BEE) is proposed, which can consider the exploration utility and utilization utility of samples comprehensively. Combined with soft actor critic algorithm, the algorithm is applied in 2V2 close air combat. Experiments show that the algorithm can make decisions efficiently in both dominant and inferior states, and its stability and convergence speed are higher than ordinary soft actor critic algorithms.

Citation Download Citation

Junchen Hou, Lang Chen, Xianrui He, Ruohong Gan, and Jun Zhou "A priority experience replay method for 2V2 close air combat", Proc. SPIE 12294, 7th International Symposium on Advances in Electrical, Electronics, and Computer Engineering, 1229461 (19 October 2022); https://doi.org/10.1117/12.2639683

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available