Communication waveform parameter decision based on reinforcement learning

Simin Zhao; Zheng Dou; Lin Qi

doi:10.1117/12.2673795

6 April 2023 Communication waveform parameter decision based on reinforcement learning

Simin Zhao, Zheng Dou, Lin Qi

Proceedings Volume 12615, International Conference on Signal Processing and Communication Technology (SPCT 2022); 126151M (2023) https://doi.org/10.1117/12.2673795
Event: International Conference on Signal Processing and Communication Technology (SPCT 2022), 2022, Harbin, China

Abstract

At present, artificial intelligence and big data are flourishing, driving wireless communication services to a more efficient and intelligent direction, communication devices are increasing dramatically, and the communication environment is becoming increasingly complex, so the decision-making link is crucial to ensure communication performance as much as possible. To address the problems that existing waveform parameter decision algorithms rely on high a priori knowledge, lack of compatibility, and low decision efficiency, a reinforcement learning-based waveform parameter decision method is proposed. The method introduces a dynamic ε mechanism based on the hill-climbing strategy (PHC) under the architecture of the reinforcement learning algorithm and proposes a dynamic ε Q-learning intelligent decision algorithm, which enables the decision model to select ε values more optimally according to the state of the decision network and improves the convergence speed and decision success rate. The algorithm makes full use of the interaction between reinforcement learning and the environment and generates waveform parameter combinations which are suitable for the current channel environment in real-time through online learning. The decision model is based on a multi-carrier spread spectrum (MC-SS) communication system. The simulation results show that the new decision algorithm does not rely on a priori knowledge and has higher decision efficiency, which not only gives suitable decision results in Gaussian channels but also adapts to various fading channels and outperforms the mapping results provided by the Modulation and Coding Scheme (MCS) index table.

Citation Download Citation

Simin Zhao, Zheng Dou, and Lin Qi "Communication waveform parameter decision based on reinforcement learning", Proc. SPIE 12615, International Conference on Signal Processing and Communication Technology (SPCT 2022), 126151M (6 April 2023); https://doi.org/10.1117/12.2673795

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available

Members: $17.00

Non-members: $21.00 ADD TO CART

PROCEEDINGS
6 PAGES

DOWNLOAD PAPER SAVE TO MY LIBRARY

GET CITATION

RIGHTS & PERMISSIONS

Get copyright permission Get copyright permission on Copyright Marketplace

KEYWORDS

Machine learning

Evolutionary algorithms

Telecommunications

Modulation

Performance modeling

Decision making

Data modeling

Show All Keywords

Keywords/Phrases

Search In:

Publication Years