A reinforcement learning approach in rotated image recognition and its convergence analysis

Khan M. Iftekharuddin; Yaqin Li

doi:10.1117/12.681237

8 September 2006 A reinforcement learning approach in rotated image recognition and its convergence analysis

Khan M. Iftekharuddin, Yaqin Li

Proceedings Volume 6310, Photonic Devices and Algorithms for Computing VIII; 63100N (2006) https://doi.org/10.1117/12.681237
Event: SPIE Optics + Photonics, 2006, San Diego, California, United States

Abstract

One of the major problems in automatic target recognition (ATR) involves the recognition of images in different orientations. In a classical training-testing setup for an ATR for rotated targets using neural networks, the recognition is inherently static, and the performance is largely dependent on the range of orientation angles in the training process. To alleviate this problem, we propose a reinforcement learning (RL) approach for the ATR of rotated images. The RL is implemented in an adaptive critic design (ACD) framework wherein the ACD is mainly composed of the neuro-dynamic programming of an action network and a critic network. The proposed RL provides an adaptive learning and object recognition ability without a priori training. Numerical simulations demonstrate that the proposed ACD-based ATR system can effectively recognize rotated target with the whole range of 180° rotation. Analytic characterization of the learning algorithm provides a sufficient condition for its asymptotic convergence. Finally, we obtain an upper bound for the estimation error of the cost-to-go function under the asymptotic convergence condition.

Citation Download Citation

Khan M. Iftekharuddin and Yaqin Li "A reinforcement learning approach in rotated image recognition and its convergence analysis", Proc. SPIE 6310, Photonic Devices and Algorithms for Computing VIII, 63100N (8 September 2006); https://doi.org/10.1117/12.681237

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available