FOCUSS-based dictionary learning algorithms

Kenneth Kreutz-Delgado; Bhaskar D. Rao

doi:10.1117/12.408634

4 December 2000 FOCUSS-based dictionary learning algorithms

Kenneth Kreutz-Delgado, Bhaskar D. Rao

Proceedings Volume 4119, Wavelet Applications in Signal and Image Processing VIII; (2000) https://doi.org/10.1117/12.408634
Event: International Symposium on Optical Science and Technology, 2000, San Diego, CA, United States

Abstract

Algorithms for data-driven learning of domain-specific over complete dictionaries are developed to obtain maximum likelihood and maximum a posteriori dictionary estimates based on the use of Bayesian models with concave/Schur- concave negative log-priors. Such priors are appropriate for obtaining sparse representations of environmental signals within an appropriately chosen dictionary. The elements of the dictionary can be interpreted as 'concepts,' features or 'words' capable of succinct expression of events encountered in the environment. This is a generalization of vector quantization in that one is interested in a description involving a few dictionary entries, but not necessarily as succinct as one entry. To learn an environmentally-adapted dictionary capable of concise expression of signals generated by the environment, we develop algorithms that iterate between a representative set of sparse representations found by variants of FOCUSS, an affine scaling transformation (ACT)-like sparse signal representation algorithm recently developed at UCSD, and an update of the dictionary using these sparse representations.

Citation Download Citation

Kenneth Kreutz-Delgado and Bhaskar D. Rao "FOCUSS-based dictionary learning algorithms", Proc. SPIE 4119, Wavelet Applications in Signal and Image Processing VIII, (4 December 2000); https://doi.org/10.1117/12.408634

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available