Automatic image assessment from facial attributes

Raymond Ptucha; David Kloosterman; Brian Mittelstaedt; Alexander Loui

doi:10.1117/12.2040393

7 March 2014 Automatic image assessment from facial attributes

Raymond Ptucha, David Kloosterman, Brian Mittelstaedt, Alexander Loui

Proceedings Volume 9020, Computational Imaging XII; 90200C (2014) https://doi.org/10.1117/12.2040393
Event: IS&T/SPIE Electronic Imaging, 2014, San Francisco, California, United States

Abstract

Personal consumer photography collections often contain photos captured by numerous devices stored both locally and via online services. The task of gathering, organizing, and assembling still and video assets in preparation for sharing with others can be quite challenging. Current commercial photobook applications are mostly manual-based requiring significant user interactions. To assist the consumer in organizing these assets, we propose an automatic method to assign a fitness score to each asset, whereby the top scoring assets are used for product creation. Our method uses cues extracted from analyzing pixel data, metadata embedded in the file, as well as ancillary tags or online comments. When a face occurs in an image, its features have a dominating influence on both aesthetic and compositional properties of the displayed image. As such, this paper will emphasize the contributions faces have on affecting the overall fitness score of an image. To understand consumer preference, we conducted a psychophysical study that spanned 27 judges, 5,598 faces, and 2,550 images. Preferences on a per-face and per-image basis were independently gathered to train our classifiers. We describe how to use machine learning techniques to merge differing facial attributes into a single classifier. Our novel methods of facial weighting, fusion of facial attributes, and dimensionality reduction produce stateof- the-art results suitable for commercial applications.

Citation Download Citation

Raymond Ptucha, David Kloosterman, Brian Mittelstaedt, and Alexander Loui "Automatic image assessment from facial attributes", Proc. SPIE 9020, Computational Imaging XII, 90200C (7 March 2014); https://doi.org/10.1117/12.2040393

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available