Comparing subjective image quality measurement methods for the creation of public databases

Judith Redi; Hantao Liu; Hani Alers; Rodolfo Zunino; Ingrid Heynderickx

doi:10.1117/12.839195

18 January 2010 Comparing subjective image quality measurement methods for the creation of public databases

Judith Redi, Hantao Liu, Hani Alers, Rodolfo Zunino, Ingrid Heynderickx

Proceedings Volume 7529, Image Quality and System Performance VII; 752903 (2010) https://doi.org/10.1117/12.839195
Event: IS&T/SPIE Electronic Imaging, 2010, San Jose, California, United States

Abstract

The Single Stimulus (SS) method is often chosen to collect subjective data testing no-reference objective metrics, as it is straightforward to implement and well standardized. At the same time, it exhibits some drawbacks; spread between different assessors is relatively large, and the measured ratings depend on the quality range spanned by the test samples, hence the results from different experiments cannot easily be merged . The Quality Ruler (QR) method has been proposed to overcome these inconveniences. This paper compares the performance of the SS and QR method for pictures impaired by Gaussian blur. The research goal is, on one hand, to analyze the advantages and disadvantages of both methods for quality assessment and, on the other, to make quality data of blur impaired images publicly available. The obtained results show that the confidence intervals of the QR scores are narrower than those of the SS scores. This indicates that the QR method enhances consistency across assessors. Moreover, QR scores exhibit a higher linear correlation with the distortion applied. In summary, for the purpose of building datasets of subjective quality, the QR approach seems promising from the viewpoint of both consistency and repeatability.

Citation Download Citation

Judith Redi, Hantao Liu, Hani Alers, Rodolfo Zunino, and Ingrid Heynderickx "Comparing subjective image quality measurement methods for the creation of public databases", Proc. SPIE 7529, Image Quality and System Performance VII, 752903 (18 January 2010); https://doi.org/10.1117/12.839195

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available