Comparison of automatic shot boundary detection algorithms

Rainer W. Lienhart

doi:10.1117/12.333848

17 December 1998 Comparison of automatic shot boundary detection algorithms

Rainer W. Lienhart

Proceedings Volume 3656, Storage and Retrieval for Image and Video Databases VII; (1998) https://doi.org/10.1117/12.333848
Event: Electronic Imaging '99, 1999, San Jose, CA, United States

Abstract

Various methods of automatic shot boundary detection have been proposed and claimed to perform reliably. Detection of edits is fundamental to any kind of video analysis. It segments a video into its basic components, that is, the shots. However, only few comparative investigations on early shot boundary detection algorithms have been published. These investigations mainly concentrate on measuring the edit detection performance. However, they do not consider the algorithms' ability to classify the types, and to locate the boundaries of the edits correctly. This paper extends these comparative investigations. More recent algorithms designed explicitly to detect specific complex editing operations, such as fades and dissolves, are taken into account. In addition, their ability to classify the types and locate the boundaries of such edits are examined. The algorithms' performance is measured in terms of hit rate, number of false hits, and miss rate for hard cuts, fades, and dissolves, over a large and diverse set of video sequences. The experiments show that while hard cuts and fades can be detected reliably, dissolves are still an open research issue. The false hit rate for dissolves is usually unacceptably high, ranging from 50 percent up to more than 400 percent. Moreover, all algorithms seem to fail under roughly the same conditions.

Citation Download Citation

Rainer W. Lienhart "Comparison of automatic shot boundary detection algorithms", Proc. SPIE 3656, Storage and Retrieval for Image and Video Databases VII, (17 December 1998); https://doi.org/10.1117/12.333848

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available