Rate-distortion optimized video summary generation and transmission over packet lossy networks

Peshala V. Pahalawatta; Zhu Li; Fan Zhai; Aggelos K. Katsaggelos

doi:10.1117/12.586327

14 March 2005 Rate-distortion optimized video summary generation and transmission over packet lossy networks

Peshala V. Pahalawatta, Zhu Li, Fan Zhai, Aggelos K. Katsaggelos

Proceedings Volume 5685, Image and Video Communications and Processing 2005; (2005) https://doi.org/10.1117/12.586327
Event: Electronic Imaging 2005, 2005, San Jose, California, United States

Abstract

The goal of video summarization is to select key frames from a video sequence in order to generate an optimal summary that can accommodate constraints on viewing time, storage, or bandwidth. While video summary generation without transmission considerations has been studied extensively, the problem of rate-distortion optimized summary generation and transmission in a packet-lossy network has gained little attention. We consider the transmission of summarized video over a packet-lossy network such as the Internet. We depart from traditional rate control methods by not sacrificing the image quality of each transmitted frame but instead focusing on the frames that can be dropped without seriously affecting the quality of the video sequence. We take into account the packet loss probability, and use the end-to-end distortion to optimize the video quality given constraints on the temporal rate of the summary. Different network scenarios such as when a feedback channel is not available, and when a feedback channel is available with the possibility of retransmission, are considered. In each case, we assume a strict end-to-end delay constraint such that the summarized video can be viewed in real-time. We show simulation results for each case, and also discuss the case when the feedback delay may not be constant.

Citation Download Citation

Peshala V. Pahalawatta, Zhu Li, Fan Zhai, and Aggelos K. Katsaggelos "Rate-distortion optimized video summary generation and transmission over packet lossy networks", Proc. SPIE 5685, Image and Video Communications and Processing 2005, (14 March 2005); https://doi.org/10.1117/12.586327

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available