Joint bit allocation for 3D video coding based on virtual view distortion

Chao Yang; Ping An; Jianxin Wang; Zhaoyang Zhang

doi:10.1117/12.2070924

29 October 2014 Joint bit allocation for 3D video coding based on virtual view distortion

Chao Yang, Ping An, Jianxin Wang, Zhaoyang Zhang

Proceedings Volume 9273, Optoelectronic Imaging and Multimedia Technology III; 92730N (2014) https://doi.org/10.1117/12.2070924
Event: SPIE/COS Photonics Asia, 2014, Beijing, China

Abstract

In multi-view plus depth (MVD) 3D video coding, texture maps and depth maps are coded jointly. The depth maps provide the scene geometry information and are used to render the virtual view at the terminal through a Depth-Image-Based-Rendering (DIBR) technique. The distortion of the coded texture maps and depth maps will induce synthesized virtual view distortion. Besides the coding efficiency of texture maps and depth maps, bit allocation between texture maps and depth maps also has a great effect on the virtual view quality. In this paper, the virtual view distortion is divided into texture maps induced distortion and depth maps induced distortion separately, models of texture maps induced virtual view distortion and depth maps induced virtual view distortion are derived respectively. Based on the depth maps induced virtual view distortion model, depth maps coding Rate Distortion Optimization (RDO) is modified and the depth maps coding efficiency is increased. Meanwhile, we also propose a Rate-distortion (R-D) model to solve the joint bit allocation problem. Experimental results demonstrate the high accuracy of the proposed virtual view distortion model. The R-D performance of the proposed algorithm is close to the full search algorithm that can give the best R-D performance, while the coding complexity of the proposed algorithm is lower. Compared with fixed texture and depth bits ratio (5:1), an average 0.3 dB gains can be achieved by the proposed algorithm. The proposed algorithm has high rate control accuracy with the average error less than 1%.

Citation Download Citation

Chao Yang, Ping An, Jianxin Wang, and Zhaoyang Zhang "Joint bit allocation for 3D video coding based on virtual view distortion", Proc. SPIE 9273, Optoelectronic Imaging and Multimedia Technology III, 92730N (29 October 2014); https://doi.org/10.1117/12.2070924

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available