Non local mean method has been widely used to fill the holes in the depth image based rendering system. For selected candidate patches, the weighting coefficient is very important for filling effect. In this paper, we select the optimal candidate patches depending on color, gradient and depth information. In order to obtain more appropriate weighting coefficient for each candidate patches, namely soft weighting, we constructed an equation sets between the valid pixels in the hole and the corresponding pixels in each candidate patches. The weighting coefficient is computed by the Orthogonal Matching Pursuit method (OMP), namely soft weighting. Finally, we combine the weight of several best matching patches to fill the holes. The results show that the proposed method has a better robustness and performance for filling hole in DIBR systems than other holes filling based on algorithms.
|