TSR: algorithm of image hole-filling based on three-step repairing

In order to solve the hole-filling mismatch problem in virtual view synthesis, a three-step repairing (TSR) algorithm was proposed. Firstly, the image with marked holes is decomposed by the non-subsampled shear wave transform ( NSST), which will generate high-/ low-frequency sub-images with different resolutions. Then the improved Criminisi algorithm was used to repair the texture information in the high-frequency sub-images, while the improved curvature driven diffusion (CDD) algorithm was used to repair the low-frequency sub-images with the image structure information. Finally, the repaired parts of high-frequency and low-frequency sub-images are synthesized to obtain the final image through inverse NSST. Experiments show that the peak signal-to-noise ratio (PSNR) of the TSR algorithm is improved by an average of 2 - 3 dB and 1 - 2 dB compared with the Criminisi algorithm and the nearest neighbor interpolation (NNI) algorithm, respectively.