PDF (11 MB)
Collect
Submit Manuscript
Show Outline
Figures (10)

Show 1 more figures Hide 1 figures
Tables (2)
Table 1
Table 2
Research Article | Open Access

Single image super-resolution via blind blurring estimation and anchored space mapping

Xiaole Zhao1()Yadong Wu1Jinsha Tian1Hongying Zhang2
School of Computer Science and Technology, Southwest University of Science and Technology, Mianyang 621010, China.
School of Information Engineering, Southwest University of Science and Technology, Mianyang 621010, China.
Show Author Information

Abstract

It has been widely acknowledged that learning-based super-resolution (SR) methods are effective to recover a high resolution (HR) image from a single low resolution (LR) input image. However, there exist two main challenges in learning-based SR methods currently: the quality of training samples and the demand for computation. We proposed a novel framework for single image SR tasks aiming at these issues, which consists of blind blurring kernel estimation (BKE) and SR recovery with anchored space mapping (ASM). BKE is realized via minimizing the cross-scale dissimilarity of the image iteratively, and SR recovery with ASM is performed based on iterative least square dictionary learning algorithm (ILS-DLA). BKE is capable of improving the compatibility of training samples and testing samples effectively and ASM can reduce consumed time during SR recovery radically. Moreover, a selective patch processing (SPP) strategy measured by average gradient amplitude |grad| of a patch is adopted to accelerate the BKE process. The experimental results show that our method outruns several typical blind and non-blind algorithms on equal conditions.

References

[1]
Freedman, G.; Fattal, R. Image and video upscaling from local self-examples. ACM Transactions on Graphics Vol. 30, No. 2, Article No. 12, 2011.
[2]
Babacan, S. D.; Molina, R.; Katsaggelos, A. K. Parameter estimation in TV image restoration using variational distribution approximation. IEEE Transactions on Image Processing Vol. 17, No. 3, 326-339, 2008.
[3]
Babacan, S. D.; Molina, R.; Katsaggelos, A. K. Total variation super resolution using a variational approach. In: Proceedings of the 15th IEEE International Conference on Image Processing, 641-644, 2008.
[4]
Babacan, S. D.; Molina, R.; Katsaggelos, A. K. Variational Bayesian super resolution. IEEE Transactions on Image Processing Vol. 20, No. 4, 984-999, 2011.
[5]
Sun, J.; Xu, Z.; Shum, H.-Y. Image super-resolution using gradient profile prior. In: Proceedings of IEEE Conference on Computer Vision Pattern Recognition, 1-8, 2008.
[6]
Freeman, W. T.; Jones, T. R.; Pasztor, E. C. Example-based super-resolution. IEEE Computer Graphics and Applications Vol. 22, No. 2, 56-65, 2002.
[7]
Sun, J.; Zheng, N.-N.; Tao, H.; Shum, H.-Y. Image hallucination with primal sketch priors. In: Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition, Vol. 2, 729-736, 2003.
[8]
Chang, H.; Yeung, D. Y.; Xiong, Y. Super-resolution through neighbor embedding. In: Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 275-282, 2004.
[9]
Roweis, S. T.; Saul, L. K. Nonlinear dimensionality reduction by locally linear embedding. Science Vol. 290, No. 5, 2323-2326, 2000.
[10]
Bevilacqua, M.; Roumy, A.; Guillemot, C.; Morel, M.-L. A. Low-complexity single-image super-resolution based on nonnegative neighbor embedding. In: Proceedings of the 23rd British Machine Vision Conference, 135.1-135.10, 2012.
[11]
Yang, J.; Wright, J.; Huang, T.; Ma, Y. Image super-resolution as sparse representation of raw image patches. In: Proceedings of IEEE Conference on Computer Vision and Pattern Recognition, 1-8, 2008.
[12]
Glasner, D.; Bagon, S.; Irani, M. Super-resolution from a single image. In: Proceedings of IEEE 12th International Conference on Computer Vision, 349-356, 2009.
[13]
Yang, J.; Wang, Z.; Lin, Z.; Cohen, S.; Huang, T. Coupled dictionary training for image super-resolution. IEEE Transactions on Image Processing Vol. 21, No. 8, 3467-3478, 2012.
[14]
Yang, J.; Wright, J.; Huang, T.; Ma, Y. Image super-resolution via sparse representation. IEEE Transactions on Image Processing Vol. 19, No. 11, 2861-2873, 2010.
[15]
He, L.; Qi, H.; Zaretzki, R. Beta process joint dictionary learning for coupled feature spaces with application to single image super-resolution. In: Proceedings of IEEE Conference on Computer Vision and Pattern Recognition, 345-352, 2013.
[16]
Zhao, X.; Wu, Y.; Tian, J.; Zhang, H. Single image super-resolution via blind blurring estimation and dictionary learning. In: Communications in Computer and Information Science, Vol. 546. Zha, H.; Chen, X.; Wang, L.; Miao, Q. Eds. Springer Berlin Heidelberg, 22-33, 2015.
[17]
Timofte, R.; De, V.; Van Gool, L. Anchored neighborhood regression for fast example-based super-resolution. In: Proceedings of IEEE International Conference on Computer Vision, 1920-1927, 2013.
[18]
Zontak, M.; Irani, M. Internal statistics of a single natural image. In: Proceedings of IEEE Conference on Computer Vision and Pattern Recognition, 977-984, 2011.
[19]
Yang, C.-Y.; Huang, J.-B.; Yang, M.-H. Exploiting self-similarities for single frame super-resolution. In: Lecture Notes in Computer Science, Vol. 6594. Kimmel, R.; Klette, R.; Sugimoto, A. Eds. Springer Berlin Heidelberg, 497-510, 2010.
[20]
Zoran, D.; Weiss, Y. From learning models of natural image patches to whole image restoration. In: Proceedings of IEEE International Conference on Computer Vision, 479-486, 2011.
[21]
Hu, J.; Luo, Y. Single-image superresolution based on local regression and nonlocal self-similarity. Journal of Electronic Imaging Vol. 23, No. 3, 033014, 2014.
[22]
Zhang, Y.; Liu, J.; Yang, S.; Guo, Z. Joint image denoising using self-similarity based low-rank approximations. In: Proceedings of Visual Communications and Image Processing, 1-6, 2013.
[23]
Michaeli, T.; Irani, M. Blind deblurring using internal patch recurrence. In: Lecture Notes in Computer Science, Vol. 8691. Fleet, D.; Pajdla, T.; Schiele, B.; Tuytelaars, T. Eds. Springer International Publishing, 783-798, 2014.
[24]
Guillemot, C.; Le Meur, O. Image inpainting: Overview and recent advances. IEEE Signal Processing Magazine Vol. 31, No. 1, 127-144, 2014.
[25]
Michaeli, T.; Irani, M. Nonparametric blind super-resolution. In: Proceedings of IEEE International Conference on Computer Vision, 945-952, 2013.
[26]
Engan, K.; Skretting, K.; Husøy, J. H. Family of iterative LS-based dictionary learning algorithms, ILS-DLA, for sparse signal representation. Digital Signal Processing Vol. 17, No. 1, 32-49, 2007.
[27]
Timofte, R.; De Smet, V.; Van Gool, L. A+: Adjusted anchored neighborhood regression for fast super-resolution. In: Lecture Notes in Computer Science, Vol. 9006. Cremers, D.; Reid, I.; Saito, H.; Yang, M.-H. Eds. Springer International Publishing, 111-126, 2014.
[28]
Bevilacqua, M.; Roumy, A.; Guillemot, C.; Morel, M.-L. A. Super-resolution using neighbor embedding of back-projection residuals. In: Proceedings of the 18th International Conference on Digital Signal Processing, 1-8, 2013.
[29]
Irani, M.; Peleg, S. Motion analysis for image enhancement: Resolution, occlusion, and transparency. Journal of Visual Communication and Image Representation Vol. 4, No. 4, 324-335, 1993.
[30]
Irani, M.; Peleg, S. Improving resolution by image registration. CVGIP: Graphical Models and Image Processing Vol. 53, No. 3, 231-239, 1991.
[31]
Dong, C.; Chen, C. L.; He, K.; Tang, X. Learning a deep convolutional network for image super-resolution. In: Lecture Notes in Computer Science, Vol. 8692. Fleet, D.; Pajdla, T.; Schiele, B.; Tuytelaars, T. Eds. Springer International Publishing, 184-199, 2014.
[32]
Zeyde, R.; Elad, M.; Protter, M. On single image scale-up using sparse-representations. In: Lecture Notes in Computer Science, Vol. 6920. Boissonnat, J.-D.; Chenin, P.; Cohen, A. et al. Eds. Springer Berlin Heidelberg, 711-730, 2010.
[33]
Dai, D.; Timofte, R.; Van Gool, L. Jointly optimized regressors for image super-resolution. Computer Graphics Forum Vol. 34, No. 2, 95-104, 2015.
[34]
Shao, W.-Z.; Elad, M. Simple, accurate, and robust nonparametric blind super-resolution. In: Lecture Notes in Computer Science, Vol. 9219. Zhang, Y.-J. Ed. Springer International Publishing, 333-348, 2015.
Computational Visual Media
Pages 71-85
Cite this article:
Zhao X, Wu Y, Tian J, et al. Single image super-resolution via blind blurring estimation and anchored space mapping. Computational Visual Media, 2016, 2(1): 71-85. https://doi.org/10.1007/s41095-016-0043-7
Metrics & Citations  
Article History
Copyright
Rights and Permissions
Return