An image super-resolution reconstruction model based on fractional-order anisotropic diffusion equation

Jimin Yu; Jiajun Yin; Shangbo Zhou; Saiao Huang; Xianzhong Xie; Jimin Yu; Jiajun Yin; Shangbo Zhou; Saiao Huang; Xianzhong Xie

doi:10.3934/mbe.2021326

Mathematical Biosciences and Engineering

2021, Volume 18, Issue 5: 6581-6607. doi: 10.3934/mbe.2021326

Previous Article Next Article

Research article

An image super-resolution reconstruction model based on fractional-order anisotropic diffusion equation

1.
Chongqing University of Posts and Telecommunications, College of Automation, Chongqing 400065, China
2.
Chongqing University, College of Computer Science, Chongqing 400044, China
3.
Chongqing Key Lab of Computer Network and Communication Technology, Chongqing 400065, China

Received: 18 May 2021 Accepted: 19 July 2021 Published: 03 August 2021

The image denoising model based on anisotropic diffusion equation often appears the staircase effect while image denoising, and the traditional super-resolution reconstruction algorithm can not effectively suppress the noise in the image in the case of blur and serious noise. To tackle this problem, a novel model is proposed in this paper. Based on the original diffusion equation, we propose a new method for calculating the adaptive fidelity term and its coefficients, which is based on the relationship between the image gradient and the diffusion function. It is realized that the diffusion speed can be slowed down by adaptively changing the coefficient of the fidelity term, and it is proved mathematically that the proposed fractional adaptive fidelity term will not change the existence and uniqueness of the solution of the original model. At the same time, washout filter is introduced as the control item of the model, and a new model of image super-resolution reconstruction and image denoising is constructed. In the proposed model, the order of fractional differential will be determined adaptively by the local variance of the image. And we give the numerical calculation method of the new model in the frequency domain by the method of Fourier transform. The experimental results show that the proposed algorithm can better prevent the staircase effect and achieve better visual effect. And by introducing washout filter to act as the control of the model, the stability of the system can be improved and the system can converge to a stable state quickly.
- anisotropic diffusion equation,
- adaptive gradient fidelity term,
- washout filter,
- image super-resolution reconstruction
Citation: Jimin Yu, Jiajun Yin, Shangbo Zhou, Saiao Huang, Xianzhong Xie. An image super-resolution reconstruction model based on fractional-order anisotropic diffusion equation[J]. Mathematical Biosciences and Engineering, 2021, 18(5): 6581-6607. doi: 10.3934/mbe.2021326

Related Papers:

Abstract

The image denoising model based on anisotropic diffusion equation often appears the staircase effect while image denoising, and the traditional super-resolution reconstruction algorithm can not effectively suppress the noise in the image in the case of blur and serious noise. To tackle this problem, a novel model is proposed in this paper. Based on the original diffusion equation, we propose a new method for calculating the adaptive fidelity term and its coefficients, which is based on the relationship between the image gradient and the diffusion function. It is realized that the diffusion speed can be slowed down by adaptively changing the coefficient of the fidelity term, and it is proved mathematically that the proposed fractional adaptive fidelity term will not change the existence and uniqueness of the solution of the original model. At the same time, washout filter is introduced as the control item of the model, and a new model of image super-resolution reconstruction and image denoising is constructed. In the proposed model, the order of fractional differential will be determined adaptively by the local variance of the image. And we give the numerical calculation method of the new model in the frequency domain by the method of Fourier transform. The experimental results show that the proposed algorithm can better prevent the staircase effect and achieve better visual effect. And by introducing washout filter to act as the control of the model, the stability of the system can be improved and the system can converge to a stable state quickly.

References

[1]	Q. Yang, Y. Zhang, T. Zhao, Example-based image super-resolution via blur kernel estimation and variational reconstruction, Pattern Recognit. Lett., 117 (2019), 83-89. doi: 10.1016/j.patrec.2018.12.008
[2]	A. Laghrib, A. Hakim, S. Raghay, An iterative image super-resolution approach based on Bregman distance, Signal Proc. Image Commun., 58 (2017), 24-34. doi: 10.1016/j.image.2017.06.006
[3]	A. Laghrib, A. Ghazdali, A. Hakim, S. Raghay, A multi-frame super-resolution using diffusion registration and a nonlocal variational image restoration, Comput. Math. Appl., 72 (2016), 2535-2548. doi: 10.1016/j.camwa.2016.09.013
[4]	L. Wang, S. Zhou, K. Awudu, Image zooming technique based on the split Bregman iteration with fractional order variation regularization, Int. Arab J. Inf. Technol., 13 (2016), 944-950.
[5]	F. Kazemi Golbaghi, M. R. Eslahchi, M. Rezghi, Image denoising by a novel variable order total fractional variation model, Math. Methods Appl. Sci., 44 (2021), 7250-7261. doi: 10.1002/mma.7257
[6]	B. V. R. Kumar, A. Halim, R. Vijayakrishna, Higher order PDE based model for segmenting noisy image, IET Image Proc., 14 (2020), 2597-2609. doi: 10.1049/iet-ipr.2019.0885
[7]	L. Afraites, A. Hadri, A. Laghrib, A denoising model adapted for impulse and Gaussian noises using a constrained-PDE, Inverse Probl., 36 (2020), 025006. doi: 10.1088/1361-6420/ab5178
[8]	L. I. Rudin, S. Osher, E. Fatemi, Nonlinear total variation based noise removal algorithms, Phys. D Nonlinear Phenom., 60 (1992), 1-4. doi: 10.1016/0167-2789(92)90223-A
[9]	J. Xu, X. Feng, Y. Hao, Y. Han, Image decomposition and staircase effect reduction based on total generalized variation, J. Syst. Eng. Elect., 25 (2014), 168-174. doi: 10.1109/JSEE.2014.00020
[10]	P. Perona, J. Malik, Scale-space and edge detection using anisotropic diffusion, IEEE Trans. Pattern Anal. Mach. Intell., 12 (1990), 629-639. doi: 10.1109/34.56205
[11]	Z. Ren, C. He, Q. Zhang, Fractional order total variation regularization for image super-resolution, Signal Proc., 93 (2013), 2408-2421. doi: 10.1016/j.sigpro.2013.02.015
[12]	J. Bai, X. C. Feng, Fractional-Order Anisotropic Diffusion for Image Denoising, IEEE Trans. Image Proc., 16 (2007), 2492-2502. doi: 10.1109/TIP.2007.904971
[13]	W. Yao, Z. Guo, J. Sun, B. Wu, H. Gao, Multiplicative Noise Removal for Texture Images Based on Adaptive Anisotropic Fractional Diffusion Equations, SIAM J. Imaging Sci., 12 (2019), 839-873. doi: 10.1137/18M1187192
[14]	X. Yin, S. Zhou, Image Structure-Preserving Denoising Based on Difference Curvature Driven Fractional Nonlinear Diffusion, Math. Problems Eng., 2015 (2015).
[15]	X. Yin, S. Chen, L. Wang, S. Zhou, Fractional-order difference curvature-driven fractional anisotropic diffusion equation for image super-resolution, Int. J. Model. Simul. Sci. Comput., 10 (2019).
[16]	A. Abirami, P. Prakash, K. Thangavel, Fractional diffusion equation-based image denoising model using CN-GL scheme, Int. J. Comput. Math., 95 (2018), 1222-1239. doi: 10.1080/00207160.2017.1401707
[17]	F. K. Golbaghi, M. Rezghi, M. R. Eslahchi, A Hybrid Image Denoising Method Based on Integer and Fractional-Order Total Variation, Iran. J. Sci. Technol. Trans. A Sci., 44 (2020), 1803-1814. doi: 10.1007/s40995-020-00977-2
[18]	J. Yu, L. Tan, S. Zhou, L. Wang, M. A. Siddique, Image Denoising Algorithm Based on Entropy and Adaptive Fractional Order Calculus Operator, IEEE Access, 5 (2017), 12275-12285. doi: 10.1109/ACCESS.2017.2718558
[19]	B. J. Maiseli, N. Ally, H. Gao, A noise-suppressing and edge-preserving multiframe super-resolution image reconstruction method, Signal Proc. Image Commun., 34 (2015), 1-13. doi: 10.1016/j.image.2015.03.001
[20]	I. El Mourabit, M. El Rhabi, A. Hakim, A. Laghrib, E. Moreau, A new denoising model for multi-frame super-resolution image reconstruction, Signal Proc., 132 (2017), 51-65. doi: 10.1016/j.sigpro.2016.09.014
[21]	A. Laghrib, A. Ben-Loghfyry, A. Hadri, A. Hakim, A nonconvex fractional order variational model for multi-frame image super-resolution, Signal Proc. Image Commun., 67 (2018), 1-11. doi: 10.1016/j.image.2018.05.011
[22]	E. C. De Oliveira, J. A. Tenreiro Machado, A Review of Definitions for Fractional Derivatives and Integral, Math. Problems Eng., 2014 (2014), 1-6.
[23]	L. Wang, S. Zhou, K. Awudu, Y. Qi, X. Lin, A novel image zooming method based on sparse representation of Weber's law descriptor, Int. J. Adv. Rob. Syst., 14 (2017).
[24]	J. Yu, R. Zhai, S. Zhou, L. J. Tan, Image Denoising Based on Adaptive Fractional Order with Improved PM Model, Math. Prob. Eng., 2018 (2018), 1-11.
[25]	Y. Zhang, J. Sun, An improved BM3D algorithm based on anisotropic diffusion equation, Math. Biosci. Eng., 17 (2020), 4970-4989. doi: 10.3934/mbe.2020050
[26]	V. B. S. Prasath, R. Delhibabu, Image restoration with fuzzy coefficient driven anisotropic diffusion, International Conference on Swarm, Evolutionary, and Memetic Computing, Springer, 2014.
[27]	X. Wang, T. Yang, W. Xu, Bifurcation Control of Finance System Based on Washout Filter, Dyn. Syst. Control, 2013 (2013).
[28]	W. Du, Y. Chu, J. Zhang, Y. Chang, J. Yu, X. An, Control of Hopf Bifurcation in Autonomous System Based on Washout Filter, J. Appl. Math., 2013 (2013).
[29]	S. Zhou, X. Lin, H. Li, Chaotic synchronization of a fractional-order system based on washout filter control, Commun. Nonlinear Sci. Numer. Simul., 16 (2011), 1533-1540. doi: 10.1016/j.cnsns.2010.06.022
[30]	C. C. Xie, X. L. Hu, On a spatially varied gradient fidelity term in PDE based image denoising, 2010 3rd International Congress on Image and Signal Processing, IEEE, 2010.
[31]	A. Laghrib, A. Hadri, A. Hakim, An edge preserving high-order PDE for multiframe image super-resolution, J. Franklin Inst., 356 (2019), 5834-5857. doi: 10.1016/j.jfranklin.2019.02.032
[32]	A. Theljani, Z. Belhachmi, M. Moakher, High-order anisotropic diffusion operators in spaces of variable exponents and application to image inpainting and restoration problems - ScienceDirect, Nonlinear Anal. Real World Appl., 47 (2019), 251-271. doi: 10.1016/j.nonrwa.2018.10.013
[33]	W. Dong, L. Zhang, G. Shi, X. Wu, Image Deblurring and Super-Resolution by Adaptive Sparse Domain Selection and Adaptive Regularization, IEEE Trans. Image Proc., 20 (2011), 1838-1857. doi: 10.1109/TIP.2011.2108306
[34]	R. Timofte, V. De Smet, L. Van Gool, A+: Adjusted Anchored Neighborhood Regression for Fast Super-Resolution, Asian conference on computer vision, Springer, 2014.
[35]	R. Timofte, V. De Smet, L. Van Gool, Anchored Neighborhood Regression for Fast Example-Based Super-Resolution, IEEE Int. Conf. Comput. Vision, Springer, 2014.
[36]	C. Dong, C. C. Loy, K. He, X. Tang, Image super-resolution using deep convolutional networks, IEEE Trans. Pattern Anal. Mach. Intell., 38 (2015), 295-307.
[37]	P. Song, X. Deng, J. F. C. Mota, N. Deligiannis, P. L. Dragotti, M. R. D. Rodrigues, Multimodal Image Super-resolution via Joint Sparse Representations induced by Coupled Dictionaries, IEEE Trans. Comput. Imaging, 6 (2017), 57-72.
[38]	T. Tirer, R. Giryes, Super-Resolution via Image-Adapted Denoising CNNs: Incorporating External and Internal Learning, IEEE Signal Proc. Lett., 26 (2019), 1080-1084. doi: 10.1109/LSP.2019.2920250
[39]	M. Vella, J. F. C. Mota, Robust Single-Image Super-Resolution via CNNs and TV-TV Minimization, IEEE Signal Proc. Lett., preprint, arXiv: 2004.00843.

Reader Comments

Your name:*

Email:*
© 2021 the Author(s), licensee AIMS Press. This is an open access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/4.0)