We study a unified form of Tikhonov regularization for ill-posed problems with a general data similarity term. We discuss sufficient conditions on this generalized Tikhonov functional that guarantee existence and stability of solutions. Furthermore, we show that some particular cases of similarity functionals and regularization techniques can be cast into a unified theoretical framework. In particular, we consider the cases of $ p $-power norm, Bregman distance and mutual information as examples of a data similarity term, and Tikhonov regularization of order one or using a Sobolev norm, total variation penalization and powers of semi-norms associated to closed operators as examples of a regularization term. Finally, we take up the case of the image registration problem.
Citation: El Mostafa Kalmoun, Fatimah Allami. On the existence and stability of minimizers for generalized Tikhonov functionals with general similarity data[J]. AIMS Mathematics, 2021, 6(3): 2764-2777. doi: 10.3934/math.2021169
We study a unified form of Tikhonov regularization for ill-posed problems with a general data similarity term. We discuss sufficient conditions on this generalized Tikhonov functional that guarantee existence and stability of solutions. Furthermore, we show that some particular cases of similarity functionals and regularization techniques can be cast into a unified theoretical framework. In particular, we consider the cases of $ p $-power norm, Bregman distance and mutual information as examples of a data similarity term, and Tikhonov regularization of order one or using a Sobolev norm, total variation penalization and powers of semi-norms associated to closed operators as examples of a regularization term. Finally, we take up the case of the image registration problem.
[1] | S. W. Anzengruber, The Discrepancy Principle for Tikhonov Regularization in Banach spaces: Regularization pPoperties and Rates of Convergence. Südwestdeutscher Verlag für Hochschulschriften, 2012. |
[2] | L. M. Bregman, The relaxation method of finding the common point of convex sets and its application to the solution of problems in convex programming, USSR Comput. Math. Math. Phys., 7 (1976), 200–217. |
[3] | M. Burger, S. Osher, Convergence rates of convex variational regularization, Inverse Probl., 20 (2004), 1411. doi: 10.1088/0266-5611/20/5/005 |
[4] | V. Caselles, A. Chambolle, M. Novaga, Total variation in imaging, Handb. Math. Methods Imaging, 2015 (2015), 1455–1499. |
[5] | T. Chan, S. Esedoglu, F. Park, A. Yip, Recent developments in total variation image restoration, Math. Models Comput. Vision, 17 (2005). |
[6] | I. Ekeland, R. Temam, Convex analysis and variational problems, 28 (1999). |
[7] | H. W. Engl, M. Hanke, A. Neubauer, Regularization of Inverse Problems, Springer Science Business Media, 375 (1996). |
[8] | J. Flemming, Theory and examples of variational regularization with non-metric fitting functionals, J. Inverse Ill-Posed Probl., 18 (2010), 677–699, |
[9] | A. Gholami, S. M. Hosseini, A balanced combination of Tikhonov and total variation regularizations for reconstruction of piecewise-smooth signals, Signal Processing, 93 (2013), 1945–1960. doi: 10.1016/j.sigpro.2012.12.008 |
[10] | C. Groetsch, The theory of Tikhonov regularization for Fredholm equations. 104p, Boston Pitman Publication, 1984. |
[11] | J. Hadamard, Lectures on Cauchy's problem in linear partial differential equations, yale univ, Press. New Haven, 1923. |
[12] | B. Hofmann, B. Kaltenbacher, C. Poeschl, O. Scherzer, A convergence rates result for Tikhonov regularization in Banach spaces with non-smooth operators, Inverse Problems, 23 (2007), 987. doi: 10.1088/0266-5611/23/3/009 |
[13] | B. K. Horn, B. G. Schunck, Determining optical flow, Artif. Intel., 17 (1981), 185–203. |
[14] | E. M. Kalmoun, An investigation of smooth tv-like regularization in the context of the optical flow problem, J. Imaging, 4 (2018), 31. doi: 10.3390/jimaging4020031 |
[15] | P. Kazemi, R. J. Renka, Tikhonov regularization using Sobolev metrics, Electron. J. Differ. Eq., 2014. |
[16] | S. Kindermann, Convex Tikhonov regularization in Banach spaces: New results on convergence rates, J. Inverse Ill-posed Probl., 24 (2016), 341–350. |
[17] | G. Mazzieri, R. Spies, K. Temperini, Existence, uniqueness and stability of minimizers of generalized Tikhonov–Phillips functionals, J. Math. Anal. Appl., 396 (2012), 396–411. doi: 10.1016/j.jmaa.2012.06.039 |
[18] | F. D. M. Neto, A. J. da Silva Neto, An Introduction to Inverse Problems with Applications, Springer Science & Business Media, 2012. |
[19] | D. L. Phillips, A technique for the numerical solution of certain integral equations of the first kind, J. ACM (JACM), 9 (1962), 84–97. doi: 10.1145/321105.321114 |
[20] | C. Pöschl, Tikhonov Regularization with General Residual Term, PhD thesis, University of Innsbruck, Austria, 2008. |
[21] | E. Resmerita, Regularization of ill-posed problems in Banach spaces: Convergence rates, Inverse Probl., 21 (2005), 1303. doi: 10.1088/0266-5611/21/4/007 |
[22] | L. I. Rudin, S. Osher, E. Fatemi, Nonlinear total variation based noise removal algorithms, Physica D: Nonlinear Phenom., 60 (1992), 259–268. doi: 10.1016/0167-2789(92)90242-F |
[23] | S. Salzo, Variational Regularization for Image Registration: Theory and Algorithms, PhD thesis, Dipartimento di Informatica e Scienze dell'Informazione, 2012. |
[24] | A. N. Tikhonov, Solution of incorrectly formulated problems and the regularization method, Soviet Math., 4 (1963), 1035–1038. |
[25] | P. Viola, W. M. Wells III, Alignment by maximization of mutual information, Int. J. Comput. Vision, 24 (1997), 137–154. doi: 10.1023/A:1007958904918 |