The Kronecker product of two matrices is known as a special algebraic operation of two arbitrary matrices in the computational aspect of matrix theory. This kind of matrix operation has some interesting and striking operation properties, one of which is given by $ (A \otimes B)(C \otimes D) = (AC) \otimes (BD) $ and is often called the mixed-product equality. In view of this equality, the Kronecker product $ A_1 \otimes A_2 $ of any two matrices can be rewritten as the dilation factorization $ A_1 \otimes A_2 = (A_1 \otimes I_{m_2})(I_{n_1} \otimes A_2) $, and the Kronecker product $ A_1 \otimes A_2 \otimes A_3 $ can be rewritten as the dilation factorization $ A_1 \otimes A_2 \otimes A_3 = (A_1\otimes I_{m_2} \otimes I_{m_3})(I_{n_1} \otimes A_2 \otimes I_{m_3})(I_{n_1} \otimes I_{n_2} \otimes A_3) $. In this article, we proposed a series of concrete problems regarding the dilation factorizations of the Kronecker products of two or three matrices, and established a collection of novel and pleasing equalities, inequalities, and formulas for calculating the ranks, dimensions, orthogonal projectors, and ranges related to the dilation factorizations. We also present a diverse range of interesting results on the relationships among the Kronecker products $ I_{m_1} \otimes A_2 \otimes A_3 $, $ A_1 \otimes I_{m_2} \otimes A_3 $ and $ A_1 \otimes A_2 \otimes I_{m_3} $.
Citation: Yongge Tian, Ruixia Yuan. New facts related to dilation factorizations of Kronecker products of matrices[J]. AIMS Mathematics, 2023, 8(12): 28818-28832. doi: 10.3934/math.20231477
The Kronecker product of two matrices is known as a special algebraic operation of two arbitrary matrices in the computational aspect of matrix theory. This kind of matrix operation has some interesting and striking operation properties, one of which is given by $ (A \otimes B)(C \otimes D) = (AC) \otimes (BD) $ and is often called the mixed-product equality. In view of this equality, the Kronecker product $ A_1 \otimes A_2 $ of any two matrices can be rewritten as the dilation factorization $ A_1 \otimes A_2 = (A_1 \otimes I_{m_2})(I_{n_1} \otimes A_2) $, and the Kronecker product $ A_1 \otimes A_2 \otimes A_3 $ can be rewritten as the dilation factorization $ A_1 \otimes A_2 \otimes A_3 = (A_1\otimes I_{m_2} \otimes I_{m_3})(I_{n_1} \otimes A_2 \otimes I_{m_3})(I_{n_1} \otimes I_{n_2} \otimes A_3) $. In this article, we proposed a series of concrete problems regarding the dilation factorizations of the Kronecker products of two or three matrices, and established a collection of novel and pleasing equalities, inequalities, and formulas for calculating the ranks, dimensions, orthogonal projectors, and ranges related to the dilation factorizations. We also present a diverse range of interesting results on the relationships among the Kronecker products $ I_{m_1} \otimes A_2 \otimes A_3 $, $ A_1 \otimes I_{m_2} \otimes A_3 $ and $ A_1 \otimes A_2 \otimes I_{m_3} $.
[1] | A. Barrlund, Efficient solution of constrained least squares problems with Kronecker product structure, SIAM J. Matrix Anal. Appl., 19 (1994), 154–160. https://doi.org/10.1137/S0895479895295027 doi: 10.1137/S0895479895295027 |
[2] | A. Ben-Israel, T. N. E. Greville, Generalized inverses: Theory and applications, 2 Eds., Springer, New York, 2003. |
[3] | D. S. Bernstein, Scalar, vector, and matrix mathematics: Theory, facts, and formulas-revised and expanded edition, Princeton University Press, Princeton, NJ, 2018. |
[4] | S. L. Campbell, C. D. Meyer, Generalized inverses of linear transformations, SIAM, Philadelphia, 2009. |
[5] | C. Canuto, V. Simoncini, M. Verani, On the decay of the inverse of matrices that are sum of Kronecker products, Linear Algebra Appl., 452 (2014), 21–39. https://doi.org/10.1016/j.laa.2014.03.029 doi: 10.1016/j.laa.2014.03.029 |
[6] | T. T. Chen, W. Li, On Condition numbers for the weighted Moore-Penrose inverse and the weighted least squares problem involving Kronecker products, East Asian J. Appl. Math., 4 (2014), 1–20. https://doi.org/10.4208/eajam.230313.070913a doi: 10.4208/eajam.230313.070913a |
[7] | J. Chuai, Y. Tian, Rank equalities and inequalities for Kronecker products of matrices with applications, Appl. Math. Comput., 150 (2004), 129–137. https://doi.org/10.1016/S0096-3003(03)00203-0 doi: 10.1016/S0096-3003(03)00203-0 |
[8] | S. Czesław, Inverting covariance matrices, Discuss. Math. Probab. Statist., 26 (2006), 163–177. |
[9] | H. Diao, R. Jayaram, Z. Song, W. Sun, D. P. Woodruff, Optimal sketching for Kronecker product regression and low rank approximation, Adv. Neural Inf. Process. Syst., 32 (2019), 4739–4750. |
[10] | H. Diao, W. Wang, Y. Wei, S. Qiao, On condition numbers for Moore-Penrose inverse and linear least squares problem involving Kronecker products, Numer. Linear Algebra Appl., 20 (2013), 44–59. https://doi.org/10.1002/nla.1823 doi: 10.1002/nla.1823 |
[11] | M. Fahrbach, G. Fu, M. Ghadiri, Subquadratic Kronecker regression with applications to tensor decomposition, Adv. Neural Inf. Process. Syst., 35 (2022), 28776–28789. |
[12] | D. W. Fausett, C. T. Fulton, Large least squares problems involving Kronecker products, SIAM J. Matrix Anal. Appl., 15 (1994), 219–227. https://doi.org/10.1137/S0895479891222106 doi: 10.1137/S0895479891222106 |
[13] | D. W. Fausett, C. T. Fulton, H. Hashish, Improved parallel QR method for large least squares problems involving Kronecker products, J. Comput. Appl. Math., 78 (1997), 63–78. https://doi.org/10.1016/S0377-0427(96)00109-4 doi: 10.1016/S0377-0427(96)00109-4 |
[14] | C. T. Fulton, L. Wu, Parallel algorithms for large least squares problems involving kronecker products, Nonlin. Anal. Theor. Meth. Appl., 30 (1997), 5033–5040. https://doi.org/10.1016/S0362-546X(97)00189-2 doi: 10.1016/S0362-546X(97)00189-2 |
[15] | A. Graham, Kronecker products and matrix calculus with applications, Wiley, New York, 1981. |
[16] | S. J. Haberman, Direct products and linear models for complete factorial tables, Ann. Statist., 3 (1975), 314–333. https://doi.org/10.1214/aos/1176343059 doi: 10.1214/aos/1176343059 |
[17] | Y. Hardy, W. H. Steeb, Matrix calculus, Kronecker product and tensor product: A practical approach to linear algebra, multilinear algebra and tensor calculus with software implementations, 3 Eds., World Scientific Pub., 2019. |
[18] | M. Huhtanen, Real linear Kronecker product operations, Linear Algebra Appl., 418 (2006), 347–361. https://doi.org/10.1016/j.laa.2006.02.020 doi: 10.1016/j.laa.2006.02.020 |
[19] | H. V. Jemderson, F. Pukelsheim, S. R. Searle, On the history of the Kronecker product, Linear Multilinear A., 14 (1983), 113–120. |
[20] | R. H. Koning, H. Neudecker, T. Wansbeek, Block Kronecker products and the vecb operator, Linear Algebra Appl., 149 (1991), 165–184. https://doi.org/10.1016/0024-3795(91)90332-Q doi: 10.1016/0024-3795(91)90332-Q |
[21] | P. Lancaster, M. Tismenetsky, The theory of matrices: With applications, 2 Eds., Academic Press, San Diego, 1985. |
[22] | G. Marsaglia, G. P. H. Styan, Equalities and inequalities for ranks of matrices, Linear Multilinear A., 2 (1974), 269–292. |
[23] | L. Meng, L. Li, Condition numbers of the minimum norm least squares solution for the least squares problem involving Kronecker products, AIMS Math., 6 (2021), 9366–9377. https://doi.org/10.3934/math.2021544 doi: 10.3934/math.2021544 |
[24] | G. S. Rogers, Kronecker products in ANOVA–-a first step, Amer. Statist., 38 (1984), 197–202. https://doi.org/10.1080/00031305.1984.10483199 doi: 10.1080/00031305.1984.10483199 |
[25] | W. H. Steeb, Y. Hardy, Matrix calculus and Kronecker product: A practical approach to linear and multilinear algebra, World Scientific, River Edge, NJ, USA, 2011. |
[26] | D. A. Stefonishin, On the generic rank of matrices composed of Kronecker products, Doklady Math., 97 (2018), 125–128. https://doi.org/10.1134/S1064562418020060 doi: 10.1134/S1064562418020060 |
[27] | Y. Tian, Some rank equalities and inequalities for Kronecker products of matrices, Linear Multilinear A., 53 (2005), 445–454. https://doi.org/10.1080/03081080500055072 doi: 10.1080/03081080500055072 |
[28] | Y. Tian, Problem 815: Comparing ranges of Kronecker products of matrices, solution by E. Herman et al., Coll. Math. J., 37 (2006), 397. |
[29] | Y. Tian, On relationships between two linear subspaces and two orthogonal projectors, Spec. Matrices, 7 (2019), 142–212. https://doi.org/10.1515/spma-2019-0013 doi: 10.1515/spma-2019-0013 |
[30] | Y. Tian, Miscellaneous equalities for idempotent matrices with applications, Open Math., 18 (2020), 671–714. https://doi.org/10.1515/math-2020-0147 doi: 10.1515/math-2020-0147 |
[31] | Y. Tian, G. P. H. Styan, Rank equalities for idempotent and involutory matrices, Linear Algebra Appl., 335 (2001), 101–117. |
[32] | C. F. Van Loan, The ubiquitous Kronecker product, J. Comp. Appl. Math., 123 (2000), 85–100. https://doi.org/10.1016/S0377-0427(00)00393-9 doi: 10.1016/S0377-0427(00)00393-9 |
[33] | C. F. Van Loan, N. Pitsianis, Approximation with Kronecker products, Linear algebra for large scale and real-time applications, Springer, Dordrecht, 232 (1993), 293–314. https://doi.org/10.1007/978-94-015-8196-7_17 |
[34] | H. Zhang, F. Ding, On the Kronecker products and their applications, J. Appl. Math., 13 (2013), 296185. |