Abstract
The problem of tensor completion arises often in signal processing and machine learning. It consists of recovering a tensor from a subset of its entries. The usual structural assumption on a tensor that makes the problem well posed is that the tensor has low rank in every mode. Several tensor completion methods based on minimization of nuclear norm, which is the closest convex approximation of rank, have been proposed recently, with applications mostly in image inpainting problems. It is often stated in these papers that methods based on Tucker factorization perform poorly when the true ranks are unknown. In this paper, we propose a simple algorithm for Tucker factorization of a tensor with missing data and its application to low-\(n\)-rank tensor completion. The algorithm is similar to previously proposed method for PARAFAC decomposition with missing data. We demonstrate in several numerical experiments that the proposed algorithm performs well even when the ranks are significantly overestimated. Approximate reconstruction can be obtained when the ranks are underestimated. The algorithm outperforms nuclear norm minimization methods when the fraction of known elements of a tensor is low.



Similar content being viewed by others
Explore related subjects
Discover the latest articles, news and stories from top researchers in related subjects.Notes
References
Acar, E., Dunlavy, D. M., Kolda, T. G., & Mørup, M. (2011). Scalable tensor factorizations for incomplete data. Chemometrics and Intelligent Laboratory Systems, 106(1), 41–56. doi:10.1016/j.chemolab.2010.08.004.
Andersson, C. A., Bro, R. (1998). Improving the speed of multi-way algorithms: Part i. tucker3. Chemometrics and Intelligent Laboratory Systems, 42(1–2), 93–103. doi:10.1016/S0169-7439(98)00010-0, http://www.sciencedirect.com/science/article/pii/S0169743998000100.
Andersson, C.A., Bro, R. (2000). The n-way toolbox for matlab. Chemometrics and Intelligent Laboratory Systems 52(1):1–4. doi:10.1016/S0169-7439(00)00071-X, http://www.sciencedirect.com/science/article/pii/S016974390000071X.
Bro, R. (1997). Parafac. tutorial and applications. Chemometrics and Intelligent Laboratory Systems 38(2):149–171. doi:10.1016/S0169-7439(97)00032-4, http://www.sciencedirect.com/science/article/pii/S0169743997000324.
Candes, E. J., & Recht, B. (2009). Exact matrix completion via convex optimization. Foundations of Computational Mathematics, 9, 717–772. doi:10.1007/s10208-009-9045-5.
De Lathauwer, L., De Moor, B., & Vandewalle, J. (2000). A multilinear singular value decomposition. SIAM Journal on Matrix Analysis and Applications, 21(4), 1253–1278. doi:10.1137/S0895479896305696.
Dunlavy, D. M., Kolda, T.G., Acar, E. (2010) Poblano v1.0: A matlab toolbox for gradient-based optimization. Tech. Rep. SAND2010-1422, Sandia National Laboratories, Albuquerque, NM and Livermore, CA.
Gandy, S., Recht, B., Yamada, I. (2011) Tensor completion and low-\(n\)-rank tensor recovery via convex optimization. Inverse Problems 27, http://dx.doi.org/10.1088/0266-5611/27/2/025010
Håstad, J. (1990) Tensor rank is np-complete. Journal of Algorithms 11(4):644–654, doi:10.1016/0196-6774(90),90014-6, http://www.sciencedirect.com/science/article/pii/0196677490900146.
Kolda, T. G., & Bader, B. W. (2009). Tensor decompositions and applications. SIAM Review, 51(3), 455–500. doi:10.1137/07070111X.
Liu, J., Musialski, P., Wonka, P., Ye, J. (2009) Tensor completion for estimating missing values in visual data. In: Proceedings of 2009 IEEE ICCV, http://dx.doi.org/10.1109/ICCV.2009.5459463.
Liu, J., Musialski, P., Wonka, P., & Ye, J. (2013). Tensor completion for estimating missing values in visual data. IEEE Transactions on Pattern Analysis and Machine Intelligence, 35(1), 208–220. doi:10.1109/TPAMI.2012.39.
Mairal, J., Elad, M., & Sapiro, G. (2008). Sparse representation for color image restoration. IEEE Transactions on Image Processing, 17(1), 23–69. doi:10.1109/TIP.2007.911828.
Martin, D., Fowlkes, C., Tal, D., Malik, J. (2001) A database of human segmented natural images and its application to evaluating segmentation algorithms and measuring ecological statistics. In: Proceedings of 8th International Conference Computer Vision, 2, 416–423.
Recht, B., Fazel, M., & Parrilo, P. (2010). Guaranteed minimum-rank solutions of linear matrix equations via nuclear norm minimization. SIAM Review, 52(3), 471–501. doi:10.1137/070697835.
Tomasi, G., Bro, R. (2005) Parafac and missing values. Chemometrics and Intelligent Laboratory Systems 75(2):163–180, doi:10.1016/j.chemolab.2004.07.003, http://www.sciencedirect.com/science/article/pii/S0169743904001741.
Tomioka, R., Hayashi, K., Kashima, H.(2011) Estimation of low-rank tensors via convex optimization. Technical report. http://arxiv.org/abs/1010.0789
Tucker, L. R. (1966). Some mathematical notes on three-mode factor analysis. Psychometrika, 31, 279–311. doi:10.1007/BF02289464.
Acknowledgments
This work was supported through Grant 098-0982903-2558 funded by the Ministry of Science, Education and Sports of the Republic of Croatia. The authors would like to thank the project leader Ivica Kopriva. Also, the authors would like to thank the anonymous reviewer whose comments helped us to improve the manuscript.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Filipović, M., Jukić, A. Tucker factorization with missing data with application to low-\(n\)-rank tensor completion. Multidim Syst Sign Process 26, 677–692 (2015). https://doi.org/10.1007/s11045-013-0269-9
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11045-013-0269-9