{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2024,7,6]],"date-time":"2024-07-06T17:19:53Z","timestamp":1720286393986},"reference-count":75,"publisher":"Wiley","issue":"5","license":[{"start":{"date-parts":[[2021,3,16]],"date-time":"2021-03-16T00:00:00Z","timestamp":1615852800000},"content-version":"vor","delay-in-days":0,"URL":"http:\/\/onlinelibrary.wiley.com\/termsAndConditions#vor"}],"funder":[{"DOI":"10.13039\/501100002661","name":"Fonds De La Recherche Scientifique - FNRS","doi-asserted-by":"publisher","id":[{"id":"10.13039\/501100002661","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["onlinelibrary.wiley.com"],"crossmark-restriction":true},"short-container-title":["Numerical Linear Algebra App"],"published-print":{"date-parts":[[2021,10]]},"abstract":"Abstract<\/jats:title>This paper is concerned with improving the empirical convergence speed of block\u2010coordinate descent algorithms for approximate nonnegative tensor factorization (NTF). We propose an extrapolation strategy in\u2010between block updates, referred to as heuristic extrapolation with restarts (HER). HER significantly accelerates the empirical convergence speed of most existing block\u2010coordinate algorithms for NTF, in particular for challenging computational scenarios, while requiring a negligible additional computational budget.<\/jats:p>","DOI":"10.1002\/nla.2373","type":"journal-article","created":{"date-parts":[[2021,3,16]],"date-time":"2021-03-16T11:41:13Z","timestamp":1615894873000},"update-policy":"http:\/\/dx.doi.org\/10.1002\/crossmark_policy","source":"Crossref","is-referenced-by-count":4,"title":["Accelerating block coordinate descent for nonnegative tensor factorization"],"prefix":"10.1002","volume":"28","author":[{"ORCID":"http:\/\/orcid.org\/0000-0002-8330-758X","authenticated-orcid":false,"given":"Andersen","family":"Man Shun Ang","sequence":"first","affiliation":[{"name":"Department of Mathematics and Operational Research, Facult\u00e9 Polytechnique Universit\u00e9 de Mons Mons Belgium"}]},{"given":"Jeremy E.","family":"Cohen","sequence":"additional","affiliation":[{"name":"INRIA CNRS Rennes France"}]},{"ORCID":"http:\/\/orcid.org\/0000-0001-6423-6897","authenticated-orcid":false,"given":"Nicolas","family":"Gillis","sequence":"additional","affiliation":[{"name":"Department of Mathematics and Operational Research, Facult\u00e9 Polytechnique Universit\u00e9 de Mons Mons Belgium"}]},{"given":"Le","family":"Thi Khanh Hien","sequence":"additional","affiliation":[{"name":"Department of Mathematics and Operational Research, Facult\u00e9 Polytechnique Universit\u00e9 de Mons Mons Belgium"}]}],"member":"311","published-online":{"date-parts":[[2021,3,16]]},"reference":[{"key":"e_1_2_10_2_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.laa.2011.05.008"},{"key":"e_1_2_10_3_1","doi-asserted-by":"publisher","DOI":"10.1137\/110829180"},{"key":"e_1_2_10_4_1","doi-asserted-by":"publisher","DOI":"10.1007\/BF02310791"},{"issue":"16","key":"e_1_2_10_5_1","first-page":"1","article-title":"Foundations of the PARAFAC procedure: model and conditions for an \u201cexplanatory\u201d multi\u2010mode factor analysis","volume":"11","author":"Harshman RA","year":"1970","journal-title":"UCLA Work Pap Phon"},{"key":"e_1_2_10_6_1","doi-asserted-by":"publisher","DOI":"10.1002\/1099-128X(200005\/06)14:3<105::AID-CEM582>3.0.CO;2-I"},{"key":"e_1_2_10_7_1","doi-asserted-by":"publisher","DOI":"10.1137\/070709967"},{"key":"e_1_2_10_8_1","doi-asserted-by":"publisher","DOI":"10.1002\/cem.1244"},{"key":"e_1_2_10_9_1","doi-asserted-by":"publisher","DOI":"10.1109\/TIT.2016.2532906"},{"key":"e_1_2_10_10_1","volume-title":"Multi\u2010way analysis in the food industry: models, algorithms, and applications","author":"Bro R","year":"1998"},{"key":"e_1_2_10_11_1","doi-asserted-by":"publisher","DOI":"10.1002\/nla.2297"},{"key":"e_1_2_10_12_1","doi-asserted-by":"publisher","DOI":"10.1162\/neco_a_01157"},{"key":"e_1_2_10_13_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10107-015-0871-8"},{"issue":"1","key":"e_1_2_10_14_1","first-page":"5312","article-title":"A differential equation for modeling Nesterov's accelerated gradient method: theory and insights","volume":"17","author":"Su W","year":"2016","journal-title":"J Mach Learn Res"},{"key":"e_1_2_10_15_1","doi-asserted-by":"publisher","DOI":"10.1109\/TSP.2017.2777399"},{"key":"e_1_2_10_16_1","doi-asserted-by":"publisher","DOI":"10.1002\/sapm192761164"},{"key":"e_1_2_10_17_1","doi-asserted-by":"publisher","DOI":"10.1002\/sapm19287139"},{"key":"e_1_2_10_18_1","doi-asserted-by":"publisher","DOI":"10.1007\/BF02288739"},{"key":"e_1_2_10_19_1","doi-asserted-by":"publisher","DOI":"10.1037\/h0054245"},{"key":"e_1_2_10_20_1","first-page":"110","volume-title":"Contributions to mathematical psychology","author":"Tucker LR","year":"1964"},{"key":"e_1_2_10_21_1","doi-asserted-by":"publisher","DOI":"10.1007\/BF02289464"},{"key":"e_1_2_10_22_1","doi-asserted-by":"publisher","DOI":"10.1002\/0470012110"},{"key":"e_1_2_10_23_1","unstructured":"De LathauwerL De MoorB. From matrix to tensor: multilinear algebra and signal processing. Proceedings of the Digest of the 4th IMA International Conference on Mathematics in Signal Process. University of Warwick Coventry England;1996. p. 1\u201311."},{"key":"e_1_2_10_24_1","doi-asserted-by":"publisher","DOI":"10.1109\/MSP.2013.2297439"},{"key":"e_1_2_10_25_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-1-84800-046-9_8"},{"key":"e_1_2_10_26_1","doi-asserted-by":"publisher","DOI":"10.1002\/widm.1"},{"key":"e_1_2_10_27_1","doi-asserted-by":"publisher","DOI":"10.1137\/07070111X"},{"key":"e_1_2_10_28_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10898-013-0035-4"},{"key":"e_1_2_10_29_1","doi-asserted-by":"publisher","DOI":"10.1002\/9780470238004"},{"issue":"1","key":"e_1_2_10_30_1","first-page":"2773","article-title":"Tensor decompositions for learning latent variable models","volume":"15","author":"Anandkumar A","year":"2014","journal-title":"J Mach Learn Res"},{"key":"e_1_2_10_31_1","doi-asserted-by":"publisher","DOI":"10.1109\/TSP.2017.2690524"},{"key":"e_1_2_10_32_1","doi-asserted-by":"publisher","DOI":"10.1137\/S0895479896305696"},{"key":"e_1_2_10_33_1","doi-asserted-by":"publisher","DOI":"10.1137\/090752286"},{"key":"e_1_2_10_34_1","doi-asserted-by":"publisher","DOI":"10.1002\/env.3170050203"},{"key":"e_1_2_10_35_1","doi-asserted-by":"publisher","DOI":"10.1038\/44565"},{"key":"e_1_2_10_36_1","doi-asserted-by":"publisher","DOI":"10.1002\/9780470747278"},{"key":"e_1_2_10_37_1","series-title":"Machine Learning and Pattern Recognition Series","first-page":"257","volume-title":"Regularization, optimization, kernels, and support vector machines","author":"Gillis N","year":"2014"},{"key":"e_1_2_10_38_1","doi-asserted-by":"publisher","DOI":"10.1109\/MSP.2018.2877582"},{"key":"e_1_2_10_39_1","first-page":"1","volume-title":"SIGGRAPH '12: ACM SIGGRAPH 2012 Emerging Technologies","author":"Wetzstein G","year":"2012"},{"key":"e_1_2_10_40_1","first-page":"463","volume-title":"Multiway data analysis","author":"Carroll JD","year":"1989"},{"key":"e_1_2_10_41_1","doi-asserted-by":"crossref","unstructured":"ShashuaA HazanT. Non\u2010negative tensor factorization with applications to statistics and computer vision. Proceedings of the 22nd International Conference on Machine Learning. Bonn Germany;2005. p. 792\u2013799.","DOI":"10.1145\/1102351.1102451"},{"key":"e_1_2_10_42_1","doi-asserted-by":"crossref","unstructured":"FitzgeraldD CranitchM CoyleE. Non\u2010negative tensor factorisation for sound source separation. Proceedings of the IET Conference. Dublin Ireland; January2005. p. 8\u201312.","DOI":"10.1049\/cp:20050279"},{"key":"e_1_2_10_43_1","doi-asserted-by":"publisher","DOI":"10.1016\/S0167-8655(01)00070-8"},{"key":"e_1_2_10_44_1","doi-asserted-by":"publisher","DOI":"10.1137\/110859063"},{"key":"e_1_2_10_45_1","doi-asserted-by":"publisher","DOI":"10.1002\/(SICI)1099-128X(199709\/10)11:5<393::AID-CEM483>3.0.CO;2-L"},{"key":"e_1_2_10_46_1","doi-asserted-by":"publisher","DOI":"10.1080\/10556780801996244"},{"key":"e_1_2_10_47_1","unstructured":"HazanT PolakS ShashuaA. Sparse image coding using a 3D non\u2010negative tensor factorization. Proceedings of the 10th IEEE International Conference on Computer Vision (ICCV'05). Beijing China; vol. 12005. p. 50\u201057."},{"key":"e_1_2_10_48_1","doi-asserted-by":"publisher","DOI":"10.1109\/TCS.1978.1084534"},{"key":"e_1_2_10_49_1","unstructured":"CohenJE. About notations in multiway array processing;2015. arXiv preprint."},{"key":"e_1_2_10_50_1","doi-asserted-by":"publisher","DOI":"10.1137\/S089547980139786X"},{"key":"e_1_2_10_51_1","doi-asserted-by":"crossref","unstructured":"LucianiX AlberaL. Semi\u2010algebraic canonical decomposition of multi\u2010way arrays and joint eigenvalue decomposition. Processing of the 2011 IEEE International Conference on Acoustics Speech and Signal (ICASSP). IEEE;2011. p. 4104\u20134107.","DOI":"10.1109\/ICASSP.2011.5947255"},{"key":"e_1_2_10_52_1","doi-asserted-by":"publisher","DOI":"10.1137\/130916084"},{"key":"e_1_2_10_53_1","doi-asserted-by":"publisher","DOI":"10.1137\/18M1200531"},{"key":"e_1_2_10_54_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.laa.2017.08.014"},{"key":"e_1_2_10_55_1","doi-asserted-by":"publisher","DOI":"10.1137\/06066518X"},{"key":"e_1_2_10_56_1","doi-asserted-by":"publisher","DOI":"10.1016\/S0169-7439(97)00031-2"},{"key":"e_1_2_10_57_1","volume-title":"Compressed sensing approaches to large\u2010scale tensor decompositions","author":"Vervliet N","year":"2018"},{"key":"e_1_2_10_58_1","doi-asserted-by":"publisher","DOI":"10.1002\/cem.1335"},{"key":"e_1_2_10_59_1","doi-asserted-by":"publisher","DOI":"10.1109\/TSP.2016.2576427"},{"key":"e_1_2_10_60_1","unstructured":"RoyerJP Thirion\u2010MoreauN ComonP. Nonnegative 3\u2010way tensor factorization taking in to account possible missing data. Proceedings of the 2012 20th European Signal Processing Conference (EUSIPCO). Bucharest Romania: IEEE;2012. p. 71\u201375."},{"key":"e_1_2_10_61_1","doi-asserted-by":"publisher","DOI":"10.1137\/120887795"},{"key":"e_1_2_10_62_1","unstructured":"HienLTK GillisN PatrinosP.Inertial block proximal method for non\u2010convex non\u2010smooth optimization. Proceedings of the 37th International Conference on Machine Learning (ICML);2020. p. 1\u201311."},{"key":"e_1_2_10_63_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.neucom.2015.08.122"},{"key":"e_1_2_10_64_1","doi-asserted-by":"publisher","DOI":"10.1109\/TSP.2012.2190406"},{"key":"e_1_2_10_65_1","doi-asserted-by":"publisher","DOI":"10.1162\/NECO_a_00256"},{"key":"e_1_2_10_66_1","doi-asserted-by":"publisher","DOI":"10.1137\/120891009"},{"key":"e_1_2_10_67_1","unstructured":"AngAMS CohenJE GillisN Khanh HienLT. Accelerating block coordinate descent for nonnegative tensor factorization;2020. arXiv e\u2010prints. arXiv:2001.04321."},{"key":"e_1_2_10_68_1","doi-asserted-by":"crossref","unstructured":"RavindranN SidiropoulosND SmithS KarypisG. Memory\u2010efficient parallel computation of tensor and matrix products for big tensor decomposition. Proceedings of the 2014 48th Asilomar Conference on Signals Systems and Computers. California CA: IEEE;2014. p. 581\u2010585.","DOI":"10.1109\/ACSSC.2014.7094512"},{"key":"e_1_2_10_69_1","doi-asserted-by":"crossref","unstructured":"BallardG HayashiK RamakrishnanK. Parallel nonnegative cp decomposition of dense tensors. Proceedings of the 2018 IEEE 25th International Conference on High Performance Computing (HiPC). Bengaluru India;2018. p. 22\u201031.","DOI":"10.1109\/HiPC.2018.00012"},{"key":"e_1_2_10_70_1","doi-asserted-by":"publisher","DOI":"10.1137\/17M1152371"},{"key":"e_1_2_10_71_1","doi-asserted-by":"publisher","DOI":"10.1137\/17M1112303"},{"key":"e_1_2_10_72_1","doi-asserted-by":"publisher","DOI":"10.1137\/17M112213X"},{"key":"e_1_2_10_73_1","unstructured":"AngA CohenJ GillisN.Accelerating approximate nonnegative canonical polyadic decomposition using extrapolation. Proceedings of the GRETSI 2019 \u2010 XXVII\u00e9me Colloque francophone de traitement du signal et des images. Lille France: Gretsi;2019. p. 1\u20134."},{"key":"e_1_2_10_74_1","doi-asserted-by":"crossref","unstructured":"SmithS KarypisG. Tensor\u2010matrix products with a compressed sparse tensor. Proceedings of the 5th Workshop on Irregular Applications: Architectures and Algorithms. Austin TX;2015. p. 1\u20137.","DOI":"10.1145\/2833179.2833183"},{"key":"e_1_2_10_75_1","doi-asserted-by":"crossref","unstructured":"MahadevanV LiW BhalodiaV VasconcelosN. Anomaly detection in crowded scenes. Proceedings of the 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. San Francisco CA: IEEE;2010. p. 1975\u20131981.","DOI":"10.1109\/CVPR.2010.5539872"},{"key":"e_1_2_10_76_1","doi-asserted-by":"publisher","DOI":"10.1137\/060676489"}],"container-title":["Numerical Linear Algebra with Applications"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/onlinelibrary.wiley.com\/doi\/pdf\/10.1002\/nla.2373","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/onlinelibrary.wiley.com\/doi\/full-xml\/10.1002\/nla.2373","content-type":"application\/xml","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/onlinelibrary.wiley.com\/doi\/pdf\/10.1002\/nla.2373","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,8,29]],"date-time":"2023-08-29T21:56:44Z","timestamp":1693346204000},"score":1,"resource":{"primary":{"URL":"https:\/\/onlinelibrary.wiley.com\/doi\/10.1002\/nla.2373"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,3,16]]},"references-count":75,"journal-issue":{"issue":"5","published-print":{"date-parts":[[2021,10]]}},"alternative-id":["10.1002\/nla.2373"],"URL":"https:\/\/doi.org\/10.1002\/nla.2373","archive":["Portico"],"relation":{},"ISSN":["1070-5325","1099-1506"],"issn-type":[{"value":"1070-5325","type":"print"},{"value":"1099-1506","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,3,16]]},"assertion":[{"value":"2020-01-16","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2021-02-23","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2021-03-16","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}