Abstract
A novel nonlinear Kaczmarz method is proposed for solving large-scale nonlinear problems, which adaptively uses residual to combine the Jacobian submatrix and projects onto the weighted hyperplane. The convergence theory of the new method is proved, and the upper bound of the convergence rate is well studied. Numerical experiments are given to demonstrate that the proposed method is efficient and better than the existing methods in terms of the number of iterations and CPU time.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
Data availability
No data was used for the research described in the article.
References
Bai Z-Z, Wu W-T (2018) On greedy randomized Kaczmarz method for solving large sparse linear systems. SIAM J Sci Comput 40(1):A592–A606
Chen J-Q, Huang Z-D (2022) On a fast deterministic block Kaczmarz method for solving large-scale linear systems. Numer Algorithms 89(3):1007–1029
Chen Q-P, Hao W-R (2019) A homotopy training algorithm for fully connected neural networks. Proc R Soc A 475(2231):20190662
Hao W-R (2018) A homotopy method for parameter estimation of nonlinear differential equations with multiple optima. J Sci Comput 74:1314–1324
Kaltenbacher B, Neubauer A, Scherzer O (2008) Iterative regularization methods for nonlinear ill-posed problems. In: Iterative regularization methods for nonlinear ill-posed problems. de Gruyter
Lukšan L (1993) Inexact trust region method for large sparse nonlinear least squares. Kybernetika 29(4):305–324
Moré JJ, Garbow BS, Hillstrom KE (1981) Testing unconstrained optimization software. ACM Trans Math Softw (TOMS) 7(1):17–41
Ortega JM, Rheinboldt WC (2000) Iterative solution of nonlinear equations in several variables. SIAM, Philadelphia
Scherzer O, Antonio L, Kowar R, Haltmeier M (2017) Kaczmarz methods for regularizing nonlinear ill-posed equations II: applications. Inverse Problems Imaging 1(3):507–523
Schuster T, Kaltenbacher B, Hofmann B, Kazimierski K-S (2012) Regularization methods in Banach spaces, vol 10. Walter de Gruyter, Berlin
Wang Q-F, Li W-G, Bao W-D, Gao X-Q (2022) Nonlinear Kaczmarz algorithms and their convergence. J Comput Appl Math 399:113720
Xiao A-Q, Yin J-F, Zheng N (2023) On fast greedy block Kaczmarz methods for solving large consistent linear systems. Comput Appl Math 42(3):119
Yuan Y-X (2011) Recent advances in numerical methods for nonlinear equations and nonlinear least squares. Numer Algebra Control Optim 1(1):15–34
Yuan R, Lazaric A, Gower RM (2022) Sketched Newton–Raphson. SIAM J Optim 32(3):1555–1583
Zhang Y-J, Li H-Y (2022) Greedy capped nonlinear Kaczmarz methods. arXiv preprint arXiv:2210.00653
Zhang J-H, Wang Y-Q, Zhao J (2023) On maximum residual nonlinear Kaczmarz-type algorithms for large nonlinear systems of equations. J Comput Appl Math 425:115065
Acknowledgements
The authors are most grateful to anonymous referees for their comments and suggestions, which greatly helped us improve the quality of this paper.
Author information
Authors and Affiliations
Corresponding author
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
This work is subsidized by NSFC (No. 11971354) of China.
Rights and permissions
Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.
About this article
Cite this article
Ye, YX., Yin, JF. A residual-based weighted nonlinear Kaczmarz method for solving nonlinear systems of equations. Comp. Appl. Math. 43, 276 (2024). https://doi.org/10.1007/s40314-024-02797-1
Received:
Revised:
Accepted:
Published:
DOI: https://doi.org/10.1007/s40314-024-02797-1