The development and convergence analysis of a quasi-Newton method for the solution of systems of nonlinear underdetermined equations is investigated. These equations arise in many application fields, e.g., supervised learning of large overparameterised neural networks, which require the...

Consider a stochastic system of such complexity that its performance can only be evaluated by using simulation or direct experimentation. To optimize the expected performance of such systems as a function of several continuous input parameters (decision variables), we present a "scaled"...