Analysis of search methods of optimization based on potential theory. III: Convergence of methods (Q1922451)

From MaRDI portal





scientific article; zbMATH DE number 922190
Language Label Description Also known as
English
Analysis of search methods of optimization based on potential theory. III: Convergence of methods
scientific article; zbMATH DE number 922190

    Statements

    Analysis of search methods of optimization based on potential theory. III: Convergence of methods (English)
    0 references
    0 references
    0 references
    0 references
    7 January 1997
    0 references
    A deterministic optimization problem of minimizing a nonsmooth multiextremal function \(f:\mathbb{R}^n\to\mathbb{R}\) is considered. Evidently, this problem can be (from the numerical point of view) very complicated. The authors replace the original deterministic problem by a stochastic optimization one of minimizing \(Ef(X)\), where \(X\) is an \(n\)-dimensional random vector; \(E\) denotes the operator of mathematical expectation. Employing a relationship between a potential of the Newtonian vector field (generated by the objective function) and a Lyapunov function, they define the random process at discrete time \(N=1,2,\dots\), \[ X^{N+1}=X^N+ \alpha_NY^{N+1}, \qquad \alpha_N>0 \text{ constant}. \] The aim of the paper is to introduce assumptions under which the random process \(X^N\) converges (in the sense of strong convergence) to a domain of a local extremum of the function \(f(\cdot)\). This third part completes a series of papers [see Zbl 0857.93101 and Zbl 0857.93102] on similar topics. However, while the other papers deal with the problem of leaving the domain \[ D(\varepsilon)=\{x\in\mathbb{R}^n\mid K>\widehat{f}(x)>\varepsilon\} \] (\(K,\varepsilon\) constants, \(+\infty> K>\varepsilon>0\); \(\widehat{f}=f-c_N\), \(c_N\) constant) almost surely in a finite time, this paper goes deeper into the investigation of the approach to the original optimization problem introduced above.
    0 references
    stochastic iteration
    0 references
    stochastic approximation
    0 references
    optimization
    0 references
    Lyapunov function
    0 references

    Identifiers

    0 references
    0 references
    0 references
    0 references
    0 references