Asymptotic linear expansion of regularized M-estimators
From MaRDI portal
Publication:6324538
DOI10.1007/S10463-021-00792-5arXiv1909.00579MaRDI QIDQ6324538
Publication date: 2 September 2019
Abstract: Parametric high-dimensional regression analysis requires the usage of regularization terms to get interpretable models. The respective estimators can be regarded as regularized M-functionals which are naturally highly nonlinear. We study under which conditions these M-functionals are compactly differentiable, so that the corresponding estimators admit an asymptotically linear expansion. In a one-step construction, for a suitably consistent starting estimator, this linearization replaces solving optimization problems by evaluating the corresponding influence curves at the given data points. We show under which conditions the asymptotic linear expansion is valid and provide concrete examples of machine learning algorithms that fit into this framework.
This page was built for publication: Asymptotic linear expansion of regularized M-estimators
