An orthogonal series estimate of time-varying regression
type: Item
instance of: scholarly article
title: An orthogonal series estimate of time-varying regression
zbMATH Open document ID: 0536.62072
author: Włodzimierz Greblicki
author: Danuta Rutkowska
author: Leszek Rutkowski
published in: Annals of the Institute of Statistical Mathematics
publication date: 1983-01-01T00:00:00Z
review text: Let \((X_ 1,Y_ 1)\), \((X_ 2,Y_ 2),..\). be independent pairs of random variables with \(X_ i\in {\mathcal X}\subset {\mathbb{R}}^ p\), \(Y_ i\in {\mathbb{R}}^ 1\) and (1) a nonstationary regression function \(R_ n(x):=E[Y_ n| X_ n=x]=t_ n(x)\cdot R(x)\) where \(R,t_ n\) are unknown, but \(\sup_ x| t_ n(x)-c_ n| \to 0\) for some real sequence \(\{c_ n\}\); (2) \(Y_ n=t_ n(X_ n)R(X_ n)+Z_ n\) with centered i.i.d. variables \(Z_ n\); and (3) the marginal density \(f(\cdot)\) of \(X_ n\) being independent of n. Consider a complete orthogonal system \(\{g_ i(\cdot)\}\) of \(L_ 2({\mathcal X})\). The unknown Fourier coefficients \(b_ i=E[g_ i(X_ i)]\), \(a_{in}=E[Y_ ng_ i(X_ n)]\) of f(x) resp. \(h_ n(x):=R_ n(x)f(x)\) are estimated by \[ \hat b_{in}:=(g_ i(X_ 1)+...+g_ i(X_ n))/n\quad resp.\quad \hat a_{i,n+1}:=\hat a_{in}-\gamma_ n(a_{in}-Y_{n+1}g_ i(X_{n+1})) \] (Robbins-Monro; \(\gamma_ n>0)\). Thus, \(\hat f{}_ n(x):=\sum^{M(n)}_{0}\hat b_{in}g_ i(x)\), \(\hat h{}_ n(x):=\sum^{N(n)}_{0}\hat a_{in}g_ i(x)\) are orthogonal series estimates for f resp. \(h_ n.\) In the paper it is shown that (under suitable conditions for \(\gamma_ n,c_ n,N(n)\), etc.) \(\hat R_ n(x):=\hat h_ n(x)/\hat f_ n(x)\) is a consistent (nonparametric) estimate for \(R_ n: | \hat R_ n(x)- R_ n(x)| \to 0\) for \(f(x)>0\) and \(n\to \infty\) (in probability and a.s.). This result applies even to cases like \(t_ n(x)=(1+\rho(x)/n)n^ q\) with \(\sup | \rho(x)|<\infty\) and \(q>0\), where \(t_ n\) is unbounded for \(n\to \infty\) (use \(c_ n=n^ q\), \(\gamma_ n=\delta_ n^{-2/3}\), \(N(n)\sim n^{\alpha})\). As an example, Hermite and Legendre systems are considered.
Mathematics Subject Classification ID: 62M10
Mathematics Subject Classification ID: 62G05
Mathematics Subject Classification ID: 62J07
Mathematics Subject Classification ID: 42C10
zbMATH DE Number: 3852258
zbMATH Keywords: asymptotic properties
zbMATH Keywords: Robbins-Monro approximation
zbMATH Keywords: consistency
zbMATH Keywords: Hermite polynomials
zbMATH Keywords: nonstationary regression function
zbMATH Keywords: unknown Fourier coefficients
zbMATH Keywords: orthogonal series estimates
zbMATH Keywords: Legendre systems
reviewed by: H.-H. Bock
MaRDI profile type: Publication
cites work: Q5576619
cites work: Q5342817
cites work: On a Stochastic Approximation Method
cites work: Q4153934
cites work: The uniform convergence of nearest neighbor regression function estimators and their application in optimization
cites work: On the L 1 convergence of kernel estimators of regression functions with applications in discrimination
cites work: Q5822308
cites work: A Dynamic Stochastic Approximation Method
cites work: Asymptotic properties of kernel estimates of a regression function
cites work: The Estimation of Probability Densities and Cumulatives by Fourier Series Methods
cites work: Q5509408
cites work: Estimation of a regression function by the parzen kernel-type density estimators
cites work: Q3253942
cites work: Estimation of Probability Density by an Orthogonal Series
cites work: Consistent nonparametric regression. Discussion
cites work: Q3264312
cites work: On Strong Consistency of Density Estimates
cites work: Q4045476
description: scientific article; zbMATH DE number 3852258