A strong law of large numbers for nonparametric regression
type: Item
instance of: scholarly article
title: A strong law of large numbers for nonparametric regression
zbMATH Open document ID: 0675.62030
DOI: 10.1016/0047-259X(89)90085-7
author: Hari Mukerjee
published in: Journal of Multivariate Analysis
publication date: 1989-01-01T00:00:00Z
review text: Suppose \((X_ 1,Y_ 1),...,(X_ n,Y_ n)\) are i.i.d. \(R^ d\times R\)-valued random variables with finite conditional means \(m(x)=E[Y_ 1| X_ 1=x]\). Let \(\| \cdot \|\) denote the norm in \(R^ d\). For fixed \(x_ 0\in R^ d\) and for each \(n\geq 1\) let \(\{X_{1n},...,X_{nn}\}\) denote the order statistics of \(\{X_ 1,...,X_ n\}\), ordered by the distances \(\{\| x_ 0-X_ i\| \}\). Let \(\{Y_{1n},...,Y_{nn}\}\) denote the corresponding induced order statistics of \(\{Y_ 1,...,Y_ n\}\) and let \(S_{jn}=\sum^{j}_{i=1}Y_{in}\), \(1\leq j\leq n.\) Under the finite first moment condition for \(Y_ 1-m(X_ 1)\) given \(X_ 1=x\) for all x in some neighborhood of \(x_ 0\) and the smoothness condition of m(x), the author proves the strong law of large numbers for the nonparametric regression estimators of \(m(x_ 0)\) of the form \(m_ n(x_ 0)=S_{k_ nn}/k_ n\) where \(\{k_ n\}\) is a sequence of positive integers with \(k_ n\to \infty\) and \(k_ n/n\to 0.\) He applies these results to the k-nearest neighbor procedure and the moving window or uniform kernel procedure. Reviewer's comments: \(U_{n^ 2}=\sum^{n}_{i=n^ 2-n+1}Z_{in}/n\) [line 5 from bottom on p. 18] should be read as \(U_{n^ 2}=\sum^{n^ 2}_{i=n^ 2-n+1}Z_{in^ 2}/n\), \(m_ n(x_ 0)\to E m_ n(x_ 0)\quad a.s.\) Theorems 3.1, 3.3, and 4.3 should be read as \(m_ n(x_ 0)-E m_ n(x_ 0)\to 0\) a.s.
reviewed by: H.Takahata
Mathematics Subject Classification ID: 62G05
Mathematics Subject Classification ID: 60F15
zbMATH DE Number: 4106051
zbMATH Keywords: finite conditional means
zbMATH Keywords: order statistics
zbMATH Keywords: finite first moment condition
zbMATH Keywords: smoothness condition
zbMATH Keywords: strong law of large numbers
zbMATH Keywords: nonparametric regression estimators
zbMATH Keywords: k-nearest neighbor procedure
zbMATH Keywords: moving window
zbMATH Keywords: uniform kernel procedure
MaRDI profile type: Publication
cites work: On the Estimation of Parameters Restricted by Inequalities
cites work: The strong law of large numbers
cites work: Strong consistency of nearest neighbor regression function estimators
cites work: The uniform convergence of nearest neighbor regression function estimators and their application in optimization
cites work: Necessary and sufficient conditions for the pointwise convergence of nearest neighbor regression function estimates
cites work: Q3868610
cites work: On a Theorem of Hsu and Robbins
cites work: On consistency in monotonic regression
cites work: Complete Convergence and the Law of Large Numbers
cites work: Q4131338
cites work: Weak and strong uniform consistency of kernel regression estimates
cites work: Strong Consistency of a Nonparametric Estimate of a Density Function
description: scientific article; zbMATH DE number 4106051