Data reduction via adaptive sampling.
type: Item
instance of: scholarly article
title: Data reduction via adaptive sampling.
zbMATH Open document ID: 1082.68561
published in: Communications in Information and Systems
publication date: 2004-03-22T00:00:00Z
review text: Data reduction is an important issue in the field of data mining. This article describes a new method for selecting a subset of data from a large dataset. A simplified chi-square criterion is proposed for measuring the goodness-of-fit between the distributions of the reduced and full data sets. Under this criterion, the data reduction problem can be formulated as a binary quadratic program and a tabu search technique is used in the search/optimization process. The procedure is adaptive in that it involves not only random sampling but also deterministic search guided by the results of the previous search steps. The method is applicable primarily to discrete data, but can be extended to continuous data as well. An experimental study that compares the proposed method with simple random sampling on a number of simulated and real world datasets has been conducted. The results of the study indicate that the distributions of the samples produced by the proposed method are significantly closer to the true distribution than those of random samples.
Mathematics Subject Classification ID: 68P15
Mathematics Subject Classification ID: 90C20
Mathematics Subject Classification ID: 68P10
Mathematics Subject Classification ID: 68T20
zbMATH DE Number: 2032469
author: Xiaobai Li
MaRDI profile type: Publication
full work available at URL: cis.2002.v2.n1.a3
OpenAlex ID: W2011631883
DOI: 10.4310/CIS.2002.V2.N1.A3
description: scientific article; zbMATH DE number 2032469