New and efficient algorithms for producing frequent itemsets with the Map-Reduce framework
type: Item
instance of: scholarly article
title: New and efficient algorithms for producing frequent itemsets with the Map-Reduce framework
zbMATH Open document ID: 1461.68209
author: Yaron Gonen
author: Ehud Gudes
author: Kirill Kandalov
published in: Algorithms
publication date: 2019-01-21T00:00:00Z
review text: Summary: The Map-Reduce (MR) framework has become a popular framework for developing new parallel algorithms for Big Data. Efficient algorithms for data mining of big data and distributed databases has become an important problem. In this paper we focus on algorithms producing association rules and frequent itemsets. After reviewing the most recent algorithms that perform this task within the MR framework, we present two new algorithms: one algorithm for producing closed frequent itemsets, and the second one for producing frequent itemsets when the database is updated and new data is added to the old database. Both algorithms include novel optimizations which are suitable to the MR framework, as well as to other parallel architectures. A detailed experimental evaluation shows the effectiveness and advantages of the algorithms over existing methods when it comes to large distributed databases.
Mathematics Subject Classification ID: 68T09
Mathematics Subject Classification ID: 68W10
Mathematics Subject Classification ID: 68W15
zbMATH DE Number: 7003845
zbMATH Keywords: apriori
zbMATH Keywords: MapReduce
zbMATH Keywords: big data
zbMATH Keywords: frequent itemsets
zbMATH Keywords: closed itemsets
zbMATH Keywords: incremental computation
describes a project that uses: MapReduce
describes a project that uses: Twister
describes a project that uses: AFOPT
describes a project that uses: Hadoop
MaRDI profile type: Publication
full work available at URL: https://doi.org/10.3390/a11120194
OpenAlex ID: W2902983346
cites work: Q2767121
cites work: Distributed Computing - IWDC 2004
Wikidata QID: Q128896495
DOI: 10.3390/A11120194
description: scientific article; zbMATH DE number 7003845