TopPI: An efficient algorithm for item-centric mining

Abstract : In this paper, we introduce item-centric mining, a new semantics for mining long-tailed datasets. Our algorithm, TopPI, finds for each item its top-k most frequent closed itemsets. While most mining algorithms focus on the globally most frequent itemsets, TopPI guarantees that each item is represented in the results, regardless of its frequency in the database. TopPI allows users to efficiently explore Web data, answering questions such as " what are the k most common sets of songs downloaded together with the ones of my favorite artist? ". When processing retail data consisting of 55 million supermarket receipts, TopPI finds the itemset " milk, puff pastry " that appears 10,315 times, but also " frangipane, puff pastry " and " nori seaweed, wasabi, sushi rice " that occur only 1120 and 163 times, respectively. Our experiments with analysts from the marketing department of our retail partner, demonstrate that item-centric mining discover valuable itemsets. We also show that TopPI can serve as a building-block to approximate complex itemset ranking measures such as the p-value. Thanks to efficient enumeration and pruning strategies, TopPI avoids the search space explosion induced by mining low support itemsets. We show how TopPI can be parallelized on multi-cores and distributed on Hadoop clusters. Our experiments on datasets with different characteristics show the superiority of TopPI when compared to standard top-k solutions, and to Parallel FP-Growth, its closest competitor.
Liste complète des métadonnées

Littérature citée [23 références]  Voir  Masquer  Télécharger

https://hal.archives-ouvertes.fr/hal-01479067
Contributeur : Vincent Leroy <>
Soumis le : mardi 28 février 2017 - 16:01:43
Dernière modification le : mardi 21 novembre 2017 - 15:23:53
Document(s) archivé(s) le : lundi 29 mai 2017 - 15:40:07

Fichier

toppi (1).pdf
Fichiers produits par l'(les) auteur(s)

Identifiants

Citation

Vincent Leroy, Martin Kirchgessner, Alexandre Termier, Sihem Amer-Yahia. TopPI: An efficient algorithm for item-centric mining. Information Systems, Elsevier, 2017, 64, pp.104 - 118. 〈10.1016/j.is.2016.09.001〉. 〈hal-01479067〉

Partager

Métriques

Consultations de la notice

549

Téléchargements de fichiers

169