Constrained Independence for Detecting Interesting Patterns

Research output: Contributions to collected editions/worksArticle in conference proceedingsResearchpeer-review

Authors

Among other criteria, a pattern may be interesting if it is not redundant with other discovered patterns. A general approach to determining redundancy is to consider a probabilistic model for frequencies of patterns, based on those of patterns already mined, and compare observed frequencies to the model. Such probabilistic models include the independence model, partition models or more complex models which are approached via randomization for a lack of an adequate tool in probability theory allowing a direct approach. We define constrained independence, a generalization to the notion of independence. This tool allows us to describe probabilistic models for evaluating redundancy in frequent itemset mining. We provide algorithms, integrated within the mining process, for determining non-redundant itemsets. Through experimentations, we show that the models used reveal high rates of redundancy among frequent itemsets and we extract the most interesting ones.

Original languageEnglish
Title of host publication2015 IEEE International Conference on Data Science and Advanced Analytics (DSAA)
EditorsGabriella Pasi, James Kwok, Osmar Zaiane, Patrick Gallinari, Eric Gaussier, Longbing Cao
Number of pages10
PublisherIEEE - Institute of Electrical and Electronics Engineers Inc.
Publication date02.12.2015
Article number7344897
ISBN (electronic)978-1-4673-8272-4
DOIs
Publication statusPublished - 02.12.2015
EventIEEE International Conference on Data Science and Advanced Analytics - DSAA 2015 - Paris, France
Duration: 19.10.201521.10.2015
http://dsaa2015.lip6.fr/