A new evolutionary algorithm for mining top-k discriminative patterns in high dimensional data |
| |
Affiliation: | 1. Informatics Center, Federal University of Pernambuco, Recife, Brazil;2. Department of Electrical Engineering, University of Brasília, Brazil;3. Department of Electronics and Systems, Federal University of Pernambuco, Recife, Brazil |
| |
Abstract: | This paper presents an evolutionary algorithm for Discriminative Pattern (DP) mining that focuses on high dimensional data sets. DPs aims to identify the sets of characteristics that better differentiate a target group from the others (e.g. successful vs. unsuccessful medical treatments). It becomes more natural to extract information from high dimensionality data sets with the increase in the volume of data stored in the world (30 GB/s only in the Internet). There are several evolutionary approaches for DP mining, but none focusing on high-dimensional data. We propose an evolutionary approach attributing features that reduce the cost of memory and processing in the context of high-dimensional data. The new algorithm thus seeks the best (top-k) patterns and hides from the user many common parameters in other evolutionary heuristics such as population size, mutation and crossover rates, and the number of evaluations. We carried out experiments with real-world high-dimensional and traditional low dimensional data. The results showed that the proposed algorithm was superior to other approaches of the literature in high-dimensional data sets and competitive in the traditional data sets. |
| |
Keywords: | Subgroup discovery Evolutionary algorithms Discriminative patterns High dimensional data |
本文献已被 ScienceDirect 等数据库收录! |
|