Subspace Analysis in Multi-Class Datasets: An Application to Novelty Detection Ensembles

Marcelo Bacher, Erez Shmueli, Irad Ben-Gal

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

Abstract

Subspace analysis is a recurring subject in many real-world applications of novelty detection ensembles. Yet, most of proposed works focused on one-class datasets, leaving multiclass datasets for classical tasks of classification with rejection. We propose a novel subspace analysis method for multi-class datasets, named 'Multi-Class Agglomerative Attribute Grouping (MAAG)' to be used in ensembles for novelty detection. The MAAG method aims at achieving a stable set of meaningful subspaces relying on a novel distance metric derived from information theory principles to evaluate the 'information distance' between groups of data attributes. The MAAG combines the proposed distance with a term derived from the chain rule of Mutual Information to generate compact clusters of observations, while maintaining them well separated among the different classes. Therefore, the MAAG aims at facilitating the merging of objectives for classification and novelty detection simultaneously. Our empirical evaluation shows that the proposed MAAG boosts the novelty-detection performance of methods based on ensemble-of-classifiers, and outperforms on average, other state-of-The-Art subspace analysis approaches applied to each individual class in multi-class settings.

Original languageEnglish
Title of host publication2018 IEEE International Conference on the Science of Electrical Engineering in Israel, ICSEE 2018
PublisherInstitute of Electrical and Electronics Engineers Inc.
ISBN (Electronic)9781538663783
DOIs
StatePublished - 2 Jul 2018
Event2018 IEEE International Conference on the Science of Electrical Engineering in Israel, ICSEE 2018 - Eilat, Israel
Duration: 12 Dec 201814 Dec 2018

Publication series

Name2018 IEEE International Conference on the Science of Electrical Engineering in Israel, ICSEE 2018

Conference

Conference2018 IEEE International Conference on the Science of Electrical Engineering in Israel, ICSEE 2018
Country/TerritoryIsrael
CityEilat
Period12/12/1814/12/18

Funding

FundersFunder number
METRO450 Consortium

    Fingerprint

    Dive into the research topics of 'Subspace Analysis in Multi-Class Datasets: An Application to Novelty Detection Ensembles'. Together they form a unique fingerprint.

    Cite this