Classification and multivariate class prediction problems arise in many scientific disciplines often relying on large data sets in the form of sample vectors of high dimension. In order to reduce dimensionality and effectively treat the problem, we may try to pre-process data and extract a minimum subset of feature variables that is sufficient for items identification, a problem addressed in literature as Minimum Test Set and known to be NP-hard by a reduction to Set Cover. We use a procedure based on computing mutual information between sets of symbolic feature variables and we present results obtained by applying the procedure over a previously discretised data set from integrated circuit industry collecting wafer data by sampling chips over a large number of real valued attribute variables (typically about a thousand). The experimentation gives evidence that the procedure effectively and feasibly yields a small number of features that provide sufficient information for chip failure prediction.

Feature Selection in High Dimension Sample Spaces

CAIANIELLO, Pasquale;COSTANTINI, STEFANIA
2013-01-01

Abstract

Classification and multivariate class prediction problems arise in many scientific disciplines often relying on large data sets in the form of sample vectors of high dimension. In order to reduce dimensionality and effectively treat the problem, we may try to pre-process data and extract a minimum subset of feature variables that is sufficient for items identification, a problem addressed in literature as Minimum Test Set and known to be NP-hard by a reduction to Set Cover. We use a procedure based on computing mutual information between sets of symbolic feature variables and we present results obtained by applying the procedure over a previously discretised data set from integrated circuit industry collecting wafer data by sampling chips over a large number of real valued attribute variables (typically about a thousand). The experimentation gives evidence that the procedure effectively and feasibly yields a small number of features that provide sufficient information for chip failure prediction.
File in questo prodotto:
Non ci sono file associati a questo prodotto.
Pubblicazioni consigliate

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/11697/42100
Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus ND
  • ???jsp.display-item.citation.isi??? ND
social impact