Data binarization by discriminant elimination
Miguel Moreira, Alain Hertz, Eddy Mayoraz · Infoscience (Ecole Polytechnique Fédérale de Lausanne) · 1999
. This paper is concerned with the problem of constructing a mapping from an arbitrary input space into a binary output space f0; 1g d , based on a given data set X partitioned into classes. The aim is to reduce the total amount of information, while keeping the most relevant of it for the partitioning. An additional constraint to our problem is that the mapping must have a simple interpretation. Thus, each of the d discriminants is related to one original attribute (e.g. linear combinations of original attributes are not admitted). Beyond data compression, the targeted application is a preprocessing for classication techniques that require Boolean input data. While other existing techniques for this problem are constructive (increasing d iteratively, such as decision trees), the method proposed here proceeds by starting with a very large dimension d, and by reducing it iteratively. Acknowledgements: The support of the Swiss National Science Foundation under grant 2000-053902....