Choosing the Metric in High-Dimensional Spaces Based on Hub Analysis
Dominik Schnitzer, Arthur Flexer · The European Symposium on Artificial Neural Networks · 2014
To avoid the undesired effects of distance concentration in high-dimensional spaces, previous work has already advocated the use of fractional p norms instead of the ubiquitous Euclidean norm. Closely re- lated to concentration is the emergence of hub and anti-hub objects. Hub objects have a small distance to an exceptionally large number of data points while anti-hubs lie far from all other data points. The contribution of this work is an empirical examination of concentration and hubness, re- sulting in an unsupervised approach for choosing an p norm by minimizing hubs while simultaneously maximizing nearest neighbor classification.