TY - GEN

T1 - Metric learning by collapsing classes

AU - Globerson, Amir

AU - Roweis, Sam

PY - 2005

Y1 - 2005

N2 - We present an algorithm for learning a quadratic Gaussian metric (Mahalanobis distance) for use in classification tasks. Our method relies on the simple geometric intuition that a good metric is one under which points in the same class are simultaneously near each other and far from points in the other classes. We construct a convex optimization problem whose solution generates such a metric by trying to collapse all examples in the same class to a single point and push examples in other classes infinitely far away. We show that when the metric we learn is used in simple classifiers, it yields substantial improvements over standard alternatives on a variety of problems. We also discuss how the learned metric may be used to obtain a compact low dimensional feature representation of the original input space, allowing more efficient classification with very little reduction in performance.

AB - We present an algorithm for learning a quadratic Gaussian metric (Mahalanobis distance) for use in classification tasks. Our method relies on the simple geometric intuition that a good metric is one under which points in the same class are simultaneously near each other and far from points in the other classes. We construct a convex optimization problem whose solution generates such a metric by trying to collapse all examples in the same class to a single point and push examples in other classes infinitely far away. We show that when the metric we learn is used in simple classifiers, it yields substantial improvements over standard alternatives on a variety of problems. We also discuss how the learned metric may be used to obtain a compact low dimensional feature representation of the original input space, allowing more efficient classification with very little reduction in performance.

UR - http://www.scopus.com/inward/record.url?scp=84864030708&partnerID=8YFLogxK

M3 - ???researchoutput.researchoutputtypes.contributiontobookanthology.conference???

AN - SCOPUS:84864030708

SN - 9780262232531

T3 - Advances in Neural Information Processing Systems

SP - 451

EP - 458

BT - Advances in Neural Information Processing Systems 18 - Proceedings of the 2005 Conference

T2 - 2005 Annual Conference on Neural Information Processing Systems, NIPS 2005

Y2 - 5 December 2005 through 8 December 2005

ER -