The Weight-Shape decomposition of density estimates: A framework for clustering and image analysis algorithms

Lior Deutsch, David Horn

Research output: Contribution to journalArticlepeer-review

Abstract

We propose an analysis scheme which addresses the Parzen-window and mixture model methods for estimating the probability density function of data points in feature space. Both methods construct the estimate as a sum of kernel functions (usually Gaussians). By adding an entropy-like function we prove that the probability distribution is a product of a weight function and a shape distribution. This Weight-Shape decomposition leads to new interpretations of established clustering algorithms. Furthermore, it suggests the construction of three different clustering schemes, which are based on gradient-ascent flow of replica points in feature space. Two of these are Quantum Clustering and the Mean-Shift algorithm. The third algorithm is based on maximal-entropy. In our terminology they become Maximal Shape Clustering, Maximal Probability Clustering and Maximal Weight Clustering, correspondingly. We demonstrate the different methods and compare them to each other on one artificial example and two natural data sets. We also apply the Weight-Shape decomposition to image analysis. The shape distribution acts as an edge detector. It serves to generate contours, as demonstrated on face images. Furthermore, it allows for defining a convolutional Shape Filter.

Original languageEnglish
Pages (from-to)190-199
Number of pages10
JournalPattern Recognition
Volume81
DOIs
StatePublished - Sep 2018

Keywords

  • Density estimate
  • Image contour extraction
  • Maximum entropy
  • Mean-shift clustering
  • Quantum clustering

Fingerprint

Dive into the research topics of 'The Weight-Shape decomposition of density estimates: A framework for clustering and image analysis algorithms'. Together they form a unique fingerprint.

Cite this