Dance to the beat: Synchronizing motion to audio

Rachele Bellini, Yanir Kleiman, Daniel Cohen-Or

Research output: Contribution to journalArticlepeer-review

Abstract

In this paper we introduce a video post-processing method that enhances the rhythm of a dancing performance, in the sense that the dancing movements are more in time to the beat of the music. The dancing performance as observed in a video is analyzed and segmented into motion intervals delimited by motion beats. We present an image-space method to extract the motion beats of a video by detecting frames at which there is a significant change in direction or motion stops. The motion beats are then synchronized with the music beats such that as many beats as possible are matched with as little as possible time-warping distortion to the video. We show two applications for this cross-media synchronization: one where a given dance performance is enhanced to be better synchronized with its original music, and one where a given dance video is automatically adapted to be synchronized with different music.

Original languageEnglish
Pages (from-to)197-208
Number of pages12
JournalComputational Visual Media
Volume4
Issue number3
DOIs
StatePublished - 1 Sep 2018

Keywords

  • motion segmentation
  • synchronization
  • video analysis
  • video processing

Fingerprint

Dive into the research topics of 'Dance to the beat: Synchronizing motion to audio'. Together they form a unique fingerprint.

Cite this