3D from compressed 2D video

Ianir A. Ideses, Leonid P. Yaroslavsky, Barak Fishbain, Roni Vistuch

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

Abstract

In this paper, we present an efficient method to synthesize 3D video from compressed 2D video. The 2D video is analyzed by computing frame-by-frame motion maps. For this computation, MPEG motion vectors extraction was performed. Using the extracted motion vector maps, the video undergoes analysis and the frames are segmented to provide object-wise depth ordering. The frames are then used to synthesize stereo pairs. This is performed by resampling the video frames on a grid that is governed by a corresponding depth-map. In order to improve the quality of the synthetic video, as well as to enable 2D viewing where 3D visualization is not possible, several techniques for image enhancement are used. In our test case, anaglyph projection was selected as the 3D visualization method, as the method is mostly suited to standard displays. The drawback of this method is ghosting artifacts. In our implementation we minimize these unwanted artifacts by modifying the computed depth-maps using non-linear transformations. Defocusing of one anaglyph color component was also used to counter such artifacts. Our results show that the suggested methods enable synthesis of high quality 3D videos in real-time.

Original languageEnglish
Title of host publicationProceedings of SPIE-IS and T Electronic Imaging - Stereoscopic Displays and Virtual Reality Systems XIV
DOIs
StatePublished - 2007
EventStereoscopic Displays and Virtual Reality Systems XIV - San Jose, CA, United States
Duration: 29 Jan 200731 Jan 2007

Publication series

NameProceedings of SPIE - The International Society for Optical Engineering
Volume6490
ISSN (Print)0277-786X

Conference

ConferenceStereoscopic Displays and Virtual Reality Systems XIV
Country/TerritoryUnited States
CitySan Jose, CA
Period29/01/0731/01/07

Keywords

  • 3D
  • Anaglyph
  • Artificial-stereo
  • Depth-maps
  • MPEG 4
  • Real-time

Fingerprint

Dive into the research topics of '3D from compressed 2D video'. Together they form a unique fingerprint.

Cite this