Skip to main navigation Skip to search Skip to main content

Learning Gradient Fields for Shape Generation

  • Ruojin Cai*
  • , Guandao Yang
  • , Hadar Averbuch-Elor
  • , Zekun Hao
  • , Serge Belongie
  • , Noah Snavely
  • , Bharath Hariharan
  • *Corresponding author for this work
  • Cornell University

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

161 Scopus citations

Abstract

In this work, we propose a novel technique to generate shapes from point cloud data. A point cloud can be viewed as samples from a distribution of 3D points whose density is concentrated near the surface of the shape. Point cloud generation thus amounts to moving randomly sampled points to high-density areas. We generate point clouds by performing stochastic gradient ascent on an unnormalized probability density, thereby moving sampled points toward the high-likelihood regions. Our model directly predicts the gradient of the log density field and can be trained with a simple objective adapted from score-based generative models. We show that our method can reach state-of-the-art performance for point cloud auto-encoding and generation, while also allowing for extraction of a high-quality implicit surface. Code is available at https://github.com/RuojinCai/ShapeGF.

Original languageEnglish
Title of host publicationComputer Vision – ECCV 2020 - 16th European Conference 2020, Proceedings
EditorsAndrea Vedaldi, Horst Bischof, Thomas Brox, Jan-Michael Frahm
PublisherSpringer Science and Business Media Deutschland GmbH
Pages364-381
Number of pages18
ISBN (Print)9783030585792
DOIs
StatePublished - 2020
Externally publishedYes
Event16th European Conference on Computer Vision, ECCV 2020 - Glasgow, United Kingdom
Duration: 23 Aug 202028 Aug 2020

Publication series

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume12348 LNCS
ISSN (Print)0302-9743
ISSN (Electronic)1611-3349

Conference

Conference16th European Conference on Computer Vision, ECCV 2020
Country/TerritoryUnited Kingdom
CityGlasgow
Period23/08/2028/08/20

Funding

Funders
Magic Leap and Facebook AI

    Keywords

    • 3D generation
    • Generative models

    Fingerprint

    Dive into the research topics of 'Learning Gradient Fields for Shape Generation'. Together they form a unique fingerprint.

    Cite this