A direct differential approach to photometric stereo with perspective viewing

Roberto Mecca, Ariel Tankus, Aaron Wetzler, Alfred M. Bruckstein

Research output: Contribution to journalArticlepeer-review

Abstract

Shape from shading and photometric stereo are two fundamental problems in computer vision aimed at reconstructing surface depth given either a single image taken under a known light source or multiple images taken under different illuminations from the same viewing angle. Whereas the former uses partial differential equation techniques to solve the image irradiance equation, the latter can be expressed as a linear system of equations in surface derivatives when three or more images are given. Therefore, it seems that current photometric stereo techniques do not extract all possible depth information from each image by itself. Extending our previous results on this problem, we consider the more realistic perspective projection of surfaces during the photographic process. Under this assumption, there is a unique weak solution (Lipschitz continuous) to the problem at hand, solving the well-known convex/concave ambiguity of the shape from shading problem. The main contribution of this paper is based on a new differential approach for multi-image photometric stereo. Most of the existing works on this topic do not directly address this problem. The common approach is to estimate the gradient field of the surface by minimizing some functional and integrate it afterwards to find the depth and hence the geometry of the object. Our new differential approach allows us to solve the problem directly, while dealing with images having missing parts. The mathematical well-posedness of the new formulation allows a fast numerical algorithm based on a combination of fast marching and fast sweeping methods.

Original languageEnglish
Pages (from-to)579-612
Number of pages34
JournalSIAM Journal on Imaging Sciences
Volume7
Issue number2
DOIs
StatePublished - 26 Jun 2014
Externally publishedYes

Keywords

  • Finite difference upwind schemes
  • Nonlinear PDE system
  • Perspective shape from shading
  • Photometric stereo
  • Semi-lagrangian schemes
  • Unique weak lipschitz solution

Fingerprint

Dive into the research topics of 'A direct differential approach to photometric stereo with perspective viewing'. Together they form a unique fingerprint.

Cite this