Linearizing the Plenoptic Space

Grégoire Nieto (1) , Frédéric Devernay (1) , James L. Crowley (2)

1 IMAGINE - Intuitive Modeling and Animation for Interactive Graphics & Narrative Environments
2 PERVASIVE - Interaction située avec les objets et environnements intelligents

The plenoptic function, also known as the light field or the lumigraph, contains the information about the radiance of all optical rays that go through all points in space in a scene. Since no camera can capture all this information, one of the main challenges in plenoptic imaging is light field reconstruction, which consists in interpolating the ray samples captured by the cameras to create a dense light field. Most existing methods perform this task by first attempting some kind of 3D reconstruction of the visible scene. Our method, in contrast, works by modeling the scene as a set of visual points, which describe how each point moves in the image when a camera moves. We compute visual point models of various degrees of complexity, and show that high-dimensional models are able to replicate complex optical effects such as reflection or refraction, and a model selection method can differentiate quasi-Lambertian from non-Lambertian areas in the scene.

Domaines: Vision par ordinateur et reconnaissance de formes [cs.CV]

Grégoire Nieto, Frédéric Devernay, James L. Crowley. Linearizing the Plenoptic Space. Light Fields for Computer Vision, Jul 2017, Honolulu, United States. pp.1714-1725, ⟨10.1109/CVPRW.2017.218⟩. ⟨hal-01572479⟩