Practical SVBRDF Acquisition of 3D Objects with Unstructured Flash Photography

Nam, G. ; Lee, J.H. ; Gutierrez, D. (Universidad de Zaragoza) ; Kim, M.H.

Resumen: Capturing spatially-varying bidirectional reflectance distribution functions (SVBRDFs) of 3D objects with just a single, hand-held camera (such as an off-the-shelf smartphone or a DSLR camera) is a difficult, open problem. Previous works are either limited to planar geometry, or rely on previously scanned 3D geometry, thus limiting their practicality. There are several technical challenges that need to be overcome: First, the built-in flash of a camera is almost colocated with the lens, and at a fixed position; this severely hampers sampling procedures in the light-view space. Moreover, the near-field flash lights the object partially and unevenly. In terms of geometry, existing multiview stereo techniques assume diffuse reflectance only, which leads to overly smoothed 3D reconstructions, as we show in this paper. We present a simple yet powerful framework that removes the need for expensive, dedicated hardware, enabling practical acquisition of SVBRDF information from real-world, 3D objects with a single, off-the-shelf camera with a built-in flash. In addition, by removing the diffuse reflection assumption and leveraging instead such SVBRDF information, our method outputs high-quality 3D geometry reconstructions, including more accurate high-frequency details than state-of-the-art multiview stereo techniques. We formulate the joint reconstruction of SVBRDFs, shading normals, and 3D geometry as a multi-stage, iterative inverse-rendering reconstruction pipeline. Our method is also directly applicable to any existing multiview 3D reconstruction technique. We present results of captured objects with complex geometry and reflectance; we also validate our method numerically against other existing approaches that rely on dedicated hardware, additional sources of information, or both.

Idioma: Inglés

DOI: 10.1145/3272127.3275017

Año: 2018

Publicado en: ACM TRANSACTIONS ON GRAPHICS 37, 6 (2018), 267 [12 pp]
ISSN: 0730-0301

Factor impacto JCR: 6.495 (2018)

Categ. JCR: COMPUTER SCIENCE, SOFTWARE ENGINEERING rank: 1 / 107 = 0.009 (2018) - Q1 - T1

Factor impacto SCIMAGO: 2.272 - Computer Graphics and Computer-Aided Design (Q1)

Financiación: info:eu-repo/grantAgreement/EC/H2020/682080/EU/Intuitive editing of visual appearance from real-world datasets/CHAMELEON
Financiación: info:eu-repo/grantAgreement/ES/MINECO/TIN2016-78753-P

Tipo y forma: Article (PostPrint)

Área (Departamento): Área Lenguajes y Sistemas Inf. (Dpto. Informát.Ingenie.Sistms.)