Light field image processing: an overview

Wu, Gaochang ; Masia, Belen (Universidad de Zaragoza) ; Jarabo, Adrian ; Zhang, Yuchen ; Wang, Liangyong ; Dai, Qionghai ; Chai, Tianyou ; Liu, Yebin

Resumen: Light field imaging has emerged as a technology allowing to capture richer visual information from our world. As opposed to traditional photography, which captures a 2D projection of the light in the scene integrating the angular domain, light fields collect radiance from rays in all directions, demultiplexing the angular information lost in conventional photography. On the one hand, this higher dimensional representation of visual data offers powerful capabilities for scene understanding, and substantially improves the performance of traditional computer vision problems such as depth sensing, post-capture refocusing, segmentation, video stabilization, material classification, etc. On the other hand, the high-dimensionality of light fields also brings up new challenges in terms of data capture, data compression, content editing, and display. Taking these two elements together, research in light field image processing has become increasingly popular in the computer vision, computer graphics, and signal processing communities. In this paper, we present a comprehensive overview and discussion of research in this field over the past 20 years. We focus on all aspects of light field image processing, including basic light field representation and theory, acquisition, super-resolution, depth estimation, compression, editing, processing algorithms for light field display, and computer vision applications of light field data.

Idioma: Inglés

DOI: 10.1109/JSTSP.2017.2747126

Año: 2017

Publicado en: IEEE Journal of Selected Topics in Signal Processing 11, 7 (2017), 926-954
ISSN: 1932-4553

Factor impacto JCR: 4.361 (2017)

Categ. JCR: ENGINEERING, ELECTRICAL & ELECTRONIC rank: 30 / 260 = 0.115 (2017) - Q1 - T1

Factor impacto SCIMAGO: 1.331 - Signal Processing (Q1) - Electrical and Electronic Engineering (Q1)

Financiación: info:eu-repo/grantAgreement/EC/H2020/682080/EU/Intuitive editing of visual appearance from real-world datasets/CHAMELEON

Tipo y forma: Article (PostPrint)

Área (Departamento): Área Lenguajes y Sistemas Inf. (Dpto. Informát.Ingenie.Sistms.)