118057 20230519145430.0 doi 10.1145/3478513.3480498 sideral 125699 ART-2021-125699 eng Yi, S.Y. Differentiable Transient Rendering 2021 Access copy available to the general public Unrestricted Recent differentiable rendering techniques have become key tools to tackle many inverse problems in graphics and vision. Existing models, however, assume steady-state light transport, i.e., infinite speed of light. While this is a safe assumption for many applications, recent advances in ultrafast imaging leverage the wealth of information that can be extracted from the exact time of flight of light. In this context, physically-based transient rendering allows to efficiently simulate and analyze light transport considering that the speed of light is indeed finite. In this paper, we introduce a novel differentiable transient rendering framework, to help bring the potential of differentiable approaches into the transient regime. To differentiate the transient path integral we need to take into account that scattering events at path vertices are no longer independent; instead, tracking the time of flight of light requires treating such scattering events at path vertices jointly as a multidimensional, evolving manifold. We thus turn to the generalized transport theorem, and introduce a novel correlated importance term, which links the time-integrated contribution of a path to its light throughput, and allows us to handle discontinuities in the light and sensor functions. Last, we present results in several challenging scenarios where the time of flight of light plays an important role such as optimizing indices of refraction, non-line-of-sight tracking with nonplanar relay walls, and non-line-of-sight tracking around two corners. info:eu-repo/grantAgreement/EC/H2020/682080/EU/Intuitive editing of visual appearance from real-world datasets/CHAMELEON This project has received funding from the European Union’s Horizon 2020 research and innovation program under grant agreement No H2020 682080-CHAMELEON info:eu-repo/grantAgreement/EC/H2020/956585/EU/Predictive Rendering In Manufacture and Engineering/PRIME This project has received funding from the European Union’s Horizon 2020 research and innovation program under grant agreement No H2020 956585-PRIME info:eu-repo/grantAgreement/ES/MICINN/PID2019-105004GB-I00 info:eu-repo/semantics/openAccess by http://creativecommons.org/licenses/by/3.0/es/ 7.403 2021 COMPUTER SCIENCE, SOFTWARE ENGINEERING 9 / 110 = 0.082 2021 Q1 T1 7.148 2021 Computer Graphics and Computer-Aided Design 2021 Q1 14.2 2021 info:eu-repo/semantics/article info:eu-repo/semantics/publishedVersion Kim, D. Choi, K. Jarabo, A. Gutierrez, D. Universidad de Zaragoza (orcid)0000-0002-7503-7022 Kim, M.H. 5007 570 Universidad de Zaragoza Dpto. Informát.Ingenie.Sistms. Área Lenguajes y Sistemas Inf. 40, 6 (2021), 286 [11 pp.] ACM trans. graph. ACM TRANSACTIONS ON GRAPHICS 0730-0301 2569054 http://zaguan.unizar.es/record/118057/files/texto_completo.pdf Versión publicada 2450673 http://zaguan.unizar.es/record/118057/files/texto_completo.jpg?subformat=icon icon Versión publicada oai:zaguan.unizar.es:118057 articulos driver 2023-05-18-14:16:53 ARTICLE