000118057 001__ 118057 000118057 005__ 20230519145430.0 000118057 0247_ $$2doi$$a10.1145/3478513.3480498 000118057 0248_ $$2sideral$$a125699 000118057 037__ $$aART-2021-125699 000118057 041__ $$aeng 000118057 100__ $$aYi, S.Y. 000118057 245__ $$aDifferentiable Transient Rendering 000118057 260__ $$c2021 000118057 5060_ $$aAccess copy available to the general public$$fUnrestricted 000118057 5203_ $$aRecent differentiable rendering techniques have become key tools to tackle many inverse problems in graphics and vision. Existing models, however, assume steady-state light transport, i.e., infinite speed of light. While this is a safe assumption for many applications, recent advances in ultrafast imaging leverage the wealth of information that can be extracted from the exact time of flight of light. In this context, physically-based transient rendering allows to efficiently simulate and analyze light transport considering that the speed of light is indeed finite. In this paper, we introduce a novel differentiable transient rendering framework, to help bring the potential of differentiable approaches into the transient regime. To differentiate the transient path integral we need to take into account that scattering events at path vertices are no longer independent; instead, tracking the time of flight of light requires treating such scattering events at path vertices jointly as a multidimensional, evolving manifold. We thus turn to the generalized transport theorem, and introduce a novel correlated importance term, which links the time-integrated contribution of a path to its light throughput, and allows us to handle discontinuities in the light and sensor functions. Last, we present results in several challenging scenarios where the time of flight of light plays an important role such as optimizing indices of refraction, non-line-of-sight tracking with nonplanar relay walls, and non-line-of-sight tracking around two corners. 000118057 536__ $$9This project has received funding from the European Union’s Horizon 2020 research and innovation program under grant agreement No H2020 956585-PRIME$$9info:eu-repo/grantAgreement/EC/H2020/956585/EU/Predictive Rendering In Manufacture and Engineering/PRIME$$9This project has received funding from the European Union’s Horizon 2020 research and innovation program under grant agreement No H2020 682080-CHAMELEON$$9info:eu-repo/grantAgreement/EC/H2020/682080/EU/Intuitive editing of visual appearance from real-world datasets/CHAMELEON$$9info:eu-repo/grantAgreement/ES/MICINN/PID2019-105004GB-I00 000118057 540__ $$9info:eu-repo/semantics/openAccess$$aby$$uhttp://creativecommons.org/licenses/by/3.0/es/ 000118057 594__ $$a14.2$$b2021 000118057 590__ $$a7.403$$b2021 000118057 592__ $$a7.148$$b2021 000118057 591__ $$aCOMPUTER SCIENCE, SOFTWARE ENGINEERING$$b9 / 110 = 0.082$$c2021$$dQ1$$eT1 000118057 593__ $$aComputer Graphics and Computer-Aided Design$$c2021$$dQ1 000118057 655_4 $$ainfo:eu-repo/semantics/article$$vinfo:eu-repo/semantics/publishedVersion 000118057 700__ $$aKim, D. 000118057 700__ $$aChoi, K. 000118057 700__ $$aJarabo, A. 000118057 700__ $$0(orcid)0000-0002-7503-7022$$aGutierrez, D.$$uUniversidad de Zaragoza 000118057 700__ $$aKim, M.H. 000118057 7102_ $$15007$$2570$$aUniversidad de Zaragoza$$bDpto. Informát.Ingenie.Sistms.$$cÁrea Lenguajes y Sistemas Inf. 000118057 773__ $$g40, 6 (2021), 286 [11 pp.]$$pACM trans. graph.$$tACM TRANSACTIONS ON GRAPHICS$$x0730-0301 000118057 8564_ $$s2569054$$uhttps://zaguan.unizar.es/record/118057/files/texto_completo.pdf$$yVersión publicada 000118057 8564_ $$s2450673$$uhttps://zaguan.unizar.es/record/118057/files/texto_completo.jpg?subformat=icon$$xicon$$yVersión publicada 000118057 909CO $$ooai:zaguan.unizar.es:118057$$particulos$$pdriver 000118057 951__ $$a2023-05-18-14:16:53 000118057 980__ $$aARTICLE