88209 20200716101443.0 doi 10.1109/TVCG.2019.2898757 sideral 111449 ART-2019-111449 eng (orcid)0000-0002-7796-3177 Serrano, A. Universidad de Zaragoza Motion parallax for 360° RGBD video 2019 Access copy available to the general public Unrestricted We present a method for adding parallax and real-time playback of 360° videos in Virtual Reality headsets. In current video players, the playback does not respond to translational head movement, which reduces the feeling of immersion, and causes motion sickness for some viewers. Given a 360° video and its corresponding depth (provided by current stereo 360° stitching algorithms), a naive image-based rendering approach would use the depth to generate a 3D mesh around the viewer, then translate it appropriately as the viewer moves their head. However, this approach breaks at depth discontinuities, showing visible distortions, whereas cutting the mesh at such discontinuities leads to ragged silhouettes and holes at disocclusions. We address these issues by improving the given initial depth map to yield cleaner, more natural silhouettes. We rely on a three-layer scene representation, made up of a foreground layer and two static background layers, to handle disocclusions by propagating information from multiple frames for the first background layer, and then inpainting for the second one. Our system works with input from many of today''s most popular 360° stereo capture devices (e.g., Yi Halo or GoPro Odyssey), and works well even if the original video does not provide depth information. Our user studies confirm that our method provides a more compelling viewing experience than without parallax, increasing immersion while reducing discomfort and nausea. info:eu-repo/grantAgreement/EC/H2020/682080/EU/Intuitive editing of visual appearance from real-world datasets/CHAMELEON This project has received funding from the European Union’s Horizon 2020 research and innovation program under grant agreement No H2020 682080-CHAMELEON info:eu-repo/grantAgreement/ES/MINECO/TIN2016-78753-P info:eu-repo/grantAgreement/ES/MINECO/TIN2016-79710-P info:eu-repo/semantics/openAccess All rights reserved http://www.europeana.eu/rights/rr-f/ 4.558 2019 COMPUTER SCIENCE, SOFTWARE ENGINEERING 10 / 108 = 0.093 2019 Q1 T1 1.519 2019 Computer Graphics and Computer-Aided Design 2019 Q1 Software 2019 Q1 Signal Processing 2019 Q1 Computer Vision and Pattern Recognition 2019 Q1 info:eu-repo/semantics/article info:eu-repo/semantics/acceptedVersion Kim, I. Chen, Z. DIVerdi, S. (orcid)0000-0002-7503-7022 Gutierrez, D. Universidad de Zaragoza Hertzmann, A. (orcid)0000-0003-0060-7278 Masia, B. Universidad de Zaragoza 5007 570 Universidad de Zaragoza Dpto. Informát.Ingenie.Sistms. Área Lenguajes y Sistemas Inf. 25, 5 (2019), 1817-1827 IEEE trans. vis. comput. graph. IEEE TRANSACTIONS ON VISUALIZATION AND COMPUTER GRAPHICS 1077-2626 1085585 http://zaguan.unizar.es/record/88209/files/texto_completo.pdf Postprint 482284 http://zaguan.unizar.es/record/88209/files/texto_completo.jpg?subformat=icon icon Postprint oai:zaguan.unizar.es:88209 articulos driver 2020-07-16-09:00:36 ARTICLE