Saliency in VR: How do people explore virtual environments?

Sitzmann, V. ; Serrano, A. (Universidad de Zaragoza) ; Pavel, A. ; Agrawala, M. ; Gutierrez, D. (Universidad de Zaragoza) ; Masia, B. (Universidad de Zaragoza) ; Wetzstein, G.
Saliency in VR: How do people explore virtual environments?
Financiación H2020 / H2020 Funds
Resumen: Understanding how people explore immersive virtual environments is crucial for many applications, such as designing virtual reality (VR) content, developing new compression algorithms, or learning computational models of saliency or visual attention. Whereas a body of recent work has focused on modeling saliency in desktop viewing conditions, VR is very different from these conditions in that viewing behavior is governed by stereoscopic vision and by the complex interaction of head orientation, gaze, and other kinematic constraints. To further our understanding of viewing behavior and saliency in VR, we capture and analyze gaze and head orientation data of 169 users exploring stereoscopic, static omni-directional panoramas, for a total of 1980 head and gaze trajectories for three different viewing conditions. We provide a thorough analysis of our data, which leads to several important insights, such as the existence of a particular fixation bias, which we then use to adapt existing saliency predictors to immersive VR conditions. In addition, we explore other applications of our data and analysis, including automatic alignment of VR video cuts, panorama thumbnails, panorama video synopsis, and saliency-basedcompression.
Idioma: Inglés
DOI: 10.1109/TVCG.2018.2793599
Año: 2018
Publicado en: IEEE TRANSACTIONS ON VISUALIZATION AND COMPUTER GRAPHICS 24, 4 (2018), 1633-1642
ISSN: 1077-2626

Factor impacto JCR: 3.78 (2018)
Categ. JCR: COMPUTER SCIENCE, SOFTWARE ENGINEERING rank: 11 / 107 = 0.103 (2018) - Q1 - T1
Factor impacto SCIMAGO: 0.957 - Computer Graphics and Computer-Aided Design (Q1) - Software (Q1) - Signal Processing (Q1) - Computer Vision and Pattern Recognition (Q1)

Financiación: info:eu-repo/grantAgreement/EC/H2020/682080/EU/Intuitive editing of visual appearance from real-world datasets/CHAMELEON
Financiación: info:eu-repo/grantAgreement/ES/MINECO/TIN2016-78753-P
Financiación: info:eu-repo/grantAgreement/ES/MINECO/TIN2016-79710-P
Tipo y forma: Article (PostPrint)
Área (Departamento): Área Lenguajes y Sistemas Inf. (Dpto. Informát.Ingenie.Sistms.)

Rights Reserved All rights reserved by journal editor


Exportado de SIDERAL (2020-01-13-14:52:37)


Visitas y descargas

Este artículo se encuentra en las siguientes colecciones:
Articles



 Record created 2019-03-18, last modified 2020-01-13


Postprint:
 PDF
Rate this document:

Rate this document:
1
2
3
 
(Not yet reviewed)