Movie editing and cognitive event segmentation in virtual reality video
Serrano, Ana (Universidad de Zaragoza) ; Sitzmann, Vincent ; Ruiz-Borau, Jaime ; Wetzstein, Gordon ; Gutierrez, Diego (Universidad de Zaragoza) ; Masia, Belen (Universidad de Zaragoza)
Resumen: Traditional cinematography has relied for over a century on a well-established set of editing rules, called continuity editing, to create a sense of situational continuity. Despite massive changes in visual content across cuts, viewers in general experience no trouble perceiving the discontinuous flow of information as a coherent set of events. However, Virtual Reality (VR) movies are intrinsically different from traditional movies in that the viewer controls the camera orientation at all times. As a consequence, common editing techniques that rely on camera orientations, zooms, etc., cannot be used. In this paper we investigate key relevant questions to understand how well traditional movie editing carries over to VR, such as: Does the perception of continuity hold across edit boundaries? Under which conditions? Does viewers' observational behavior change after the cuts? To do so, we rely on recent cognition studies and the event segmentation theory, which states that our brains segment continuous actions into a series of discrete, meaningful events. We first replicate one of these studies to assess whether the predictions of such theory can be applied to VR. We next gather gaze data from viewers watching VR videos containing different edits with varying parameters, and provide the first systematic analysis of viewers' behavior and the perception of continuity in VR. From this analysis we make a series of relevant findings; for instance, our data suggests that predictions from the cognitive event segmentation theory are useful guides for VR editing; that different types of edits are equally well understood in terms of continuity; and that spatial misalignments between regions of interest at the edit boundaries favor a more exploratory behavior even after viewers have fixated on a new region of interest. In addition, we propose a number of metrics to describe viewers' attentional behavior in VR. We believe the insights derived from our work can be useful as guidelines for VR content creation.
Idioma: Inglés
DOI: 10.1145/3072959.3073668
Año: 2017
Publicado en: ACM TRANSACTIONS ON GRAPHICS 36, 4 (2017), 47 [12 pp.]
ISSN: 0730-0301
Factor impacto JCR: 4.384 (2017)
Categ. JCR: COMPUTER SCIENCE, SOFTWARE ENGINEERING rank: 3 / 104 = 0.029 (2017) - Q1 - T1
Factor impacto SCIMAGO: 1.344 - Computer Graphics and Computer-Aided Design (Q1)
Financiación: info:eu-repo/grantAgreement/ES/MINECO/IMAGER-TIN2016-79710-P
Financiación: info:eu-repo/grantAgreement/ES/MINECO/TIN2014-61696-EXP
Financiación: info:eu-repo/grantAgreement/ES/MINECO/TIN2016-78753-P
Tipo y forma: Article (PostPrint)
Área (Departamento): Área Expresión Gráfica en Ing. (Dpto. Ingeniería Diseño Fabri.)
Área (Departamento): Área Lenguajes y Sistemas Inf. (Dpto. Informát.Ingenie.Sistms.)
You must give appropriate credit, provide a link to the license, and indicate if changes were made. You may do so in any reasonable manner, but not in any way that suggests the licensor endorses you or your use. You may not use the material for commercial purposes.
Exportado de SIDERAL (2019-07-09-11:33:29)
Visitas y descargas
Idioma: Inglés
DOI: 10.1145/3072959.3073668
Año: 2017
Publicado en: ACM TRANSACTIONS ON GRAPHICS 36, 4 (2017), 47 [12 pp.]
ISSN: 0730-0301
Factor impacto JCR: 4.384 (2017)
Categ. JCR: COMPUTER SCIENCE, SOFTWARE ENGINEERING rank: 3 / 104 = 0.029 (2017) - Q1 - T1
Factor impacto SCIMAGO: 1.344 - Computer Graphics and Computer-Aided Design (Q1)
Financiación: info:eu-repo/grantAgreement/ES/MINECO/IMAGER-TIN2016-79710-P
Financiación: info:eu-repo/grantAgreement/ES/MINECO/TIN2014-61696-EXP
Financiación: info:eu-repo/grantAgreement/ES/MINECO/TIN2016-78753-P
Tipo y forma: Article (PostPrint)
Área (Departamento): Área Expresión Gráfica en Ing. (Dpto. Ingeniería Diseño Fabri.)
Área (Departamento): Área Lenguajes y Sistemas Inf. (Dpto. Informát.Ingenie.Sistms.)
You must give appropriate credit, provide a link to the license, and indicate if changes were made. You may do so in any reasonable manner, but not in any way that suggests the licensor endorses you or your use. You may not use the material for commercial purposes. Exportado de SIDERAL (2019-07-09-11:33:29)
Permalink:
Visitas y descargas
Este artículo se encuentra en las siguientes colecciones:
Articles
Record created 2019-02-22, last modified 2019-07-09