The joint role of geometry and illumination on material recognition

Lagunas, Manuel (Universidad de Zaragoza) ; Serrano, Ana (Universidad de Zaragoza) ; Gutiérrez, Diego (Universidad de Zaragoza) ; Masiá, Belén (Universidad de Zaragoza)

Resumen: Observing and recognizing materials is a fundamental part of our daily life. Under typical viewing conditions, we are capable of effortlessly identifying the objects that surround us and recognizing the materials they are made of. Nevertheless, understanding the underlying perceptual processes that take place to accurately discern the visual properties of an object is a long-standing problem. In this work, we perform a comprehensive and systematic analysis of how the interplay of geometry, illumination, and their spatial frequencies affects human performance on material recognition tasks. We carry out large-scale behavioral experiments where participants are asked to recognize different reference materials among a pool of candidate samples. In the different experiments, we carefully sample the information in the frequency domain of the stimuli. From our analysis, we find significant first-order interactions between the geometry and the illumination, of both the reference and the candidates. In addition, we observe that simple image statistics and higher-order image histograms do not correlate with human performance. Therefore, we perform a high-level comparison of highly nonlinear statistics by training a deep neural network on material recognition tasks. Our results show that such models can accurately classify materials, which suggests that they are capable of defining a meaningful representation of material appearance from labeled proximal image data. Last, we find preliminary evidence that these highly nonlinear models and humans may use similar high-level factors for material recognition tasks.

Idioma: Inglés

DOI: 10.1167/jov.21.2.2

Año: 2021

Publicado en: Journal of Vision 21, 2 (2021), 2[18 pp.]
ISSN: 1534-7362

Factor impacto JCR: 2.004 (2021)

Categ. JCR: OPHTHALMOLOGY rank: 44 / 62 = 0.71 (2021) - Q3 - T3

Factor impacto CITESCORE: 3.2 - Medicine (Q2) - Neuroscience (Q3)

Factor impacto SCIMAGO: 0.79 - Sensory Systems (Q2) - Ophthalmology (Q2)

Financiación: info:eu-repo/grantAgreement/EC/H2020/682080/EU/Intuitive editing of visual appearance from real-world datasets/CHAMELEON
Financiación: info:eu-repo/grantAgreement/EC/H2020/765121/EU/DyViTo: Dynamics in Vision and Touch - the look and feel of stuff/DyViTo
Financiación: info:eu-repo/grantAgreement/EC/H2020/956585/EU/Predictive Rendering In Manufacture and Engineering/PRIME
Financiación: info:eu-repo/grantAgreement/ES/MINECO/PID2019-105004GB-I00
Financiación: info:eu-repo/grantAgreement/ES/MINECO/TIN2016-78753-P

Tipo y forma: Article (Published version)

Área (Departamento): Área Lenguajes y Sistemas Inf. (Dpto. Informát.Ingenie.Sistms.)