Ray-Patch: an efficient querying for light field transformers

Berriel Martins, Tomás (Universidad de Zaragoza) ; Civera Sancho, Javier (Universidad de Zaragoza)

Resumen: In this paper we propose the Ray-Patch querying, a novel model to efficiently query transformers to decode implicit representations into target views. Our Ray-Patch decoding reduces the computational footprint and increases inference speed up to one order of magnitude compared to previous models, without losing global attention, and hence maintaining specific task metrics. The key idea of our novel querying is to split the target image into a set of patches, then querying the transformer for each patch to extract a set of feature vectors, which are finally decoded into the target image using convolutional layers. Our experimental results quantify the effectiveness of our method, specifically the notable boost in rendering speed for the same task metrics.

Idioma: Inglés

DOI: 10.1109/ICCVW60793.2023.00124

Año: 2023

Publicado en: IEEE International Conference on Computer Vision workshops (2023), 1150 - 1155
ISSN: 2473-9936

Tipo y forma: Congress (PostPrint)

Área (Departamento): Área Ingen.Sistemas y Automát. (Dpto. Informát.Ingenie.Sistms.)