130031 20241125101139.0 doi 10.1145/3592391 sideral 134357 ART-2023-134357 eng Deschaintre, Valentin The visual language of fabrics 2023 Access copy available to the general public Unrestricted We introduce text2fabric, a novel dataset that links free-text descriptions to various fabric materials. The dataset comprises 15,000 natural language descriptions associated to 3,000 corresponding images of fabric materials. Traditionally, material descriptions come in the form of tags/keywords, which limits their expressivity, induces pre-existing knowledge of the appropriate vocabulary, and ultimately leads to a chopped description system. Therefore, we study the use of free-text as a more appropriate way to describe material appearance, taking the use case of fabrics as a common item that non-experts may often deal with. Based on the analysis of the dataset, we identify a compact lexicon, set of attributes and key structure that emerge from the descriptions. This allows us to accurately understand how people describe fabrics and draw directions for generalization to other types of materials. We also show that our dataset enables specializing large vision-language models such as CLIP, creating a meaningful latent space for fabric appearance, and significantly improving applications such as fine-grained material retrieval and automatic captioning. info:eu-repo/semantics/openAccess All rights reserved http://www.europeana.eu/rights/rr-f/ 7.8 2023 COMPUTER SCIENCE, SOFTWARE ENGINEERING 5 / 132 = 0.038 2023 Q1 T1 7.766 2023 Computer Graphics and Computer-Aided Design 2023 Q1 14.3 2023 info:eu-repo/semantics/article info:eu-repo/semantics/acceptedVersion Guerrero-Viu, Julia Universidad de Zaragoza (orcid)0000-0002-2077-683X Gutierrez, Diego Universidad de Zaragoza (orcid)0000-0002-7503-7022 Boubekeur, Tamy Masia, Belen Universidad de Zaragoza (orcid)0000-0003-0060-7278 5007 570 Universidad de Zaragoza Dpto. Informát.Ingenie.Sistms. Área Lenguajes y Sistemas Inf. 42, 4 (2023), [15 pp] ACM trans. graph. ACM TRANSACTIONS ON GRAPHICS 0730-0301 2053264 http://zaguan.unizar.es/record/130031/files/texto_completo.pdf Postprint 2174143 http://zaguan.unizar.es/record/130031/files/texto_completo.jpg?subformat=icon icon Postprint oai:zaguan.unizar.es:130031 articulos driver 2024-11-22-12:02:07 ARTICLE