ALBAYZIN 2016 spoken term detection evaluation: an international open competitive evaluation in Spanish

Tejedor, J. ; Toledano, D.T. ; Lopez-Otero, P. ; Docio-Fernandez, L. ; Serrano, L. ; Hernaez, I. ; Coucheiro-Limeres, A. ; Ferreiros, J. ; Olcoz, J. (Universidad de Zaragoza) ; Llombart, J.

Resumen: Within search-on-speech, Spoken Term Detection (STD) aims to retrieve data from a speech repository given a textual representation of a search term. This paper presents an international open evaluation for search-on-speech based on STD in Spanish and an analysis of the results. The evaluation has been designed carefully so that several analyses of the main results can be carried out. The evaluation consists in retrieving the speech files that contain the search terms, providing their start and end times, and a score value that reflects the confidence given to the detection. Two different Spanish speech databases have been employed in the evaluation: MAVIR database, which comprises a set of talks from workshops, and EPIC database, which comprises a set of European Parliament sessions in Spanish. We present the evaluation itself, both databases, the evaluation metric, the systems submitted to the evaluation, the results, and a detailed discussion. Five different research groups took part in the evaluation, and ten different systems were submitted in total. We compare the systems submitted to the evaluation and make a deep analysis based on some search term properties (term length, within-vocabulary/out-of-vocabulary terms, single-word/multi-word terms, and native (Spanish)/foreign terms).

Idioma: Inglés

DOI: 10.1186/s13636-017-0119-z

Año: 2017

Publicado en: EURASIP JOURNAL ON AUDIO SPEECH AND MUSIC PROCESSING 2017, 1 (2017), [23 pp]
ISSN: 1687-4714

Factor impacto JCR: 3.057 (2017)

Categ. JCR: ENGINEERING, ELECTRICAL & ELECTRONIC rank: 62 / 260 = 0.238 (2017) - Q1 - T1
Categ. JCR: ACOUSTICS rank: 4 / 31 = 0.129 (2017) - Q1 - T1

Factor impacto SCIMAGO: 0.337 - Electrical and Electronic Engineering (Q2) - Acoustics and Ultrasonics (Q2)

Financiación: info:eu-repo/grantAgreement/ES/MINECO/TEC2015-67163-C2-1-R
Financiación: info:eu-repo/grantAgreement/ES/MINECO/TEC2015-68172-C2-1-P
Financiación: info:eu-repo/grantAgreement/ES/MINECO/TIN2014-54288-C4-1-R

Tipo y forma: Article (Published version)

Área (Departamento): Área Teoría Señal y Comunicac. (Dpto. Ingeniería Electrón.Com.)