Knowledge Distillation and Random Erasing Data Augmentation for Text-Dependent Speaker Verification

Mingote, Victoria (Universidad de Zaragoza) ; Miguel, Antonio (Universidad de Zaragoza) ; Ribas, Dayana (Universidad de Zaragoza) ; Ortega, Alfonso (Universidad de Zaragoza) ; Lleida, Eduardo (Universidad de Zaragoza)

Resumen: This paper explores the Knowledge Distillation (KD) approach and a data augmentation technique to improve the generalization ability and robustness of text-dependent speaker verification (SV) systems. The KD method consists of two neural networks, known as Teacher and Student, where the student is trained to replicate the predictions from the teacher, so it learns their variability during the training process. To provide robustness to the distillation process, we apply Random Erasing (RE), a data augmentation technique which was created to improve the generalization ability of the neural networks. We have developed two alternatives of the combination of KD and RE, which, produce a more robust system with better performance, since the student network can learn from teacher predictions of data not existing in the original dataset. All alternatives were tested on RSR2015-Part I database, where the proposed variants outperform reference system based on a single network using RE.

Idioma: Inglés

DOI: 10.1109/ICASSP40776.2020.9053153

Año: 2020

Publicado en: Proceedings - ICASSP, IEEE International Conference on Acoustics, Speech and Signal Processing 2020 (2020), 6824-6828
ISSN: 0736-7791

Factor impacto SCIMAGO: 0.546 - Electrical and Electronic Engineering - Software - Signal Processing

Financiación: info:eu-repo/grantAgreement/ES/DGA-FEDER/T36-17R
Financiación: info:eu-repo/grantAgreement/ES/MINECO/TIN2017-85854-C4-1-R

Tipo y forma: Article (PostPrint)

Área (Departamento): Área Teoría Señal y Comunicac. (Dpto. Ingeniería Electrón.Com.)