Robust Sound Source Tracking Using SRP-PHAT and 3D Convolutional Neural Networks

Diaz-Guerra, D. (Universidad de Zaragoza) ; Miguel, A. (Universidad de Zaragoza) ; Beltran, J.R. (Universidad de Zaragoza)

Resumen: In this article, we present a new single sound source DOA estimation and tracking system based on the well-known SRP-PHAT algorithm and a three-dimensional Convolutional Neural Network. It uses SRP-PHAT power maps as input features of a fully convolutional causal architecture that uses 3D convolutional layers to accurately perform the tracking of a sound source even in highly reverberant scenarios where most of the state of the art techniques fail. Unlike previous methods, since we do not use bidirectional recurrent layers and all our convolutional layers are causal in the time dimension, our system is feasible for real-time applications and it provides a new DOA estimation for each new SRP-PHAT map. To train the model, we introduce a new procedure to simulate random trajectories as they are needed during the training, equivalent to an infinite-size dataset with high flexibility to modify its acoustical conditions such as the reverberation time. We use both acoustical simulations on a large range of reverberation times and the actual recordings of the LOCATA dataset to prove the robustness of our system and its good performance even using low-resolution SRP-PHAT maps.

Idioma: Inglés

DOI: 10.1109/TASLP.2020.3040031

Año: 2021

Publicado en: IEEE/ACM Transactions on Audio, Speech, and Language Processing 29 (2021), 300-311
ISSN: 2329-9290

Factor impacto JCR: 4.364 (2021)

Categ. JCR: ACOUSTICS rank: 5 / 32 = 0.156 (2021) - Q1 - T1
Categ. JCR: ENGINEERING, ELECTRICAL & ELECTRONIC rank: 82 / 274 = 0.299 (2021) - Q2 - T1

Factor impacto CITESCORE: 9.4 - Engineering (Q1) - Mathematics (Q1) - Computer Science (Q1) - Physics and Astronomy (Q1)

Factor impacto SCIMAGO: 1.591 - Acoustics and Ultrasonics (Q1) - Computational Mathematics (Q1) - Speech and Hearing (Q1) - Instrumentation (Q1) - Media Technology (Q1) - Electrical and Electronic Engineering (Q1)

Tipo y forma: Artículo (Versión definitiva)

Área (Departamento): Área Tecnología Electrónica (Dpto. Ingeniería Electrón.Com.)
Área (Departamento): Área Teoría Señal y Comunicac. (Dpto. Ingeniería Electrón.Com.)