Robust Policy Search for Robot Navigation

Garcia-Barcos, J. (Universidad de Zaragoza) ; Martinez-Cantin, R. (Universidad de Zaragoza)

Resumen: Complex robot navigation and control problems can be framed as policy search problems. However, interactive learning in uncertain environments can be expensive, requiring the use of data-efficient methods. Bayesian optimization is an efficient nonlinear optimization method where queries are carefully selected to gather information about the optimum location. This is achieved by a surrogate model, which encodes past information, and the acquisition function for query selection. Bayesian optimization can be very sensitive to uncertainty in the input data or prior assumptions. In this letter, we incorporate both robust optimization and statistical robustness, showing that both types of robustness are synergistic. For robust optimization we use an improved version of unscented Bayesian optimization which provides safe and repeatable policies in the presence of policy uncertainty. We also provide new theoretical insights. For statistical robustness, we use an adaptive surrogate model and we introduce the Boltzmann selection as a stochastic acquisition method to have convergence guarantees and improved performance even with surrogate modeling errors. We present results in several optimization benchmarks and robot tasks.

Idioma: Inglés

DOI: 10.1109/LRA.2021.3060408

Año: 2021

Publicado en: IEEE Robotics and Automation Letters 6, 2 (2021), 2389-2396
ISSN: 2377-3766

Factor impacto JCR: 4.321 (2021)

Categ. JCR: ROBOTICS rank: 11 / 30 = 0.367 (2021) - Q2 - T2

Factor impacto CITESCORE: 8.0 - Engineering (Q1) - Mathematics (Q1) - Computer Science (Q1)

Factor impacto SCIMAGO: 2.206 - Artificial Intelligence (Q1) - Biomedical Engineering (Q1) - Mechanical Engineering (Q1) - Control and Optimization (Q1) - Control and Systems Engineering (Q1) - Computer Vision and Pattern Recognition (Q1)

Financiación: info:eu-repo/grantAgreement/ES/MINECO-FEDER/RTI2018-096903-B-I00

Tipo y forma: Artículo (Versión definitiva)

Área (Departamento): Área Ingen.Sistemas y Automát. (Dpto. Informát.Ingenie.Sistms.)
Área (Departamento): Área Lenguajes y Sistemas Inf. (Dpto. Informát.Ingenie.Sistms.)