LLM-Informed Multi-Armed Bandit Strategies for Non-Stationary Environments

Curtò, J. de ; Zarzà, I. de ; Roig, Gemma ; Cano, Juan Carlos ; Manzoni, Pietro ; Calafate, Carlos T.

Resumen: In this paper, we introduce an innovative approach to handling the multi-armed bandit (MAB) problem in non-stationary environments, harnessing the predictive power of large language models (LLMs). With the realization that traditional bandit strategies, including epsilon-greedy and upper confidence bound (UCB), may struggle in the face of dynamic changes, we propose a strategy informed by LLMs that offers dynamic guidance on exploration versus exploitation, contingent on the current state of the bandits. We bring forward a new non-stationary bandit model with fluctuating reward distributions and illustrate how LLMs can be employed to guide the choice of bandit amid this variability. Experimental outcomes illustrate the potential of our LLM-informed strategy, demonstrating its adaptability to the fluctuating nature of the bandit problem, while maintaining competitive performance against conventional strategies. This study provides key insights into the capabilities of LLMs in enhancing decision-making processes in dynamic and uncertain scenarios.

Idioma: Inglés

DOI: 10.3390/electronics12132814

Año: 2023

Publicado en: Electronics 12, 13 (2023), 2814 [22 pp.]
ISSN: 2079-9292

Factor impacto JCR: 2.6 (2023)

Categ. JCR: COMPUTER SCIENCE, INFORMATION SYSTEMS rank: 115 / 249 = 0.462 (2023) - Q2 - T2
Categ. JCR: PHYSICS, APPLIED rank: 81 / 179 = 0.453 (2023) - Q2 - T2
Categ. JCR: ENGINEERING, ELECTRICAL & ELECTRONIC rank: 157 / 352 = 0.446 (2023) - Q2 - T2

Factor impacto CITESCORE: 5.3 - Electrical and Electronic Engineering (Q2) - Hardware and Architecture (Q2) - Signal Processing (Q2) - Computer Networks and Communications (Q2) - Control and Systems Engineering (Q2)

Factor impacto SCIMAGO: 0.644 - Computer Networks and Communications (Q2) - Control and Systems Engineering (Q2) - Signal Processing (Q2) - Hardware and Architecture (Q2) - Electrical and Electronic Engineering (Q2)

Financiación: info:eu-repo/grantAgreement/ES/MCIN/AEI/PID2021-122580NB-I00

Tipo y forma: Article (Published version)