Adaptation to criticality through organizational invariance in embodied agents
Resumen: Many biological and cognitive systems do not operate deep within one or other regime of activity. Instead, they are poised at critical points located at phase transitions in their parameter space. The pervasiveness of criticality suggests that there may be general principles inducing this behaviour, yet there is no well-founded theory for understanding how criticality is generated at a wide span of levels and contexts. In order to explore how criticality might emerge from general adaptive mechanisms, we propose a simple learning rule that maintains an internal organizational structure from a specific family of systems at criticality. We implement the mechanism in artificial embodied agents controlled by a neural network maintaining a correlation structure randomly sampled from an Ising model at critical temperature. Agents are evaluated in two classical reinforcement learning scenarios: the Mountain Car and the Acrobot double pendulum. In both cases the neural controller appears to reach a point of criticality, which coincides with a transition point between two regimes of the agent''s behaviour. These results suggest that adaptation to criticality could be used as a general adaptive mechanism in some circumstances, providing an alternative explanation for the pervasive presence of criticality in biological and cognitive systems.
Idioma: Inglés
DOI: 10.1038/s41598-018-25925-4
Año: 2018
Publicado en: SCIENTIFIC REPORTS 8, 1 (2018), 7723 [11 pp]
ISSN: 2045-2322

Factor impacto JCR: 4.011 (2018)
Categ. JCR: MULTIDISCIPLINARY SCIENCES rank: 14 / 69 = 0.203 (2018) - Q1 - T1
Factor impacto SCIMAGO: 1.414 - Multidisciplinary (Q1)

Financiación: info:eu-repo/grantAgreement/ES/MINECO/PSI2014-62092-EXP
Financiación: info:eu-repo/grantAgreement/ES/MINECO/TIN2016-80347-R
Tipo y forma: Artículo (Versión definitiva)
Área (Departamento): Área Lenguajes y Sistemas Inf. (Dpto. Informát.Ingenie.Sistms.)

Creative Commons Debe reconocer adecuadamente la autoría, proporcionar un enlace a la licencia e indicar si se han realizado cambios. Puede hacerlo de cualquier manera razonable, pero no de una manera que sugiera que tiene el apoyo del licenciador o lo recibe por el uso que hace.


Exportado de SIDERAL (2019-11-22-14:44:50)


Visitas y descargas

Este artículo se encuentra en las siguientes colecciones:
Artículos



 Registro creado el 2018-06-14, última modificación el 2019-11-22


Versión publicada:
 PDF
Valore este documento:

Rate this document:
1
2
3
 
(Sin ninguna reseña)