English   español  
Please use this identifier to cite or link to this item: http://hdl.handle.net/10261/30210
logo share SHARE   Add this article to your Mendeley library MendeleyBASE
Visualizar otros formatos: MARC | Dublin Core | RDF | ORE | MODS | METS | DIDL
Exportar a otros formatos:


Learning in categorizable environments

AuthorsPorta, Josep M. ; Porta, Josep M. ; Celaya, Enric ; Celaya, Enric
KeywordsAutomation: Robots
Issue Date2000
PublisherMassachusetts Institute of Technology
Citation6th International Conference on Simulation of Adaptative Behavior: 343-352 (2000)
AbstractEfficient learning in animats living in complex environments can only be achieved if we depart from more restrictive initial hypothesis about the environment than the ones usually assumed in standard Reinforcement Learning. In this paper, we observe that in realistic situations the main part of the sensory information available for the robot is irrelevant to determine the effects of an animat's action and that, consequently, those effects can be correctly foreseen attaining to only few of the animat sensors. The environments in which this condition holds are called categorizable environments. In this kind of environments, the reinforcement learning problem can be redefined from the usual state-action evaluation approach to an approach in which the objective is to determine the relevance of the sensors with respect to each action (and, of course, the expected reward for each action). We present an animat control system based on that analysis that is able to find the conditions from which the effect of each action can be determined. The system focus its attention to the situations and actions that result more critical for the animat. Additionally, it tries to efficiently use the scarcely presented opportunities to learn interesting things. Results of the application of this animat control architecture to the task of step coordination in a simulated six legged robot walking on flat an rough terrain are presented.
DescriptionInternational Conference on Simulation of Adaptative Behavior (SAB), 2000, París Francia)
Appears in Collections:(IRII) Comunicaciones congresos
Files in This Item:
File Description SizeFormat 
doc1.pdf412,23 kBAdobe PDFThumbnail
Show full item record
Review this work

WARNING: Items in Digital.CSIC are protected by copyright, with all rights reserved, unless otherwise indicated.