English   español  
Please use this identifier to cite or link to this item: http://hdl.handle.net/10261/30274
Share/Impact:
Statistics
logo share SHARE   Add this article to your Mendeley library MendeleyBASE
Visualizar otros formatos: MARC | Dublin Core | RDF | ORE | MODS | METS | DIDL
Exportar a otros formatos:
Title

Applying categorization to improve learning in complex environments

AuthorsAgostini, Alejandro ; Celaya, Enric
KeywordsReinforcement learning
Categorization
Complex environments
Cybernetics: Artificial intelligence: Generalisation (artificial intelligence)
Automation: Robots: Intelligent robots
Cybernetics: Artificial intelligence: Learning (artificial intelligence)
Machine learning
Intelligent robots and autonomous agents
Automatic theorem proving
Issue Date2004
PublisherUniversidad Politécnica de Cataluña
Citation1a Jornada de Recerca en Automàtica, Visió i Robòtica: 263-268 (2004)
AbstractAn autonomous agent is considered intelligent if it is capable to improve its performance through time, learning by experience. The problem of learning to improve performance from experience has been formalized in the field of Reinforcement Learning. The main difficulty found in this field is that the number of experiences required for learning to take place could be very large depending on the environment structure. If the environment has no structure at all the learning cannot be completed until all actions have been executed at least once in each possible state. Then, the application of reinforcement learning techniques is only fea-sible when the environment presents enough regularity to allow some kind of generalization. Many reinforcement learning techniques have been proposed using different forms of generalization. Despite the diversity of strategies proposed, usual generalization techniques do not take ad-vantage of all the opportunities of generalization. A new algorithm was proposed that exploits a type of regularity that is denoted as categorizability. Categorizability means that from all the relevant features that must be taken into account to decide the best action in any situation, only a few of them are actually relevant in each particular situation. In this paper the categorization and learning capabilities of the algorithm are evaluated using a problem that satisfies to a good extent the categorization property. The categorization achieved is analyzed in detail and illustrated with examples. The algorithm learning performance is compared with those of other learning algorithms. Some improvements of the original algorithm are introduced.
DescriptionJornada de Recerca en Automàtica, Visió i Robòtica (AVR), 2004, Barcelona (España)
URIhttp://hdl.handle.net/10261/30274
ISBN8476538448
Appears in Collections:(IRII) Comunicaciones congresos
Files in This Item:
File Description SizeFormat 
doc1.pdf250,99 kBAdobe PDFThumbnail
View/Open
Show full item record
Review this work
 


WARNING: Items in Digital.CSIC are protected by copyright, with all rights reserved, unless otherwise indicated.