Please use this identifier to cite or link to this item:
logo share SHARE BASE
Visualizar otros formatos: MARC | Dublin Core | RDF | ORE | MODS | METS | DIDL | DATACITE

Applying categorization to improve learning in complex environments

AuthorsAgostini, Alejandro CSIC ORCID; Celaya, Enric CSIC
KeywordsReinforcement learning
Complex environments
Cybernetics: Artificial intelligence: Generalisation (artificial intelligence)
Automation: Robots: Intelligent robots
Cybernetics: Artificial intelligence: Learning (artificial intelligence)
Machine learning
Intelligent robots and autonomous agents
Automatic theorem proving
Issue Date2004
PublisherUniversidad Politécnica de Cataluña
Citation1a Jornada de Recerca en Automàtica, Visió i Robòtica: 263-268 (2004)
AbstractAn autonomous agent is considered intelligent if it is capable to improve its performance through time, learning by experience. The problem of learning to improve performance from experience has been formalized in the field of Reinforcement Learning. The main difficulty found in this field is that the number of experiences required for learning to take place could be very large depending on the environment structure. If the environment has no structure at all the learning cannot be completed until all actions have been executed at least once in each possible state. Then, the application of reinforcement learning techniques is only fea-sible when the environment presents enough regularity to allow some kind of generalization. Many reinforcement learning techniques have been proposed using different forms of generalization. Despite the diversity of strategies proposed, usual generalization techniques do not take ad-vantage of all the opportunities of generalization. A new algorithm was proposed that exploits a type of regularity that is denoted as categorizability. Categorizability means that from all the relevant features that must be taken into account to decide the best action in any situation, only a few of them are actually relevant in each particular situation. In this paper the categorization and learning capabilities of the algorithm are evaluated using a problem that satisfies to a good extent the categorization property. The categorization achieved is analyzed in detail and illustrated with examples. The algorithm learning performance is compared with those of other learning algorithms. Some improvements of the original algorithm are introduced.
DescriptionJornada de Recerca en Automàtica, Visió i Robòtica (AVR), 2004, Barcelona (España)
Appears in Collections:(IRII) Comunicaciones congresos

Files in This Item:
File Description SizeFormat
doc1.pdf250,99 kBAdobe PDFThumbnail
Show full item record
Review this work

Page view(s)

checked on May 26, 2022


checked on May 26, 2022

Google ScholarTM



WARNING: Items in Digital.CSIC are protected by copyright, with all rights reserved, unless otherwise indicated.