English   español  
Please use this identifier to cite or link to this item: http://hdl.handle.net/10261/127467
Share/Impact:
Statistics
logo share SHARE logo core CORE   Add this article to your Mendeley library MendeleyBASE

Visualizar otros formatos: MARC | Dublin Core | RDF | ORE | MODS | METS | DIDL
Exportar a otros formatos:

Title

Online EM with weight-based forgetting

AuthorsCelaya, Enric ; Celaya, Enric ; Agostini, Alejandro
KeywordsForgetting factor
On-line EM
Local representations
Biased sampling
NGnet
Issue Date2015
PublisherMassachusetts Institute of Technology
CitationNeural Computation 27(5): 1142-1157 (2015)
AbstractIn the online version of the EM algorithm introduced by Sato and Ishii (2000), a time-dependent discount factor is introduced for forgetting the effect of the old estimated values obtained with an earlier, inaccurate estimator. In their approach, forgetting is uniformly applied to the estimators of each mixture component depending exclusively on time, irrespective of theweight attributed to each unit for the observed sample. This causes an excessive forgetting in the less frequently sampled regions. To address this problem, we propose a modification of the algorithm that involves a weight-dependent forgetting, different for each mixture component, in which old observations are forgotten according to the actual weight of the new samples used to replace older values. A comparison of the timedependent versus the weight-dependent approach shows that the latter improves the accuracy of the approximation and exhibits much greater stability.
Publisher version (URL)http://dx.doi.org/10.1162/NECO_a_00723
URIhttp://hdl.handle.net/10261/127467
DOI10.1162/NECO_a_00723
Identifiersdoi: 10.1162/NECO_a_00723
issn: 0899-7667
e-issn: 1530-888X
Appears in Collections:(IRII) Artículos
Files in This Item:
File Description SizeFormat 
On-lineEM.pdf483,38 kBAdobe PDFThumbnail
View/Open
Show full item record
Review this work
 

Related articles:


WARNING: Items in Digital.CSIC are protected by copyright, with all rights reserved, unless otherwise indicated.