English   español  
Please use this identifier to cite or link to this item: http://hdl.handle.net/10261/197395
logo share SHARE logo core CORE   Add this article to your Mendeley library MendeleyBASE

Visualizar otros formatos: MARC | Dublin Core | RDF | ORE | MODS | METS | DIDL
Exportar a otros formatos:


A framework for evaluation in learning from label proportions

AuthorsHernández-González, Jerónimo
KeywordsLearning from label proportions
Weakly supervised classification
Evaluation metrics
Issue Date10-May-2019
PublisherSpringer Nature
CitationProgress in Artificial Intelligence 8: 359–373 (2019)
AbstractIn the subfield of weakly supervised learning, the problem of learning from label proportions has received growing attention in the machine learning community. Learning from the type of data characteristic of this problem requires specific learning methodologies. Nowadays, the state of the art includes many different techniques to learn the most typical types of classifiers from proportions of labels. However, for the sake of simplicity, all these contributions use synthetic data to validate the proposed learning techniques. Evaluation with real label proportions data has barely been explored. This paper proposes a whole framework for model validation and evaluation when only data labeled with label proportions are available. An approximation to the number of true positive examples is proposed based on a reasonable assumption, which enables the completion of a confusion matrix and thus, the calculation of all the standard evaluation metrics. Additionally, a discussion on the performance of different approaches to cross-validation in this specific problem is presented. Both large empirical studies have been carried out to support the discussion on the contributions of this work.
Publisher version (URL)http://dx.doi.org/10.1007/s13748-019-00187-x
Appears in Collections:(IIIA) Artículos
Files in This Item:
File Description SizeFormat 
accesoRestringido.pdf15,35 kBAdobe PDFThumbnail
Show full item record
Review this work

WARNING: Items in Digital.CSIC are protected by copyright, with all rights reserved, unless otherwise indicated.