English   español  
Please use this identifier to cite or link to this item: http://hdl.handle.net/10261/27730
logo share SHARE   Add this article to your Mendeley library MendeleyBASE
Visualizar otros formatos: MARC | Dublin Core | RDF | ORE | MODS | METS | DIDL | DATACITE
Exportar a otros formatos:


Knocking down some assumptions about the effectos of evaluation systems on publications

AuthorsOsuna, Carmen CSIC; Cruz Castro, Laura CSIC ORCID ; Sanz Menéndez, Luis CSIC ORCID
KeywordsResearch evaluation systems
Scientific production
Effects of evaluations
Quasi-experimental design
Issue Date2010
PublisherConsejo Superior de Investigaciones Científicas (España)
CitationKnocking down some Assumptions about the Effects of Evaluation Systems on Publications, Serie Documentos de Trabajo, Instituto de Políticas y Bienes Públicos (CSIC), 10-2010
SeriesDocumento de Trabajo IPP, 10-2010
AbstractIn 1989 the Spanish Government established an individual retrospective research evaluation system (RES) for public researchers. This system was voluntary but involved the incentive of a permanent salary bonus. Policy makers have associated the establishment of this evaluation system with the signifi cant increase in the volume of scientifi c publications attributed to Spain over the last decades. In a similar vein to the analyses of other country cases, some scholars have also claimed that the growth of Spain’s international scientifi c publications is a result of the establishment of the new evaluation system. In this paper, we provide a methodological revision of the validity threats in previous research, including some interrupted time series analyses and control groups to investigate the effects of this policy instrument on the number of papers produced by Spanish authors. In the years following the establishment of the evaluation system, the results indicate a considerable increase in the number of papers attributed to Spanish authors among those eligible for evaluation (the “treated” group), but also in the control publications cannot be attributed indisputably to the effect of the establishment of the RES, but rather to the increase of expenditure and number of researchers in the Spanish R&D system along with some maturation effects. We take this case as an example of the need to improve and refi ne methodologies and to be more cautious when attributing effects to research evaluation mechanisms at the national level.
Publisher version (URL)http://ipp.csic.es/es/workpaper/knocking-down-some-assumptions-about-effects-evaluation-systems-publications
Appears in Collections:(CCHS-IPP) Informes y documentos de trabajo
Files in This Item:
File Description SizeFormat 
Evaluation_Systems_Publications.pdf235,67 kBAdobe PDFThumbnail
Show full item record
Review this work

WARNING: Items in Digital.CSIC are protected by copyright, with all rights reserved, unless otherwise indicated.