Digital.CSIC > Ciencia y Tecnologías Físicas > Instituto de Física de Cantabria (IFCA) > (IFCA) Libros y partes de libros >




Open Access item Merging on-demand HPC resources from Amazon EC2 with the grid: a case study of a Xmipp application

Authors:Lorca, Alejandro
Martín-Caro, Javier
Núñez-Ramírez, Rafael
Martínez-Salazar, Javier
Issue Date:Jun-2011
Citation:IBERGRID: 85-96 (2011)
Abstract:We present an infrastructure in which HPC resources from the Amazon Web Services public cloud are combined with specific grid resources at Ibergrid. The integration is done transparently for the GridWay users through a daemon which permanently monitors the pool of available resources and submitted jobs, managing virtual instances for satisfying the demand under budget restrictions. The study has been proved with a specific application from the Xmipp package, which performs image processing from electron microscopy data and requires heavy high-throughput computing offering parallelization capabilities. The application was ported successfully for such a hybrid framework with the help of the MPI-Start package. Some preliminary results from test runs are presented for a controlled sample of thousand input images. Some inconveniences and troublesome aspects of the deployment are also reported.
Description:12 páginas, 5 figuras, 4 tablas.-- Trabajo presentado al 5th Iberian Grid Infrastructure Conference celebrado en Santander (España) del 8 al 10 de junio de 2011.
Publisher version (URL):http://dx.doi.org/10.4272/978-84-9745-884-9
Appears in Collections:(CFMAC-IEM) Libros y partes de libros
(SGAI) Libros y partes de libros
(IFCA) Libros y partes de libros

Items in DSpace are protected by copyright, with all rights reserved, unless otherwise indicated.