Abstract
The advent of Cloud computing has given to researchers the ability to access resources that satisfy their growing needs, which could not be satisfied by traditional computing resources such as PCs and locally managed clusters. On the other side, such ability, has opened new challenges for the execution of their computational work and the managing of massive amounts of data into resources provided by different private and public infrastructures.
COMP Superscalar (COMPSs) is a programming framework that provides a programming model and a runtime that ease the development of applications for distributed environments and their execution on a wide range of computational infrastructures. COMPSs has been recently extended in order to be interoperable with several cloud technologies like Amazon, OpenNebula, Emotive and other OCCI compliant offerings.
This paper presents the extensions of this interoperability layer to support the execution of COMPSs applications into the Windows Azure Platform. The framework has been evaluated through the porting of a data mining workflow to COMPSs and the execution on an hybrid testbed.
Chapter PDF
Similar content being viewed by others
References
European Grid Infrastructure, http://www.egi.eu
StratusLab, http://www.stratuslab.eu
European Middleware Initiative, http://www.eu-emi.eu
Microsoft Azure, http://www.microsoft.com/azure
Amazon Elastic Compute Cloud, http://aws.amazon.com/es/ec2
Virtual multidisciplinary ENvironments USing Cloud infrastructures, http://www.venus-c.eu
Tejedor, E., Badia, R.M.: COMP Superscalar: Bringing GRID superscalar and GCM Together. In: IEEE Int. Symposium on Cluster Computing and the Grid, Lyon, France (2008)
Lezzi, D., Rafanell, R., Carrion, A., Blanquer, I., Badia, R.M., Hernandez, V.: Enabling e-Science applications on the Cloud with COMPSs. Cloud Computing: Project and Initiatives (2011)
Open Cloud Computing Interface Working Group, http://www.occi-wg.org
Distributed Management Task Force Inc., Open Virtualization Format Specification v1.1. DMT Standar DSP0243 (2010)
Allen, G., Davis, K., Goodale, T., Hutanu, A., Kaiser, H., Kielmann, T., Merzky, A., van Nieuwpoort, R., Reinefeld, A., Schintke, F., Schütt, T.T., Seidel, E., Ullmer, B.: The Grid Application Toolkit: Towards Generic and Easy Application Programming Interfaces for the Grid. Proceedings of the IEEE 93(3) (March 2005)
Marozzo, F., Talia, D., Trunfio, P.: A Cloud Framework for Parameter Sweeping Data Mining Applications. In: 3rd IEEE Int. Conference on Cloud Computing Technology and Science (CloudCom 2011), Athens, Greece (2011)
Witten, H., Frank, E.: Data Mining: Practical machine learning tools with Java implementations. Morgan Kaufmann Publishers (2000)
Quinlan, J.R.: C4.5: Programs for Machine Learning. Morgan Kaufmann Publishers (1993)
Goiri, I., Guitart, J., Torres, J.: Elastic Management of Tasks in Virtualized Environments. In: XX Jornadas de Paralelismo (JP 2009), Coruña, Spain (2009)
GlusterFS Distributed Network File System, http://www.gluster.org
Dean, J., Ghemawat, S.: MapReduce: simplified data processing on large clusters. Commun. ACM 51, 107–113 (2008)
Apache Hadoop, http://hadoop.apache.org
Hadoop on Azure, https://www.hadooponazure.com
Project Daytona, http://research.microsoft.com/en-us/projects/daytona
Google App Engine, http://code.google.com/intl/de/appengine
Ekanayake, J., Li, H., Zhang, B., Gunarathne, T., Bae, S., Qiu, J., Fox, G.: Twister: A Runtime for Iterative MapReduce. In: 1st Int. Workshop on MapReduce and its Applications (MAPREDUCE 2010), Chicago, USA (2010)
Wei, Y., Sukumar, K., Vecchiola, C., Karunamoorthy, D., Buyya, R.: Aneka Cloud Application Platform and Its Integration with Windows Azure. CoRR, abs/1103.2590 (2011)
Simmhan, Y., Ingen, C., Subramanian, G., Li, J.: Bridging the Gap between Desktop and the Cloud for eScience Applications. In: 3rd IEEE Int. Conference on Cloud Computing (CLOUD 2010), Washington, USA (2010)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2012 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Marozzo, F., Lordan, F., Rafanell, R., Lezzi, D., Talia, D., Badia, R.M. (2012). Enabling Cloud Interoperability with COMPSs. In: Kaklamanis, C., Papatheodorou, T., Spirakis, P.G. (eds) Euro-Par 2012 Parallel Processing. Euro-Par 2012. Lecture Notes in Computer Science, vol 7484. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-32820-6_4
Download citation
DOI: https://doi.org/10.1007/978-3-642-32820-6_4
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-32819-0
Online ISBN: 978-3-642-32820-6
eBook Packages: Computer ScienceComputer Science (R0)