Abstract
The volumes and velocity of data are growing at unprecedented rates, often physically distributed, have access constraints, and requirements to leverage the diverse computational fabrics like clouds and grids. The Meandre data-intensive component-based application infrastructure can leverage diversity and enables extremely scalable server clusters and applications to address these challenges. Data-intensive flows can: be web-services and/or computational tasks; co-locate processing with data; orchestrate cloud computing resources; and leverage grid resources with distributed execution. Meandre from a laptop to a cloud, grid, or server as analytical computational tasks and/or web-services in data-intensive flows made up of components that provide deployment and execution strategies for extreme scalability.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Beynon, M.D., Kurc, T., Sussman, A., Saltz, J.: Design of a framework for data-intensive wide-area applications. In: HCW 2000: Proceedings of the 9th Heterogeneous Computing Workshop, p. 116. IEEE Computer Society, Washington, DC (2000)
Dean, J., Ghemawat, S.: MapReduce: Simplified Data Processing on Large Clusters. In: OSDI 2004: Sixth Symposium on Operating System Design and Implementation (2004)
Foster, I.: The virtual data grid: A new model and architecture for data-intensive collaboration. In: The 15th International Conference on Scientific and Statistical Database Management, p. 11 (2003)
Haller, P., Odersky, M.: Scala actors: Unifying thread-based and event-based programming. Theoretical Computer Science (2008), doi:10.1016/j.tcs, 09.019
Llorà, X., Àcs, B., Auvil, L., Capitanu, B., Welge, M., Goldberg, D.E.: Meandre: Semantic-driven data-intensive flows in the clouds. In: Proceedings of the 4th IEEE International Conference on e-Science, pp. 238–245. IEEE Press, Los Alamitos (2008)
Ács, B., Llorà, X., Auvil, L., Capitanu, B., Tcheng, D., Haberman, M., Dong, L., Wentling, T., Welge, M.: A general approach to data-intensive computing using the Meandre component-based framework. In: Proceedings of the 1st International Workshop on Workflow Approaches To New Data-Centric Science, Indianapolis, Indiana, June 06, pp. 1–12. ACM, New York (2010)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2011 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Ács, B. et al. (2011). Meandre Data-Intensive Application Infrastructure: Extreme Scalability for Cloud and/or Grid Computing. In: Onada, T., Bekki, D., McCready, E. (eds) New Frontiers in Artificial Intelligence. JSAI-isAI 2010. Lecture Notes in Computer Science(), vol 6797. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-25655-4_22
Download citation
DOI: https://doi.org/10.1007/978-3-642-25655-4_22
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-25654-7
Online ISBN: 978-3-642-25655-4
eBook Packages: Computer ScienceComputer Science (R0)