Abstract
We review several aspects of building real-time streaming data Grid applications. Building on general purpose messaging system software (NaradaBrokering) and generalized collaboration services (GlobalMMCS), we are developing a diverse set of interoperable capabilities. These include dynamic information systems for managing short-lived collaborative service collections (“gaggles”), stream filters to support the integration of Geographical Information Systems services with data analysis applications, streaming video to support collaborative geospatial maps with time-dependent data, and video stream playback and annotation services to enable scientific collaboration.
(Invited Paper)
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Shrideep Pallickara and Geoffrey Fox. NaradaBrokering: A Middleware Framework and Architecture for Enabling Durable Peer-to-Peer Grids. Proceedings of ACM/IFIP/USENIX International Middleware Conference Middleware-2003.
Shrideep Pallickara and Geoffrey Fox. A Scheme for Reliable Delivery of Events in Distributed Middleware Systems. Proceeding sof the IEEE International Conference on Autonomic Computing. 2004.
Shrideep Pallickara, Geoffrey Fox and Harshawardhan Gadgil. On the Creation & Discovery of Topics in Distributed Publish/Subscribe systems. (To appear) Proceedings of the IEEE/ACM GRID 2005. Seattle, WA.
Wenjun Wu, Geoffrey Fox, Hasan Bulut, Ahmet Uyar, Harun Altay “Design and Implementation of A Collaboration Web-services system”, Journal of Neural, Parallel & Scientific Computations (NPSC), Volume 12, 2004. See also http://www.globalmmcs.org.
GIS Research at Community Grids Lab, web site: www.crisisgrid.org
Geoffrey Fox, Galip Aydin, Harshawardhan Gadgil, Shrideep Pallickara, Marlon Pierce, and Wenjun Wu. Management of Real-Time Streaming Data Grid Services. Invited talk at Fourth International Conference on Grid and Cooperative Computing (GCC2005), held in Beijing, China, during Nov 30–Dec 3, 2005.
Geoffrey Fox. The Rule of the Millisecond in CISE Magazine. Vol 6, No 2, pp 93–96 (2004).
Berman, F., Fox, G., and Hey, T., (eds.). Grid Computing: Making the Global Infrastructure a Reality, John Wiley & Sons, Chichester, England, ISBN 0-470-85319-0 (2003). http://www.grid2002.org.
Geoffrey Fox, Shrideep Pallickara, and Marlon Pierce. Building a Grid of Grids: Messaging Substrates and Information Management. To appear as chapter in book “Grid Computational Methods” Edited by M.P. Bekakos, G.A. Gravvanis and H.R. Arabnia.
Galip Aydin, Mehmet S. Aktas, Geoffrey C. Fox, Harshawardhan Gadgil, Marlon Pierce, Ahmet Sayar SERVOGrid Complexity Computational Environments (CCE) Integrated Performance Analysis Technical report June 2005 accepted as poster and short paper in Grid2005 Workshop, 2005.
B. Plale, P. Dinda, and G. Von Laszewski., Key Concepts and Services of a Grid Information Service. In Proceedings of the 15th International Conference on Parallel and Distributed Computing Systems (PDCS 2002), 2002.
Mehmet S. Aktas, Geoffrey Fox, Marlon Pierce Managing Dynamic Metadata as Context Istanbul International Computational Science and Engineering Conference (ICCSE2005) June 2005 also please see: http://www.opengrids.org/fthpis.
Bellwood, T., Clement, L., and von Riegen, C. (eds) (2003), UDDI Version 3.0.1: UDDI Spec Technical Committee Specification. Available from http://uddi.org/pubs/uddi-v3.0.1-20031014.htm.
Bunting, B., Chapman, M., Hurlery, O., Little M., Mischinkinky, J., Newcomer, E., Webber J., and Swenson, K., Web Services Context (WS-Context), available from http://www.arjuna.com/library/specs/ws_caf_1-0/WS-CTX.pdf.
Mehmet S. Aktas, Galip Aydin, Geoffrey C. Fox, Harshawardhan Gadgil, Marlon Pierce, Ahmet Sayar, Information Services for Grid/Web Service Oriented Architecture (SOA) Based Geospatial Applications, Technical Report, June, 2005.
Mehmet S. Aktas, Geoffrey C. Fox, Marlon Pierce, “An Architecture for Supporting Information in Dynamically Assembled Semantic Grids”, Technical report August 2005. Available at thttp://grids.ucs.indiana.edu/ptliupages/publications/SKG2005_Aktas.pdf.
D. Estrin, R. Govindan, J. Heidemann and S. Kumar, “Next Century Challenges: Scalable Coordination in Sensor Networks,” In Proceedings of the Fifth Annual International Conference on Mobile Computing and Networks (MobiCOM’ 99), August 1999, Seattle, Washington.
Akyildiz, I. F., Su, W., Sankarasubramaniam, Y., and Cayirci, E., “A Survey on Sensor Networks” IEEE Communications Magazine, August 2002.
Archana Bharathidasan, Vijay Anand Sai Ponduru, “Sensor Networks: An Overview”.
Bock, Y., Prawirodirdjo, L, Melbourne, T I.: “Detection of arbitrarily large dynamic ground motions with a dense high-rate GPS network” GEOPHYSICAL RESEARCH LETTERS, VOL. 31, 2004.
Southern California Integrated GPS Network web site: http://www.scign.org/.
Scripps Orbit and Permanent Array Center web site: http://sopac.ucsd.edu/.
The Geography Markup Language described in an Encoding Specification from Open Geospatial Consortium available from http://portal.opengeospatial.org/files/?artifact_id=4700.
Open Geospatial Consortium Discussion Paper, Editor Simon Cox: “Observations and Measurements”. OGC Document Number: OGC 03-022r3.
The Open Geospatial Consortium, Inc. web site: http://www.opengeospatial.org/.
Chiu, K., Govindaraju, M., and Bramley, R.: Investigating the Limits of SOAP Performance for Scientific Computing, Proc. of 11th IEEE International Symposium on High Performance Distributed Computing HPDC-11 (2002) 256.
Oh, S., Bulut, H., Uyar, A., Wu, W., Fox G., Optimized Communication using the SOAP Infoset For Mobile Multimedia Collaboration Applications. In proceedings of the International Symposium on Collaborative Technologies and Systems CTS05 (2005).
R. Berjon, chair, “XML Binary Characterization Working Group Public Page.” Available from http://www.w3c.org/XML/Binary/
Paul Sandoz, Alessando Triglia, and Santiago Pericas-Geertsen, “Fast Infoset.” Avaialble from http://java.sun.com/developer/technicalArticles/xml/fastinfoset/.
Jeff De La Beaujardiere, OpenGIS Consortium Web Mapping Server Implementation Specification 1.3, OGC Document #04-024, August 2002.
Ahmet Sayar, Marlon Pierce, Geoffrey Fox OGC Compatible Geographical Information Services Technical Report (Mar 2005), Indiana Computer Science Report TR610.
H. Schulzrinne, S. Casner, R. Frederick, and V. Jacobson, RTP: A Transport Protocol for Real-Time Applications. Internet Engineering Task Force Request for Comments 3550 (2003). http://www.ietf.org/rfc/rfc3550.txt
H. Schulzrinne, A. Rao, and R. Lanphier, Real Time Streaming Protocol (RTSP), Internet Engineering Task Force Request For Comments 2326 (1998). http://www.ietf.org/rfc/rfc2326.txt
RealNetworks Helix Server http://www.realnetworks.com/
QuickTime Streaming Server http://www.apple.coin/quicktime/streamingserver/
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2006 Springer Science+Business Media, Inc.
About this paper
Cite this paper
Fox, G.C. et al. (2006). Real Time Streaming Data Grid Applications. In: Davoli, F., Palazzo, S., Zappatore, S. (eds) Distributed Cooperative Laboratories: Networking, Instrumentation, and Measurements. Signals and Communication Technology. Springer, Boston, MA. https://doi.org/10.1007/0-387-30394-4_17
Download citation
DOI: https://doi.org/10.1007/0-387-30394-4_17
Publisher Name: Springer, Boston, MA
Print ISBN: 978-0-387-29811-5
Online ISBN: 978-0-387-30394-9
eBook Packages: EngineeringEngineering (R0)