Deep Middleware for the Divergent Grid

  • Paul Grace
  • Geoff Coulson
  • Gordon S. Blair
  • Barry Porter
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 3790)


Next-generation Grid applications will be highly heterogeneous in nature, will run on many types of computer and device, will operate within and across many heterogeneous network types, and must be explicitly configurable and runtime reconfigurable. We refer to this future Grid environment as the “divergent Grid”. In this paper, we propose a “deep middleware” approach to meeting key requirements of the divergent Grid. Deep middleware reaches down into the network to provide highly flexible network support that underpins a rich, extensible and reconfigurable set of application-level “interaction paradigms” (such as publish-subscribe, multicast, tuple spaces etc.). In our Gridkit middleware platform, these facilities are encapsulated in two key component frameworks: the interaction framework and the overlay framework, which are the subject of this paper. The paper also evaluates the two frameworks in terms of their configurability (e.g. ability to be profiled for different device types) and reconfigurability (e.g. to self-optimise as the environment changes).


Overlay Network Failure Detection Tuple Space Interaction Paradigm Overlay Node 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


  1. 1.
    Andersen, A., Blair, G., Goebel, V., Karlsen, R., Stabell-Kulø, T., Yu, W.: Arctic Beans: Configurable and Reconfigurable Enterprise Component Architectures. IEEE Distributed Systems Online 2(7) (November 2001)Google Scholar
  2. 2.
    Andersen, D., Balakrishnan, H., Kaashoek, M., Morris, R.: The Case for Resilient Overlay Networks. In: Proceedings of the 8th Workshop on Hot Topics in Operating Systems, Elmau, Germany, May 2001, pp. 152–157 (2001)Google Scholar
  3. 3.
    Blair, G., Coulson, G., Andersen, A., Blair, L., Clarke, M., Costa, F., Duran-Limon, H., Fitzpatrick, T., Johnston, L., Moreira, R., Parlavantzas, N., Saikoski, K.: The design and implementation of Open ORB 2. IEEE Distributed Systems Online 2(6) (September 2001)Google Scholar
  4. 4.
    Blair, G., Coulson, G., Grace, P.: Research Directions in Reflective Middleware: the Lancaster Experience. In: Proceedings of the 3rd Workshop on Reflective and Adaptive Middleware (RM 2004), Toronto, Canada, October 2004, pp. 262–267 (2004)Google Scholar
  5. 5.
    Capra, L., Emmerich, W., Mascolo, C.: CARISMA: Context-Aware Reflective mIddleware System for Mobile Applications. IEEE Transactions on Software Engineering 29(10), 929–945 (2003)CrossRefzbMATHGoogle Scholar
  6. 6.
    Castro, M., Druschel, P., Kermarrec, A., Rowstron, A.: SCRIBE: A large-scale and decentralized application-level multicast infrastructure. IEEE Journal on Selected Areas in communications (JSAC) 20(8), 1489–1499 (2002)CrossRefGoogle Scholar
  7. 7.
    Chin, J., Coveney, P.V.: Towards Tractable Toolkits for the Grid: a Plea for Lightweight, Usable Middleware. RealityGrid NeSC Tech Report UKeS-2004-01 (February 2004)Google Scholar
  8. 8.
    Coulson, G., Blair, G., Grace, P., Joolia, A., Lee, K., Ueyama, J.: A Component Model for Building Systems Software. In: Proceedings of the IASTED Conference on Software Engineering and Applications (SEA 2004), Cambridge, MA, USA (November 2004)Google Scholar
  9. 9.
    Coulson, G., Blair, G., Hutchison, D., Joolia, A., Lee, K., Ueyama, J., Gomes, A.T., Ye, Y.: NETKIT: A Software Component-Based Approach to Programmable Networking. ACM SIGCOMM Computer Communications Review (CCR) 33(5), 55–66 (2003)CrossRefGoogle Scholar
  10. 10.
    Dabek, F., Zhao, B., Druschel, P., Kubiatowicz, J., Stoica, I.: Towards a Common API for Structured P2P Overlays. In: Proceedings of the 2nd International Workshop on Peer-to-Peer Systems (IPTPS), Berkeley, CA, USA, February 2003, pp. 33–44 (2003)Google Scholar
  11. 11.
    Davies, N., Friday, A., Storz, O.: Exploring the Grid’s Potential for Ubiquitous Computing. IEEE Pervasive Computing 3(2), 74–75 (2004), see also:
  12. 12.
    Doval, D., O’Mahony, D.: Overlay Networks: A Scalable Alternative for P2P. IEEE Internet Computing 7(4), 79–82 (2003)CrossRefGoogle Scholar
  13. 13.
    Furmento, N., Mayer, A., McGough, S., Newhouse, S., Field, T., Darlington, J.: ICENI: Optimisation of Component Applications within a Grid Environment. Parallel Computing 28(12), 1753–1772 (2002)CrossRefzbMATHGoogle Scholar
  14. 14.
    Gnutella Protocol Specification v0.6,
  15. 15.
    Grace, P., Coulson, G., Blair, G., Mathy, L., Yeung, W.K., Cai, W., Duce, D., Cooper, C.: GRIDKIT: Pluggable Overlay Networks for Grid Computing. In: Proceedings of the International Symposium on Distributed Objects and Applications (DOA 2004), Cyprus, October 2004, pp. 1463–1481 (2004)Google Scholar
  16. 16.
    Hiltunen, M., Schlichting, R.: A Configurable Membership Service. IEEE Transactions on Computers 47(5), 573–586 (1998)CrossRefGoogle Scholar
  17. 17.
    Hughes, D., Warren, I., Coulson, G.: AGnuS: The Altruistic Gnutella Server. In: Proceedings of the 3rd International Conference on Peer-to-Peer Computing (P2P 2003), Linkoping, Sweden, September 2003, pp. 202–203 (2003)Google Scholar
  18. 18.
    Hutchinson, N., Peterson, L.: The x-kernel: An Architecture for Implementing Network Protocols. IEEE Transactions on Software Engineering 17(1), 64–76 (1991)CrossRefGoogle Scholar
  19. 19.
    Kon, F., Roman, M., Liu, P., Mao, J., Yamane, T., Magalhaes, L., Campbell, R.: Monitoring, Security, and Dynamic Configuration with the dynamicTAO Reflective ORB. In: Proceedings of the 2nd ACM/IFIP International Conference on Middleware, New York, April 2000, pp. 121–143 (2000)Google Scholar
  20. 20.
    Li, B., Guo, J., Wang, M.: iOverlays: A Lightweight Middleware Infrastructure for Overlay Application Implementations. In: Proceedings of the 5th ACM/IFIP/USENIX International Conference on Middleware, Toronto, Canada, November 2004, pp. 135–154 (2004)Google Scholar
  21. 21.
    Mathy, L., Canonico, R., Hutchinson, D.: An Overlay Tree Building Control Protocol. In: Proceedings of the 3rd International COST264 Workshop on Networked Group Communication, London, UK, November 2001, pp. 76–87 (2001)Google Scholar
  22. 22.
    Miranda, H., Rodrigues, L.: Communication Support for Multiple QoS Requirements. In: Proceedings of the 3rd European Research Seminar on Advances in Distributed Systems (ERSADS 1999), Madeira Island, Portugal (April 1999)Google Scholar
  23. 23.
    ISO Reference Model for Open Distributed Processing,
  24. 24.
    Parlavantzas, N., Coulson, G., Blair, G.: An Extensible Binding Framework for Component-Based Middleware. In: Proceedings of the 7th IEEE International Enterprise Distributed Object Computing Conference (EDOC 2003), Brisbane, Australia, September 2003, pp. 252–263 (2003)Google Scholar
  25. 25.
    Roman, M., Islam, N.: Dynamically Programmable and Reconfigurable Middleware Services. In: Proceedings of the 5th ACM/IFIP/USENIX International Conference on Middleware, Toronto, Canada, November 2004, pp. 372–396 (2004)Google Scholar
  26. 26.
    Roman, M., Kon, F., Campbell, R.: Reflective Middleware: From Your Desk to Your Hand. IEEE Distributed Systems Online 2(5) (August 2001)Google Scholar
  27. 27.
    Sadjadi, S., McKinley, P., Kasten, E.: Architecture and Operation of an Adaptable Communication Substrate. In: Proceedings of the 9th IEEE International Workshop on Future Trends of Distributed Computing Systems (FTDCS 2003), San Juan, Puerto Rico, May 2003, pp. 46–55 (2003)Google Scholar
  28. 28.
    Stoica, I., Morris, R., Karger, D., Kaashoek, M., Balakrishnan, H.: Chord: A Scalable Peer-to-Peer Lookup Service for Internet Applications. In: Proceedings of the ACM SIGCOMM 2001 Conference, San Diego, CA, USA, August 2001, pp. 149–160 (2001)Google Scholar
  29. 29.
    van Renesse, R., Birman, K., Hayden, M., Vaysburd, A., Karr, D.: Adaptive Systems Using Ensemble. Software Practice and Experience 28(9), 963–979 (1998)CrossRefGoogle Scholar
  30. 30.
    van Renesse, R., Birman, K., Maffeis, S.: Horus, a Flexible Group Communication System. Communications of the ACM 39(4), 76–83 (1996)CrossRefGoogle Scholar
  31. 31.
    van Renesse, R., Minsky, Y., Hayden, M.: A Gossip-Based Failure Detection Service. In: Proceedings of the 1st IFIP International Conference on Middleware, Lake District, UK, September 1998, pp. 55–70 (1998)Google Scholar
  32. 32.
    Wojciechowski, P., Rutti, O., Schiper, A.: SAMOA: A Framework for a Synchronisation-Augmented Microprotocol Approach. In: Proceedings of the 18th IEEE Parallel and Distributed Processing Symposium, Santa Fe, New Mexico (April 2004)Google Scholar

Copyright information

© IFIP International Federation for Information Processing 2005

Authors and Affiliations

  • Paul Grace
    • 1
  • Geoff Coulson
    • 1
  • Gordon S. Blair
    • 1
  • Barry Porter
    • 1
  1. 1.Computing DepartmentLancaster UniversityLancasterUK

Personalised recommendations