Abstract
The data diffusion space (DDS) is an all-software shared address space for parallel computing on distributed memory platforms. It is an extra address space to that of each process running a parallel application under the SPMD (Single Program Multiple Data) model. The size of DDS can be up to 264 bytes, either on 32- or on 64-bit architectures. Data laid on DDS diffuses, or migrates and replicates, in the memory of each processor using the data. This data is used through an interface similar to that used to access data in files.
We have implemented DDS for PC clusters with Linux. However, being all-software, DDS should require little change to make it immediately usable in other distributed memory platforms and operating systems. We present experimental results on the performance of two applications both under DDS and under MPI (Message Passing Interface). DDS tends to perform better in larger processor counts, and is simpler to use than MPI for both in-core and out-of-core computation.
Chapter PDF
Similar content being viewed by others
Keywords
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.
References
Agarwal, A., et al.: The MIT Alewife Machine: Architecture and Performance. In: Proceedings of the 22nd ISCA, pp. 943–952 (1995)
Bal, H.E., Kaashoek, M.F., Tanenbaum, A.S.: ORCA: A Languaje for Parallel Programming of Distributed Systems. IEEE Transactions on Software Engineering, 190–205 (March 1992)
Bershad, B.N., Zekauskas, M.J., Sawdon, W.A.: The midway distributed shared memory system. In: Proceedings of COMPCON 1993, pp. 528–537 (1993)
Buenabad-Chávez, J., Muller, H.L., Stallard, P.W.A., Warren, D.H.D.: Virtual memory on data diffusion architectures. Parallel Computing 29, 1021–1052 (2003)
Joe, T.: COMA-F: A Non-hierarchical Cache Only Memory Architecture. Stanford University Department of Electrical Engineering. PhD Thesis (1995)
Johnson, K.L., Kaashoek, M.F., Wallach, D.A.: CRL: High-Performance All- Software Distributed Shared Memory. In: Proceedings of the 5th SOSP (1995)
Lenoski, D., Laudon, J., Gharachorloo, K., Gupta, A., Hennessy, J.: The Directory-Based Cache Coherence Protocol for the DASH Multiprocessor. In: Proceedings of the 17th ISCA, pp. 148–159 (1990)
Li, K.: Shared Virtual Memory Systems on Loosely Coupled Multiprocessors (IVY). Yale University. PhD thesis (1986)
Laudon, J., Lenoski, D.: The SGI Origin: A ccNUMA Highly Scalable Server. In: Proceedings of the 24th ISCA, pp. 241–251 (1997)
Manoj, N.P., Manjunath, K.V., Govindarajano, R.: CAS-DSM: A compiler assisted sofware distributed shared memory. International Journal of Parallel Programming 32, 77–122 (2004)
Marino, M.D., Lino de Campos, G.: A speedup comparative study: three third generation DSM systems. In: Proceedings of the 7th International Conference on Parallel and Distributed Systems,Workshops, pp. 153–158 (2000)
MPI: The Message Passing Interface, http://www-unix.mcs.anl.gov/mpi/
MPI-2: Extensions to the Message-Passing Interface , http://www.mpiforum.org/docs/docs.html
PVFS: The Parallel Virtual File System, http://parlweb.parl.clemson.edu/pvfs/
PVM: Parallel Virtual Machine , http://www.epm.ornl.gov/pvm/pvmhome.html
Scales, D.J., Gharachorloo, K., Thekkath, C.A.: Shasta: A Low Overhead, Software-Only Approach for Supporting Fine-Grain Shared Memory. In: Proceedings of the 7th ASPLOS, pp. 174–185 (1996)
Swanson, M., Stoller, L., Carter, J.: Making distributed shared memory simple, yet efficient. In: proceedings of the Third International Workshop on High-Level Parallel Programming Models and Supportive Environments, pp. 2–13 (1998)
Thakur, R., Lusk, E., Gropp, W.: Users Guide for ROMIO: A High- Performance, Portable MPI-IO Implementation. Technical Report 234, Mathematics and Computer Science Division, Argonne National Laboratory (1997)
Warren, D.H.D., Haridi, S.: DATA DIFFUSION MACHINE: A Scalable Shared Virtual Memory Multiprocessor. In: Proceedings of the International Conference on Fifth Generation Computer Systems, pp. 943–952 (1988)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2005 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Buenabad-Chávez, J., Domínguez-Domínguez, S. (2005). The Data Diffusion Space for Parallel Computing in Clusters. In: Cunha, J.C., Medeiros, P.D. (eds) Euro-Par 2005 Parallel Processing. Euro-Par 2005. Lecture Notes in Computer Science, vol 3648. Springer, Berlin, Heidelberg. https://doi.org/10.1007/11549468_10
Download citation
DOI: https://doi.org/10.1007/11549468_10
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-28700-1
Online ISBN: 978-3-540-31925-2
eBook Packages: Computer ScienceComputer Science (R0)