Advertisement

A Compound Scheduling Strategy for Irregular Array Redistribution in Cluster Based Parallel System

  • Shih-Chang Chen
  • Ching-Hsien Hsu
  • Tai-Lung Chen
  • Kun-Ming Yu
  • Hsi-Ya Chang
  • Chih-Hsun Chou
Part of the Lecture Notes in Computer Science book series (LNCS, volume 6083)

Abstract

With the advancement of network and techniques of clusters, joining clusters to construct a wide parallel system becomes a trend. Irregular array redistribution employs generalized blocks to help utilize the resource while executing scientific application on such platforms. Research for irregular array redistribution is focused on scheduling heuristics because communication cost could be saved if this operation follows an efficient schedule. In this paper, a two-step communication cost modification (T2CM) and a synchronization delay-aware scheduling heuristic (SDSH) are proposed to normalize the communication cost and reduce transmission delay in algorithm level. The performance evaluations show the contributions of proposed method for irregular array redistribution.

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. 1.
    Cohen, J., Jeannot, E., Padoy, N., Wagner, F.: Messages Scheduling for Parallel Data Redistribution between Clusters. IEEE Transactions on Parallel and Distributed Systems 17(10), 1163–1175 (2006)CrossRefGoogle Scholar
  2. 2.
    Guo, M., Pan, Y., Liu, Z.: Symbolic Communication Set Generation for Irregular Parallel Applications. The Journal of Supercomputing 25(3), 199–214 (2003)zbMATHCrossRefGoogle Scholar
  3. 3.
    Hsu, C.-H., Bai, S.-W., Chung, Y.-C., Yang, C.-S.: A Generalized Basic-Cycle Calculation Method for Efficient Array Redistribution. IEEE Transactions on Parallel and Distributed Systems 11(12), 1201–1216 (2000)CrossRefGoogle Scholar
  4. 4.
    Hsu, C.-H., Chen, M.-H., Yang, C.-T., Li, K.-C.: Optimizing Communications of Dynamic Data Redistribution on Symmetrical Matrices in Parallelizing Compilers. IEEE Transactions on Parallel and Distributed Systems 17(11) (2006)Google Scholar
  5. 5.
    Hsu, C.-H., Chen, S.-C., Lan, C.-Y.: Scheduling Contention-Free Irregular Redistribution in Parallelizing Compilers. The Journal of Supercomputing 40(3), 229–247 (2007)CrossRefGoogle Scholar
  6. 6.
    Huang, J.-W., Chu, C.-P.: A flexible processor mapping technique toward data localization for block-cyclic data redistribution. The Journal of Supercomputing 45(2), 151–172 (2008)CrossRefGoogle Scholar
  7. 7.
    Jeannot, E., Wagner, F.: Scheduling Messages For Data Redistribution: An Experimental Study. The International Journal of High Performance Computing Applications 20(4), 443–454 (2006)CrossRefGoogle Scholar
  8. 8.
    Karwande, A., Yuan, X., Lowenthal, D.K.: An MPI prototype for compiled communication on ethernet switched clusters. Journal of Parallel and Distributed Computing 65(10), 1123–1133 (2005)CrossRefGoogle Scholar
  9. 9.
    Prylli, L., Touranchean, B.: Fast runtime block cyclic data redistribution on multiprocessors. Journal of Parallel and Distributed Computing 45(1), 63–72 (1997)zbMATHCrossRefGoogle Scholar
  10. 10.
    Rauber, T., Rünger, G.: A Data Re-Distribution Library for Multi-Processor Task Programming. International Journal of Foundations of Computer Science 17(2), 251–270 (2006)zbMATHCrossRefGoogle Scholar
  11. 11.
    Sudarsan, R., Ribbens, C.J.: Efficient Multidimensional Data Redistribution for Resizable Parallel Computations. In: Stojmenovic, I., Thulasiram, R.K., Yang, L.T., Jia, W., Guo, M., de Mello, R.F. (eds.) ISPA 2007. LNCS, vol. 4742, pp. 182–194. Springer, Heidelberg (2007)CrossRefGoogle Scholar
  12. 12.
    Wang, H., Guo, M., Wei, D.: Message Scheduling for Irregular Data Redistribution in Parallelizing Compilers. IEICE Transactions on Information and Sysmtes E89-D(2), 418–424 (2006)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2010

Authors and Affiliations

  • Shih-Chang Chen
    • 1
  • Ching-Hsien Hsu
    • 2
  • Tai-Lung Chen
    • 1
  • Kun-Ming Yu
    • 2
  • Hsi-Ya Chang
    • 3
  • Chih-Hsun Chou
    • 1
  1. 1.College of Engineering 
  2. 2.Department of Computer Science and Information EngineeringChung Hua UniversityHsinchuTaiwan R.O.C.
  3. 3.National Center for High-Performance ComputingHsinchuTaiwan

Personalised recommendations