A Knowledge Discovery Methodology for Behavior Analysis of Large-Scale Applications on Parallel Architectures

  • Elias N. Houstis
  • Vassilios S. Verykios
  • Ann C. Catlin
  • John R. Rice
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 2660)


The focus of this paper is the application and extension of the knowledge discovery in databases process [5] developed in PYTHIA recommender system, to analyze the behavior of a DOE ASCI application/hardware pairs in the context of POEMS project[4]. The POEMS project has built a library of models for modeling scalable architectures like those in the ASCI program. Moreover, it supports detail simulation of a variety of state-of-the-art processors and memory hierarchies and incorporates parallel evaluation of discrete-event simulation. The driver application used is SWEEP3D.


Recommender System Data Mining Knowledge Discovery Scientific Computing 


  1. 1.
    V. S. Adve and R. Sakellariou. Application Representations for Multi-Paradigm Performance Modeling. International Journal of High Performance and Scientific Applications, 1999. To appear.Google Scholar
  2. 2.
    R. Bagrodia and S. Prakash. Using Parallel Simulation to Evaluate MPI Programs. In Proceedings of the 1998 Winter Simulation Conference WSC’ 98, 1998.Google Scholar
  3. 3.
    Doug Burger and Todd M. Austin. The SimpleScalar Tool Set, Version 2.0. Technical Report Technical Report #1342, Computer Sciences Department, University of Wisconsin-Madison, June 1997.Google Scholar
  4. 4.
    E. Deelman, R. Bagrodia, A. Dube, J. Browne, A. Hoisie, Y. Luo, O. Lubeck, H. Wasserman, R. Oliver, R. Teller, D. Sundram-Stukel, M. Vernon, V. Adve, E. Houstis, and J. Rice. POEMS: End-to-end Performance Design of Large Parallel Adaptive Computational Systems. In Proceedings of the 1st International Workshop on Software and Performance (WOSP)’ 98, October 1998.Google Scholar
  5. 5.
    U. M. Fayyad, G. Piatetsky-Shapiro, and P. Smyth. From Data Mining to Knowledge Discovery: An Overview. In U. M. Fayyad, G. Piatetsky-Shapiro, P. Smyth, and R. Uthurusamy, editors, Advances in Knowledge Discovery and Data Mining, pages 1–34. AAAI Press/MIT Press, 1996.Google Scholar
  6. 6.
    M. I. Frank, A. Agarwal, and M. K. Vernon. LoPC: Modeling Contention in Parallel Algorithms. In Proceedings of the 6th ACM SIGPLAN Symposium on Principles and Practices of Parallel Programming (PPoPP’ 97), 1997. Las Vegas.Google Scholar
  7. 7.
    E. N. Houstis, S. Weerawarana, A. Joshi, and J. R. Rice. The PYTHIA Project. In S. K. Aityan, editor, Neural, Parallel, and Scientific Computations, pages 215–218. Dynamic Publishers., 1995.Google Scholar
  8. 8.
    Elias N. Houstis, Ann C. Catlin, John R. Rice, Vassilios S. Verykios, Naren Ramakrishnan, and Catherine E. Houstis. PYTHIA-II: A Knowledge/Database System for Managing Performance Data and Recommending Scientific Software. ACM Transactions on Mathematical Software, 26(2):227–253, 2000.zbMATHCrossRefGoogle Scholar
  9. 9.
    A. M. Ionescu, K. E. Schauser, and C. Scheiman. LogGP: Incorporating Long Messages into the LogP Model. In Proceedings of the 7th Annual ACM Symposium On Parallel Algorithms and Architectures (SPAA’ 95), 1995. Santa Barbara, July.Google Scholar
  10. 10.
    S. Weerawarana, E. N. Houstis, J. R. Rice, A. Joshi, and C. E. Houstis. PYTHIA: A Knowledge Based System to Select Scientific Algorithms. ACM Transactions on Mathematical Software, 22(4):447–468, 1996.zbMATHCrossRefGoogle Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2003

Authors and Affiliations

  • Elias N. Houstis
    • 1
    • 2
  • Vassilios S. Verykios
    • 1
    • 3
  • Ann C. Catlin
    • 2
  • John R. Rice
    • 2
  1. 1.Dept. of Computer and Commun. Engr.Univ. of ThessalyVolosGREECE
  2. 2.Dept. of Computer SciencesPurdue UniversityWest LafayetteUSA
  3. 3.Research and Academic Computer Technology InstitutePatrasGREECE

Personalised recommendations