Skip to main content

Cluster Detection in Databases: The Adaptive Matched Filter Algorithm and Implementation


Matched filter techniques are a staple of modern signal and image processing. They provide a firm foundation (both theoretical and empirical) for detecting and classifying patterns in statistically described backgrounds. Application of these methods to databases has become increasingly common in certain fields (e.g. astronomy). This paper describes an algorithm (based on statistical signal processing methods), a software architecture (based on a hybrid layered approach) and a parallelization scheme (based on a client/server model) for finding clusters in large astronomical databases. The method has proved successful in identifying clusters in real and simulated data. The implementation is flexible and readily executed in parallel on a network of workstations.

This is a preview of subscription content, access via your institution.


  • Abell, G. 1958. Astrophysical Journal Supplement, 3:211.

    Google Scholar 

  • Abell, G., Corwin, H., and Olowin, R. 1989. Astrophysical Journal Supplement, 70:1.

    Google Scholar 

  • Bahcall, N. 1988, ARA&A, 26:631.

  • Bramel, D.A., Nichol, R.C., and Pope, A.C. Astrophysical Journal, to appear.

  • Binggeli, B., Sandage, A., and Tammann, G. 1988. Annual Reviews of Astronomy and Astrophysics, 26:509.

    Google Scholar 

  • Colley, W.N., Tyson, J.A., and Turner, E.L. 1996. Astrophysical Journal, 461:L83.

  • Dalton, G., Efstathiou, G., Maddox, S., and Sutherland, W. 1994. Monthly Notices of the Royal Astronomical Society, 269:15.

    Google Scholar 

  • Dasarathy, B. 1999. Data Mining and Knowledge Discovery: Theory, Tools and Technology, Vol. 3696, SPIE.

  • Djorgoski, S. et al. 1997. In Applications of Digital Image Processing XX, (A. Tescher (Ed.)0, Proc. SPIE, Vol. 3164.

  • Duda, R.O., Hart, P.E., and Stork, D.G. 2000. Pattern Classification. John Wiley and Sons: New York.

    Google Scholar 

  • Li-Zhi Fang and Pando, J. 1997. In Proceedings of the 5th Erice Chalonge School on Astrofundamental Physics, (N. Sánchez and A. Zichichi (Eds.)), World Scientfic: Singapore.

    Google Scholar 

  • Fadda, D., Slezak, E., and Bijaoui, A. 1997.A&A, 127:335.

  • Fayyad, U., Piatetsky-Shapiro, G., Smyth, P., and Uthurasamy, R. 1996, Advances in Knowledge Discovery and Data Mining, MIT Press: Cambridge, MA.

    Google Scholar 

  • Gal, R.R., DeCarvalho, R.R., Odewahn, S.C., Djorgovski, S.G., and Margoniner, V.E. Astronomical Journal, to appear.

  • Kawaski, W., Shimasaku, K., Doi, M., and Okamura, S. astro-ph/9705112, A&AS, accepted.

  • Kepner, J., Fan, X., Bahcall, N., Gunn, J., Lupton, R., and Xu, G. 1999. Astrophysical Journal, 517:78.

    Google Scholar 

  • Kepner, J., Gokhale, M., Minnich, R., Marks, A., and DeGood, J. Cluster Computing, to appear.

  • Kim et al. and the SDSS Collaboration, 2000. Bulletin of the American Astronomical Society, 195, no. 30.03.

  • Loveday, J., Peterson, B., Efstathiou, G., and Maddox, S. 1992. Astrophysical Journal, 390:338.

    Google Scholar 

  • Lumsden, S., Nichol, R., Collins, C., and Guzzo, L. 1992. Monthly Notices of the Royal Astronomical Society, 258:1.

  • Postman, M. et al. 1996. Astronomical Journal, 111:615

  • Ramella, M., Nonino, M., Boschlin, W., and Fadda, D. 1998. astro-ph/9810124.

  • Schechter, P. 1976. Asto physical Journal, 203:297.

    Google Scholar 

  • Szalay, A.S., Kunszt, P., Thakar, A., Gray, J., and Slutz, D. In ADASS' 99 conference.

Download references

Author information

Authors and Affiliations


Rights and permissions

Reprints and Permissions

About this article

Cite this article

Kepner, J., Kim, R. Cluster Detection in Databases: The Adaptive Matched Filter Algorithm and Implementation. Data Mining and Knowledge Discovery 7, 57–79 (2003).

Download citation

  • Issue Date:

  • DOI:

  • filtering
  • parallel processing
  • astronomy