Skip to main content

Determining an out-of-Core FFT Decomposition Strategy for Parallel Disks by Dynamic Programming

  • Chapter
Algorithms for Parallel Processing

Part of the book series: The IMA Volumes in Mathematics and its Applications ((IMA,volume 105))

Abstract

We present an out-of-core FFT algorithm based on the in-core FFT method developed by Swarztrauber. Our algorithm uses a recursive divide-and-conquer strategy, and each stage in the recursion presents several possibilities for how to split the problem into subproblems. We give a recurrence for the algorithm’s I/O complexity on the Parallel Disk Model and show how to use dynamic programming to determine optimal splits at each recursive stage. The algorithm to determine the optimal splits takes only Θ(lg2 N) time for an N-point FFT, and it is practical. The out-of-core FFT algorithm itself takes considerably longer.

Supported in part by the National Science Foundation under grant CCR-9625894. Portions of this work were performed while the author was visiting the Institute for Mathematics and its Applications at the University of Minnesota.

Regarding the copyright of this article I hereby grant the Institute for Mathematics and its Applications (IMA) and Springer-Verlag New York Inc. the right to include the article in an IMA Volume “Algorithms for Parallel Processing” to be edited by Robert S. Schreiber, Michael Heath, and Abhiram Ranade.

I grant this right to print the article with the express understanding that I will retain the copyright to the article. I am not granting or assigning the copyright to IMA or to Springer-Verlag. Consequently, I will retain control over dissemination of the article, including the right to make it publicly available on a web server.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

eBook
USD 16.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 109.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. D.H. Bailey, FFTs in external or hierarchical memory, The Journal of Super-computing, 4 (1990), pp. 23–35.

    Google Scholar 

  2. N.M. Brenner, Fast Fourier transform of externally stored data, IEEE Transactions on Audio and Electroacoustics, AU-17 (1969), pp. 128–132.

    Article  Google Scholar 

  3. J.W. Cooley AND J.W. Tukey, An algorithm for the machine calculation of complex Fourier series, Mathematics of Computation, 19 (1965), pp. 297–301.

    Article  MathSciNet  MATH  Google Scholar 

  4. T.H. Cormen, C.E. Leiserson, and R.L. Rivest, Introduction to Algorithms, The MIT Press, Cambridge, Massachusetts, 1990.

    MATH  Google Scholar 

  5. T.H. Cormen AND D.M. Nicol, Performing out-of-core FFTs on parallel disk systems, Tech. Rep. PCS-TR96–294, Dartmouth College Department of Computer Science, Aug. 1996, To appear in Parallel Computing.

    Google Scholar 

  6. T.H. Cormen, T.Sundquist, AND L.F.Wisniewski, Asymptotically tight bounds for performing BMMC permutations on parallel disk systems, Tech. Rep. PCSTR94–223, Dartmouth College Department of Computer Science, July 1994. Preliminary version appeared in Proceedings of the 5th Annual ACM Symposium on Parallel Algorithms and Architectures. Revised version to appear in SIAM Journal on Computing.

    Google Scholar 

  7. T.H. Cormen, J. Wegmann, AND D.M. Nicol Multiprocessor out-of-core FFTs with distributed memory and parallel disks, in Proceedings of the Fifth Workshop on I/O in Parallel and Distributed Systems (IOPADS ‘87), Nov. 1997, pp. 68–78. Also Dartmouth College Computer Science Technical Report PCSTR97–303.

    Chapter  Google Scholar 

  8. Z. Li, Computational Models and Program Synthesis for Parallel Out-of-Core Computation, PhD thesis, Department of Computer Science, Duke University, 1996.

    Google Scholar 

  9. H.J. Nussbaumer, Fast Fourier Transform and Convolution Algorithms, Springer-Verlag, New York, second ed., 1982.

    Book  Google Scholar 

  10. R. Sweet AND J. Wilson, Development of out-of-core fast Fourier transform software for the Connection Machine. URL http://www-math.cudenver.edu/~jwilson/final_report/final_report.html, Dec. 1995.

    Book  Google Scholar 

  11. C. Van Loan, Computational Frameworks for the Fast Fourier Transform, SIAM Press, Philadelphia, 1992.

    Book  MATH  Google Scholar 

  12. J.S. Vitter AND E.A.M. Shriver, Algorithms for parallel memory I: Two-level memories, Algorithmica, 12 (1994), pp. 110–147.

    Article  MathSciNet  MATH  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 1999 Springer Science+Business Media New York

About this chapter

Cite this chapter

Cormen, T.H. (1999). Determining an out-of-Core FFT Decomposition Strategy for Parallel Disks by Dynamic Programming. In: Heath, M.T., Ranade, A., Schreiber, R.S. (eds) Algorithms for Parallel Processing. The IMA Volumes in Mathematics and its Applications, vol 105. Springer, New York, NY. https://doi.org/10.1007/978-1-4612-1516-5_14

Download citation

  • DOI: https://doi.org/10.1007/978-1-4612-1516-5_14

  • Publisher Name: Springer, New York, NY

  • Print ISBN: 978-1-4612-7175-8

  • Online ISBN: 978-1-4612-1516-5

  • eBook Packages: Springer Book Archive

Publish with us

Policies and ethics