Abstract
We present an out-of-core FFT algorithm based on the in-core FFT method developed by Swarztrauber. Our algorithm uses a recursive divide-and-conquer strategy, and each stage in the recursion presents several possibilities for how to split the problem into subproblems. We give a recurrence for the algorithm’s I/O complexity on the Parallel Disk Model and show how to use dynamic programming to determine optimal splits at each recursive stage. The algorithm to determine the optimal splits takes only Θ(lg2 N) time for an N-point FFT, and it is practical. The out-of-core FFT algorithm itself takes considerably longer.
Supported in part by the National Science Foundation under grant CCR-9625894. Portions of this work were performed while the author was visiting the Institute for Mathematics and its Applications at the University of Minnesota.
Regarding the copyright of this article I hereby grant the Institute for Mathematics and its Applications (IMA) and Springer-Verlag New York Inc. the right to include the article in an IMA Volume “Algorithms for Parallel Processing” to be edited by Robert S. Schreiber, Michael Heath, and Abhiram Ranade.
I grant this right to print the article with the express understanding that I will retain the copyright to the article. I am not granting or assigning the copyright to IMA or to Springer-Verlag. Consequently, I will retain control over dissemination of the article, including the right to make it publicly available on a web server.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
D.H. Bailey, FFTs in external or hierarchical memory, The Journal of Super-computing, 4 (1990), pp. 23–35.
N.M. Brenner, Fast Fourier transform of externally stored data, IEEE Transactions on Audio and Electroacoustics, AU-17 (1969), pp. 128–132.
J.W. Cooley AND J.W. Tukey, An algorithm for the machine calculation of complex Fourier series, Mathematics of Computation, 19 (1965), pp. 297–301.
T.H. Cormen, C.E. Leiserson, and R.L. Rivest, Introduction to Algorithms, The MIT Press, Cambridge, Massachusetts, 1990.
T.H. Cormen AND D.M. Nicol, Performing out-of-core FFTs on parallel disk systems, Tech. Rep. PCS-TR96–294, Dartmouth College Department of Computer Science, Aug. 1996, To appear in Parallel Computing.
T.H. Cormen, T.Sundquist, AND L.F.Wisniewski, Asymptotically tight bounds for performing BMMC permutations on parallel disk systems, Tech. Rep. PCSTR94–223, Dartmouth College Department of Computer Science, July 1994. Preliminary version appeared in Proceedings of the 5th Annual ACM Symposium on Parallel Algorithms and Architectures. Revised version to appear in SIAM Journal on Computing.
T.H. Cormen, J. Wegmann, AND D.M. Nicol Multiprocessor out-of-core FFTs with distributed memory and parallel disks, in Proceedings of the Fifth Workshop on I/O in Parallel and Distributed Systems (IOPADS ‘87), Nov. 1997, pp. 68–78. Also Dartmouth College Computer Science Technical Report PCSTR97–303.
Z. Li, Computational Models and Program Synthesis for Parallel Out-of-Core Computation, PhD thesis, Department of Computer Science, Duke University, 1996.
H.J. Nussbaumer, Fast Fourier Transform and Convolution Algorithms, Springer-Verlag, New York, second ed., 1982.
R. Sweet AND J. Wilson, Development of out-of-core fast Fourier transform software for the Connection Machine. URL http://www-math.cudenver.edu/~jwilson/final_report/final_report.html, Dec. 1995.
C. Van Loan, Computational Frameworks for the Fast Fourier Transform, SIAM Press, Philadelphia, 1992.
J.S. Vitter AND E.A.M. Shriver, Algorithms for parallel memory I: Two-level memories, Algorithmica, 12 (1994), pp. 110–147.
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 1999 Springer Science+Business Media New York
About this chapter
Cite this chapter
Cormen, T.H. (1999). Determining an out-of-Core FFT Decomposition Strategy for Parallel Disks by Dynamic Programming. In: Heath, M.T., Ranade, A., Schreiber, R.S. (eds) Algorithms for Parallel Processing. The IMA Volumes in Mathematics and its Applications, vol 105. Springer, New York, NY. https://doi.org/10.1007/978-1-4612-1516-5_14
Download citation
DOI: https://doi.org/10.1007/978-1-4612-1516-5_14
Publisher Name: Springer, New York, NY
Print ISBN: 978-1-4612-7175-8
Online ISBN: 978-1-4612-1516-5
eBook Packages: Springer Book Archive