Skip to main content
Log in

On the Scalability of 2-D Discrete Wavelet Transform Algorithms

  • Published:
Multidimensional Systems and Signal Processing Aims and scope Submit manuscript

Abstract

The ability of a parallel algorithm to make efficient use of increasing computational resources is known as its scalability. In this paper, we develop four parallel algorithms for the 2-dimensional Discrete Wavelet Transform algorithm (2-D DWT), and derive their scalability properties on Mesh and Hypercube interconnection networks. We consider two versions of the 2-D DWT algorithm, known as the Standard (S) and Non-standard (NS) forms, mapped onto P processors under two data partitioning schemes, namely checkerboard (CP) and stripped (SP) partitioning. The two checkerboard partitioned algorithms \( M^2 = \Omega (P\log P)\) (Non-standard form, NS-CP), and as \(M^2 = \Omega (P\log ^2 P)\) (Standard form, S-CP); while on the store-and-forward-routed (SF-routed) Mesh and Hypercube they are scalable as \({{3\; - \;\gamma }}\) (NS-CP), and as \({{2\; - \;\gamma }}\) (S-CP), respectively, where M 2 is the number of elements in the input matrix, and γ ∈ (0,1) is a parameter relating M to the number of desired octaves J as \(J = \left\lceil {\gamma \;\log M} \right\rceil \). On the CT-routed Hypercube, scalability of the NS-form algorithms shows similar behavior as on the CT-routed Mesh. The Standard form algorithm with stripped partitioning (S-SP) is scalable on the CT-routed Hypercube as M 2 = Ω(P 2), and it is unscalable on the CT-routed Mesh. Although asymptotically the stripped partitioned algorithm S-SP on the CT-routed Hypercube would appear to be inferior to its checkerboard counterpart S-CP, detailed analysis based on the proportionality constants of the isoefficiency function shows that S-SP is actually more efficient than S-CP over a realistic range of machine and problem sizes. A milder form of this result holds on the CT- and SF-routed Mesh, where S-SP would, asymptotically, appear to be altogether unscalable.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Similar content being viewed by others

References

  1. A. Grossmann and R. Kronland-Martinet, and J. Morlet, “Reading and Understanding Continuous Wavelet Transforms”. in J. M. Combes, A. Grossmann, and P. Tchamitchian (eds.), Wavelets: Time-Frequency Methods and Phase Space, pp. 2–20. Springer-Verlag, 1989.

  2. I. Daubechies, Ten Lectures on Wavelets, Number 61 in CBMS- NSF Series in Applied Mathematics. Philadelphia: SIAM Publications, 1992.

    Google Scholar 

  3. P. P. Vaidyanathan, Multirate Systems and Filter Banks, Englewood Cliffs, NJ: Prentice-Hall, 1993.

    Google Scholar 

  4. S. G. Mallat, “A Theory for Multiresolution Signal Decomposition: The Wavelet Representation,” IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 11, no. 7, 1989, pp. 674–693.

    Google Scholar 

  5. M. Vetterli and C. Herley. “Wavelets and Filter Banks: Theory and Design,” IEEE Trans. on Signal Processing, vol. 40, no. 9, 1992, pp. 2207–2232.

    Google Scholar 

  6. R. A. DeVore, B. Jawerth, and B. J. Lucier, “Image Compression Through Wavelet Transform Coding,” IEEE Transactions on Information Theory, vol. 38, no. 2, 1992, pp. 719–746.

    Google Scholar 

  7. W. Zettler, J. Huffman, and D. C. P. Linden, “Applications of compactly supported wavelets to image compression,” Technical Report AD 900119, Aware Inc., 1990.

  8. M. Unser and A. Aldroubi, “Polynomial Splines and Wavelets—A Signal Processing Perspective,” in C. K. Chui (ed.), Wavelets: A Tutorial in Theory and Applications. Academic Press, 1992.

  9. G. Beylkin, R. Coifman, and V. Rokhlin, “Fast Wavelet Transforms and Numerical Algorithms I,” CPAM, vol. 44, 1991, pp. 141–183.

    Google Scholar 

  10. B. Alpert, “A Class of Bases in L2 for the Sparse Representation of Integral Operators,” SIAM Journal of Scientific Computation, vol. 24, no. 1, 1993, pp. 246–262.

    Google Scholar 

  11. B. Alpert, G. Beylkin, R. Coifman, and V. Rokhlin, “Wavelets for the Fast Solution of Second-Kind Integral Equations,” SIAM Journal on Scientific Computation, vol. 14, no. 1, 1993, p. 159.

    Google Scholar 

  12. E. Bacry, S. Mallat, and G. Papanicolaou, “A Wavelet Based Space-Time Adaptive Numerical Method for Partial Differential Equations,” Mathematical Modeling and Numerical Analysis, vol. 26, 7, 1992, p. 793.

    Google Scholar 

  13. S. Mallat and W. L. Hwang, “Singularity detection and processing with wavelets,” Courant Institute of Mathematical Sciences, New York University, Preprint.

  14. E. H. Adelson, E. Simoncelli, and R. Hingorani, “Orthogonal Pyramid Transforms for Image Coding,” in Visual Communications and Image Processing II, no. 845, pp. 50–58. SPIE, 1987.

    Google Scholar 

  15. T. Bell, “Remote Sensing,” IEEE Spectrum, 1995, pp. 25–31.

  16. M. Hamdi, “Parallel Architectures for Wavelet Transforms,” in 1993 Workshop on Computer Architecures for Machine Perception, 1993, pp. 376–384.

  17. C. Chakrabarti and M. Vishwanath, “Efficient Realizations of the Discrete and Continuous Wavelet Transforms: from Single Chip Implementations to Mappings on SIMD Array Computers,” IEEE Transactions on Signal Processing, vol. 43, no. 3, 1995, pp. 759–771.

    Google Scholar 

  18. J. Fridman and E. Manolakos, “On the Synthesis of Regular VLSI Architectures for the 1-D Discrete Wavelet Transform,” in A. Lane and M. Unser (eds.), Wavelet Applications in Signal and Image Processing II, pp. 91–104. SPIE, July 1994.

  19. J. Fridman and E. S. Manolakos, “Distributed Memory and Control VLSI Architectures for the 1-D Discrete Wavelet Transform,” in J. Rabaey, P. Chau, and J. Eldon (eds.), VLSI Signal Processing VII, pp. 388–397. IEEE Signal Processing Society, 1994.

  20. J. Fridman and E. S. Manolakos, “Discrete Wavelet Transform: Data Dependence Analysis and Synthesis of Distributed Memory and Control Architectures,” IEEE Transactions on Signal Processing, to appear 1997.

  21. J. Fridman, Parallel Algorithms and Architectures for the Discrete Wavelet Transform, PhD thesis, Northeastern University, June 1996.

  22. J. Fridman, B. York, and E. S. Manolakos, “Discrete Wavelet Transform Algorithms on a Massively Parallel Platform,” in International Conference on Signal Processing Applications and Technology, pp. 1512–1516, 1995.

  23. V. Kumar, A. Grama, A. Gupta, and G. Karypis, Introduction to Parallel Computing, The Benjamin/ Cummings Publishing Company, Inc., 1994.

  24. J. P. Andrew, P. O. Ogunbona, and F. J. Paoloni, “Comparison of Wavelet Filters and Subband Analysis Structures for Still Image Compression,” in Proc. Int'l. Conf. on Acoustics, Speech and Signal Proccessing, pp. V-589-592. IEEE Signal Processing Society, 1994.

  25. G. A. Geist, M. T. Heath, B.W. Peyton, and P. H. Worley, “PICL: A portable Instrumented Communication Library,” Technical Report, ORNL/TM-11130, Oak Ridge National Laboratory, 1990.

  26. H. Xu, E. T. Kalns, P. K. McKinley, and L. M. Ni, “ComPaSS: A Communication Package for Scalable Software Design,” Journal of Parallel and Distributed Computing, vol. 22, 1994, pp. 449–461.

    Google Scholar 

  27. S. Y. Kung, VLSI Array Processors, Prentice Hall, 1989.

  28. J. L. Gustafson, “Reevaluating Amdahl's Law,” Communications of the Association for Computing Machinery (ACM), vol. 31, no. 5, 1988, pp. 532–533.

    Google Scholar 

  29. P. H. Worley, “The Effect of Time Constraints on Scaled Speedup,” SIAM Journal Sci. Statist. Comput., vol. 11, no. 5, 1990, pp. 838–858.

    Google Scholar 

  30. X. H. Sun and L. M. Ni, “Another View of Parallel Speedup,” in Proceedings Supercomputing 90, pp. 324–333, 1990.

  31. F. A. Van-Catledge, “Toward a General Model for Evaluating the Relative Performance of Computer Systems”. Int'l. Journal of Supercomputer Applications, vol. 3, 1989, pp. 100–108.

    Google Scholar 

  32. X. H. Sun and D. Rover, “Scalability of Parallel Algorithm-Machine Combinations,” IEEE Transactions on Parallel and Distributed Systems, vol. 5, no. 6, 1994, pp. 599–613.

    Google Scholar 

  33. V. Kumar and A. Gupta, “Analyzing Scalability of Parallel Algorithms and Architectures,” Journal of Parallel and Distributed Computing, vol. 22, 1994, pp. 379–391.

    Google Scholar 

  34. J. Ghosh, S. K. Das, and A. John, “Concurrent Processing of Linearly Ordered Data Structures in Hypercube Multicomputers,” IEEE Transactions on Parallel and Distributed Systems, vol. 5, no. 9, 1994, pp. 898–911.

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Rights and permissions

Reprints and permissions

About this article

Cite this article

Fridman, J., Manolakos, E.S. On the Scalability of 2-D Discrete Wavelet Transform Algorithms. Multidimensional Systems and Signal Processing 8, 185–217 (1997). https://doi.org/10.1023/A:1008229209464

Download citation

  • Issue Date:

  • DOI: https://doi.org/10.1023/A:1008229209464

Navigation