A Low Power Architecture for HASM Motion Tracking
- 69 Downloads
This paper proposes low power VLSI architecture for motion tracking that can be used in online video applications such as in MPEG and VRML. The proposed architecture uses a hierarchical adaptive structured mesh (HASM) concept that generates a content-based video representation. The developed architecture shows the significant reducing of power consumption that is inherited in the HASM concept. The proposed architecture consists of two units: a motion estimation and motion compensation units.
The motion estimation (ME) architecture generates a progressive mesh code that represents a mesh topology and its motion vectors. ME reduces the power consumption since it (1) implements a successive splitting strategy to generate the mesh topology. The successive split allows the pipelined implementation of the processing elements. (2) It approximates the mesh nodes motion vector by using the three step search algorithm. (3) and it uses parallel units that reduce the power consumption at a fixed throughput.
The motion compensation (MC) architecture processes a reference frame, mesh nodes and motion vectors to predict a video frame using affine transformation to warp the texture with different mesh patches. The MC reduces the power consumption since it uses (1) a multiplication-free algorithm for affine transformation. (2) It uses parallel threads in which each thread implements a pipelined chain of scalable affine units to compute the affine transformation of each patch.
The architecture has been prototyped using top-down low-power design methodology. The performance of the architecture has been analyzed in terms of video construction quality, power and delay.
Unable to display preview. Download preview PDF.
- 3.G.J. Holzmann, Beyond Photography—The Digital Dark-Room. Englewood Cliffs, NJ: Prentice-Hall, 1988.Google Scholar
- 4.G. Wolberg, Digital Image Warping. Los Almitos, CA: IEEE Computer Society Press, 1990.Google Scholar
- 5.H. Bruzewitz, “Motion Compensation with Triangles,” in Proc. 3rd Int. Conf. 64 kbit Coding of Moving Video, Rootterdam, The Netherlands, Sept. 1990.Google Scholar
- 6.G.J. Sullivan and R.L. Baker, “Motion Compensation for Video Compression Using Control Grid Interpolation,” in Proc. IEEE ICASSP, vol. 4, May 1991, pp. 2713-2716.Google Scholar
- 7.Y. Nakaya and H. Harashima, “An Iterative Motion Estimation Method using Triangular Patches for Motion Compensation,” in Proc. SPIE Visual Communications and Image Processing, vol. 1605, Nov. 1991, pp. 546-557.Google Scholar
- 17.A. Nosratinia, N. Mohsenian, M.T. Orchard, and B. Liu, “Interslice Coding of Magnetic Resonance Images Using Deformable Triangular Patches,” in Proc. IEEE ICIP, Austin, TX, Nov. 1994, vol. 2, pp. 898-892.Google Scholar
- 20.O. Lee and Y. Wang, “Non-Uniform Image Sampling and Interpolation Over Deformed and Its Hierarchical Extension,” International Conference on Visual Communications and Image Processing, vol. 3, 1995, pp. 289-300.Google Scholar
- 21.W. Badawy and M. Bayoumi, “On Minimizing Hierarchical Mesh Coding Overhead: (HASM) Hierarchical Adaptive Structured Mesh Approach”, in IEEE International Conference on Acoustics, Speech, and Signal Processing, ICASSP, Istanbul, Turkey, June 5–9, 2000, pp. 1923-1926.Google Scholar
- 22.D. Terzopoulos and M. Vailescu, “Sampling and Reconstruction using Adaptive Meshes,” IEEE International Conference on Computer Vision and Pattern Recognition CVPR'91, 1991, pp. 70-75.Google Scholar
- 25.S. Brofferio and F. Rocca, “Interframe Redundancy Reduction of Video Signals Generated by Translating Objects,” IEEE Trans. Commun. vol. Com-25, April 1977, p. 448055.Google Scholar
- 28.H.K. Thapar and J. Cioffi, “A Block Processing Method for Designing High Speed Viterbi Decoders,” in Proc. IEEE Communications Conf., June 1989, pp. 1096-1100.Google Scholar
- 30.T. Koga, K. Iinuma, A. Hirano, Y. Iijima, and T. Ishiguro, “Motion-Compensated Interframe Coding for Video Conferencing,” in Proc. National Telecommun. Conf., New Orleans, LA, 1981, pp. G.5.3.1-G.5.3.5.Google Scholar
- 31.J.R. Jam and A.K. Jam, “Displacement Measurement and its Application in Interframe Image Coding,” in IEEE Trans. Commun. vol. COM-29, 1981, pp. 1799-1808.Google Scholar
- 36.P.E. Eren, C. Toklu, and A.M. Tekalp, “Object-Based Manipulation and Composition Using 2D Meshes in VRML,” in Proc. IEEE Signal Processing 1st Workshop Multimedia Processing, Princeton, NJ, June 1997, pp. 257-261.Google Scholar
- 37.G. Wolberg, Digital Image Warping. Los Alamitos, CA: Computer Society Press, 1990.Google Scholar
- 38.G. Seetharaman, “Image Sequence Analysis for Three-Dimensional Perception of Dynamic Scenes,” in Handbook of Pattern Recognition and Image Processing: Computer Vision, T.Y. Young (Ed.), Academic Press, 1994, pp. 361-403.Google Scholar
- 39.S. Gunasekaran and T.Y. Young, “A Region Correspondence Approach to the Recovery of 3-Dimensional Motion and Structure in Dynamic Scenes,” in Image Understanding in Unstructured Environment, S.-S. Chen (Ed.), World Scientific, 1988, pp. 75-123.Google Scholar
- 40.L. Chiariglione, “MPEG and Multimedia Communications,” in IEEE Trans. Circuits Syst. Video Technol., vol. 7, 1997.Google Scholar
- 42.H. Benoit-Cattin, A.C. Planat, P.R. Joachimsmann, A. Baskurt, P. Clarysse, and I.E. Magnin, “On Minimizing the Active Mesh Coding,” in IEEE International Conference on Image Processing, 1998, pp. 895-898.Google Scholar
- 43.S.K. Rao, M. Hatamian, M.T. Uyttendaele, S. Narayan, J.H. O'Neill, and G.A. Uvieghara, “A Versatile and Powerful Chip for Real Time Motion Estimation,” in Proc. IEEE ISSCC, 1993, pp. 32-33.Google Scholar
- 45.A. Ohtani, Y. Matsumoto, M. Gion, H. Yoshida, T. Araki, A. Ubukata, M. Serizawa, K. Aoki, A. Sota, A. Nagata, and K. Aono, “A Motion Estimation Processor for mpeg2 Video Real Time Encoding at Wide Search Range,” in Proc. IEEE CICC, 1995, pp. 405-408.Google Scholar
- 46.J.F. Shen and L.G. Chen, “Low Power Full-Search Block-Matching Motion Estimation Chip for h.263+,” in Proc. IEEE Circuits and Systems, vol. 4, 1999, pp. 299-302.Google Scholar
- 49.G. Wolberg, Digital Image Warping. Los Alamatos, CA: Computer Society Press, 1990.Google Scholar
- 51.P.J.L. van Beek, A.M. Tekalp, and A. Puri, “2D Mesh Geometry and Motion Compression for Efficient Object-Based Video Representation,” Int. Conf. on Image Processing'97, Santa Barbara, CA, Oct. 1997.Google Scholar
- 52.G. Fujita, T. Onoye, and I. Shirakawa, “A New Motion Estimation Core Dedicated to h.263 Video Coding,” in Proc. IEEE Circuits and Systems, vol. 2, 1997, pp. 1161-1164.Google Scholar