Software-Based Video/Audio Processing for Cellular Phones
- 68 Downloads
Nowadays, most cellular phones are used beyond voice communication. Although the processing power of cellular phones is sufficient for most data applications, it is difficult to play video and audio contents in software because of their computational complexity and lack of basic tools for multimedia processing, so software-based multimedia processing on cellular phones is a challenging issue. Several transcoding methods are introduced to address this issue, but they are mainly of the DCT-domain conversion. Hence, they are only applicable to high-end cellular phones. To develop a solution for low-end and mid-tier cellular phones, we begin this paper by analyzing the complexity of existing video standards to see if it is possible to play them on cellular phones by software. Next, various coding profiles as combinations of subalgorithms are studied, and we select a profile that adapts its complexity to the processing power of cellular phones. Also, an efficient dithering algorithm called out-of-order dithering is developed. We implement the profile with out-of-order dithering in an actual cellular phone software environment and present the performance results. The performance results show that software based video/audio processing is indeed possible on low-end cellular phones.
Keywordsvideo/audio processing cellular phone adaptation
Unable to display preview. Download preview PDF.
- Y. Arai, T. Agui and M. Nakajima, A fast DCT-SQ scheme for images, Transactions of IEICE 71 (1988) 1095–1097. Google Scholar
- ARM, http://www.arm.com.
- P.A.A. Assuncao and M. Ghanbari, Transcoding of MPEG-2 video in the frequency domain, in: Proc. of IEEE Internat. Conf. on Acoustics, Speech, and Signal Processing (ICASSP), Vol. 4 (April 1997) pp. 2633–2636. Google Scholar
- Coding of audio-visual objects, part 2: visual, ISO/IEC, 14496-2 (December 1999). Google Scholar
- R. Dugad and N. Ahuja, A fast scheme for downsampling and upsampling in the DCT domain, in: Proc. of IEEE Internat. Conf. on Image Processing (ICIP), Vol. 2 (October 1999) pp. 909–913. Google Scholar
- E. Feig and S. Winograd, Fast algorithms for the discrete cosine transform, IEEE Transactions on Signal Processing 40 (1992) 2174–2193. Google Scholar
- B. Gordon, N. Ghaddha and T.H. Meng, Low-power multiplierless YUV to RGB converter bases on human vision perception, invited chapter, in: Low Power/Low Voltage Integrated Circuits and Systems, ed. E. Sanchez-Sinencio (IEEE Press, New York, 1994) pp. 408–417. Google Scholar
- A. Graps, An introduction to wavelets, IEEE Computational Science and Engineering 2(2) (1995) 50–61. Google Scholar
- R. Han, P. Bhagwat, R. LaMaire, T. Mummert, V. Perret and J. Rubas, Dynamic adaptation in an image transcoding proxy for mobile Web browsing, IEEE Personal Communications Magazine (1998) 8–17. Google Scholar
- J.-H. Jeong and C. Yoo, A server-centric streaming model, in: Proc. of NOSSDAV 2000 (June 2000) pp. 25–34. Google Scholar
- Y. Joo, Y. Choi, H. Shim, H.G. Lee, K. Kim and N. Chang, Energy exploration and reduction of SDRAM memory systems, in: Proc. of ACM Conf. on Design Automation, USA (2002) pp. 892–897. Google Scholar
- D. Legall, MPEG – A video compression standard for multimedia applications, Communications of the ACM 34(4) (1991) 46–48. Google Scholar
- D.A. Lelewer and D.S. Hirschberg, Data Compression, ACM Computing (Springer, Heidelberg/New York, 1989). Google Scholar
- C. Loeffler, A. Ligtenberg and C.S. Moschytz, Practical fast 1D DCT algotithm with eleven multiplications, in: Proc. of ICASSP (1989) pp. 988–991. Google Scholar
- N. Merhav and V. Bhaskaran, Fast algorithms for DCT domain image down sampling and for inverse motion compensation, IEEE Transactions on Circuits and Systems Video Technology 7(3) (1997) 468–476. Google Scholar
- D.G. Morrison, M.E. Nilson and M. Ghabari, Reduction of the bit-rate of compressed video while in its coded form, in: Proc. of Internat. Packet Video Workshop, Portland, OR (September 1994) pp. D17.1–17.4. Google Scholar
- Mulcahy C., Image compression using the Haar wavelet transform, Spelman Science and Mathematics Journal 1(1) (1997) 22–31. Google Scholar
- Qualcomm Corp., http://www.qualcomm.com.
- I.E.G. Richardson, H.264 and MPEG-4 Video Compression (Wiley, New York, 2003). Google Scholar
- A. Said and W.A. Pearlman, A new fast and efficient image codec based on set partitioning in hierarchical trees, IEEE Transactions on Circuits and Systems for Video Technology 6 (June 1996) 243–250. Google Scholar
- Samsung Electronics Co., http://www.sec.co.kr.
- T. Shanableh and M. Ghanbari, Heterogeneous video transcoding to lower spatio-temporal resolutions and different encoding formats, IEEE Transactions on Multimedia 2(2) (2000) 101–110. Google Scholar
- J.M. Shapiro, Embedded image coding using zero trees of wavelet coefficients, IEEE Transactions on Signal Processing 41(12) (1993) 3445–3462. Google Scholar
- SK Telecom, http://www.sktelecom.com.
- B. Sostawa, T. Dannemann and J. Speidel, DSP-based transcoding of digital video signals with MPEG-2 format, IEEE Transactions on Consumer Electronics 46(2) (2000) 358–362. Google Scholar
- R. Talluri, Error-resilient video coding in the ISO MPEG-4 standard, IEEE Communication Magazine 36 (June 1998) 112–119. Google Scholar
- R. Ulichney, A review of halftoning techniques, Proceedings of SPIE 3963 (2000) 378–391. Google Scholar
- Video coding for low bit rate communication, ITU-T Recommendation H.263, version 1 (November 1995), version 2 (January 1998), version 3 (November 2000). Google Scholar
- G.K. Wallace, The JPEG still picture compression standard, IEEE Transactions on Computer Electronics 38(1) (1991) 18–34. Google Scholar
- J. Wen, P. Meshkat and J. Villasenor, Structured trees for lossless coding of quantized wavelet coefficients, in: Proc. of Asilomar Conf. on Signals, Systems, and Computers (November 1996) pp. 3–6. Google Scholar
- J. Youn and M. Sun, Motion vector refinement for high performance transcoding, IEEE Transactions on Multimedia 1(1) (1999) 30–40. Google Scholar
- Q. Yu and K.J. Parker, Quality issues in blue noise halftoning, Proceedings of SPIE 3300 (1998) 376–385. Google Scholar
- W. Zhu, K. Yang and M. Beacken, CIF-to-QCIF video bitstream down-conversion in the DCT domain, Bell Labs Technical Journal 3(3) (1998) 21–29. Google Scholar