This paper proposes a fast decision algorithm in pattern classification based on Gaussian mixture models (GMM). Statistical pattern classification problems often meet a situation that comparison between probabilities is obvious and involve redundant computations. When GMM is adopted for the probability model, the exponential function should be evaluated. This work firstly reduces the exponential computations to simple and rough interval calculations. The exponential function is realized by scaling and multiplication with powers of two so that the decision is efficiently realized. For finer decision, a refinement process is also proposed. In order to verify the significance, experimental results on TI DM6437 EVM board and TED TB-3S-3400DSP-IMG board are shown through the application to a color extraction problem. It is verified that the classification was almost completed without any refinement process and the refinement process can proceed the residual decisions.
This is a preview of subscription content, log in to check access.
Buy single article
Instant access to the full article PDF.
Price includes VAT for USA
Subscribe to journal
Immediate online access to all issues from 2019. Subscription will auto renew annually.
This is the net price. Taxes to be calculated in checkout.
Jain, A. K., Duin, R. P. W., & Mao, J. (2000). Statistical pattern recognition: A review. IEEE Transactions on Pattern Analysis and Machine Intelligence, 22(1), 4–37.
McKenna, S. J., Gong, S., & Raja, Y. (1998). Modeling facial colour and identity with Gaussian mixtures. Pattern Recognition, 31(12), 1883–1892.
Phung, S. L., Bouzerdoum, A., & Chai, D. (2005). Skin segmentation using color pixel classification: Analysis and comparison. IEEE Transactions on Pattern Analysis and Machine Intelligence, 27(1), 148–154.
Cui, X., & Gong, Y. (2007). A study of variable-parameter Gaussian mixture hidden Markov modeling for noisy speech recognition. IEEE Trans. on Audio, Speech and Language Proc., 15(4), 1366–1376.
Ueda, N., & Ghahramani, Z. (2002). Bayesian model search for mixture models based on optimizing variational bounds. Neural Networks, 15, 1223–1241.
Nasios, N., & Bors, A. G. (2006). Variational learning for Gaussian mixture models. IEEE Transactions on Systems, Man, and Cybernetics. Part B, 36(4), 849–862.
Bishop, C. M. (2006). Pattern recognition and machine learning. New York: Springer.
Shi, M., Bermak, A., Chandrasekaran, S., & Amira, A. (2006). An efficient FPGA implementation of Gaussian mixture models-based classifier using distributed arithmetic. In IEEE Proc. of int. conf. on electronics, circuits and systems ’06 (pp. 1276–1279).
Shi, M., & Bermak, A. (2006). An efficient digital VLSI implementation of Gaussian mixture models-based classifier. IEEE Transactions on Very Large Scale Iintegration (VLSI) Systems, 14(9), 962–974.
Meyer-Baese, U. (2007). Digital signal processing with field programmable gate arrays (3rd edn.). New York: Springer.
Press, W. H., Teukolsky, S. A., Vetterling, W. T., & Flannery, B. P. (2007). Numerical recipes: The art of scientific computing (3rd edn.). Cambridge: Cambridge University Press.
The authors would like to acknowledge the support from the Texas Instruments University program.
Appendix: Derivation of Eq. 15
Appendix: Derivation of Eq. 15
The following relation is used for deriving Eq. 15:
About this article
Cite this article
Watanabe, H., Muramatsu, S. Fast Algorithm and Efficient Implementation of GMM-Based Pattern Classifiers. J Sign Process Syst 63, 107–116 (2011). https://doi.org/10.1007/s11265-009-0439-z
- Pattern classification
- Gaussian mixture model
- Bayesian decision
- Efficient implementation
- color extraction