Cluster-Weighted Modeling: Probabilistic Time Series Prediction, Characterization, and Synthesis

  • Bernd Schoner
  • Neil Gershenfeld


Cluster-weighted modeling, a mixture density estimator around local models, is presented as a framework for the analysis, prediction and characterization of non-linear time series. First architecture, model estimation and characterization formalisms are introduced. The characterization tools include estimator uncertainty, predictor uncertainty, and the correlation dimension of the data set. in the second part of this chapter the framework is extended to synthesize audio signals and is applied to model a violin in a data-driven input-output approach.


Local Model Audio Signal Audio Data Cluster Parameter Finger Position 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. [1]
    Shunichi Amari. Information Geometry of the EM and em Algorithms for Neural Networks. Neural Networks, 8 (9): 1379–1408, 1995.CrossRefGoogle Scholar
  2. [2]
    Andrew R. Barron. Universal approximation bounds for superpositions of a sigmoidal function. IEEE Transactions on Information Theory, 39: 930–945, 1993.MATHCrossRefGoogle Scholar
  3. [3]
    W.L. Buntine. A guide to the literature on learning probabilistic networks from data. IEEE Transactions on Knowledge and Data Engineering, 1996.Google Scholar
  4. [4]
    Martin Casdagli. A dynamical systems approach to modeling input-output systems. In M. Casdagli and S. Eubank, editors, Nonlinear Modeling and Forecasting, Santa Fe Institute Studies in the Sciences of Complexity, pages 265–281, Redwood City, 1992. Addison-Wesley.Google Scholar
  5. [5]
    W.S. Cleveland and S.J. Devlin. Regression analysis by local fitting. J. A. Statist. Assoc., 83: 596–610, 1988.MATHCrossRefGoogle Scholar
  6. [6]
    Lothar Cremer. The Physics of the Violin. MIT Press, Cambridge, Massachusetts, 1984.Google Scholar
  7. [7]
    A.P. Dempster, N.M. Laird, and D.B. Rubin. Maximum Likelihood From Incomplete Data via the EM Algorithm. J. R. Statist. Soc. B, 39: 1–38, 1977.MathSciNetMATHGoogle Scholar
  8. [8]
    Neil Gershenfeld. The Nature of Mathematical Modeling. Cambridge University Press, New York, 1999.MATHGoogle Scholar
  9. [9]
    D. Beckerman and M. Wellman. Bayesian Networks. Communications of the Association Machinery. 1995.Google Scholar
  10. [10]
    M.I. Jordan and R.A. Jacobs. Hierarchical mixtures of experts and the EM algorithm. Neural Computation, 6: 181–214, 1994.CrossRefGoogle Scholar
  11. [11]
    Michael Jordan, editor. Learning in Graphical Models. MIT Press, Cambridge, Massachusetts, 1998.MATHGoogle Scholar
  12. [12]
    Dana C. Massie. Wavetable sampling synthesis. In Mark Kahrs and Karlheinz Brandenburg, editors, Applications of Digital Signal Processing to Audio and Acoustics, pages 311–341. Kluwer Academic Publishers, 1998.Google Scholar
  13. [13]
    R.J. McAulay and T.F. Quatieri. Speech analysis/synthesis based on a sinusoidal representation. IEEE Transactions on Acoustics, Speech and Signal Processing, ASSP-34 No. 4: 744–754, 1986.CrossRefGoogle Scholar
  14. [14]
    M.E. McIntyre and J. Woodhouse. On the fundamentals of bowed-string dynamics. Acustica, 43 (2): 93–108, 1979.MATHGoogle Scholar
  15. [15]
    Radford M. Neal. Bayesian Learning for Neural Networks. Springer, New York, 1996.MATHGoogle Scholar
  16. [16]
    Radford M. Neal and Geoffrey E. Hinton. A new view of the em algorithm that justifies incremental and other variants, 1993.Google Scholar
  17. [17]
    Lawrence R. Rabiner. A tutorial on hidden markov models and selected applications in speech recognition. Proceedings of the IEEE, 77: 257–286, 1989.CrossRefGoogle Scholar
  18. [18]
    B. Schoner, C. Cooper, C. Douglas, and N. Gershenfeld. Data-driven modeling of acoustical instruments. Journal for New Music Research, 28 (2): 81–89, 1999.CrossRefGoogle Scholar
  19. [19]
    Xavier Serra and Julius O. Smith. Spectral modeling synthesis: A sound analysis/synthesis system based on a deterministic plus stochastic decomposition. Computer Music Journal, 14 (4): 12–24, 1990.CrossRefGoogle Scholar
  20. [20]
    J. Smith and P. Gosset. A flexible sampling-rate conversion method. In Acoustics, Speech, and Signal Processing, San Diego, volume 2, 1984.Google Scholar
  21. [21]
    Julius O. Smith. Physical modeling using digital waveguides. Computer Music Journal, 6 (4), 1992.Google Scholar
  22. [22]
    Floris Takens. Detecting strange attractors in turbulence. In D.A. Rand and L.S. Young, editors, Dynamical Systems and Turbulence, volume 898 of Lecture Notes in Mathematics, pages 366–381, New York, 1981. Springer-Verlag.CrossRefGoogle Scholar

Copyright information

© Springer Science+Business Media New York 2001

Authors and Affiliations

  • Bernd Schoner
  • Neil Gershenfeld

There are no affiliations available

Personalised recommendations