Instrument Modeling and Synthesis

  • Andrew B. Horner
  • James W. Beauchamp
Chapter

During the 1970s and 1980s, before synthesizers based on direct sampling of musical sounds became popular, replicating musical instruments using frequency modulation (FM) or wavetable synthesis was one of the “holy grails” of music synthesis. Synthesizers such as the Yamaha DX7 allowed users great flexibility in mixing and matching sounds, but were notoriously difficult to coerce into producing sounds like those of a given instrument. Instrument design wizards practiced the mysteries of FM instrument design.

Keywords

Genetic Algorithm Modulation Index Instrument Modeling Genetic Algorithm Method Amplitude Envelope 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.
This is a preview of subscription content, log in to check access.

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Beauchamp, J.W. (1974), “Time-Variant Spectra of Violin Tones”, J. Acoust. Soc, Am. 56(3), 995–1004.CrossRefADSGoogle Scholar
  2. Beauchamp, J. (1982). “Synthesis by Amplitude and ‘Brightness’ Matching of Analyzed Musical Instrument Tones”, J. Audio Eng. Soc. 30(6), pp. 396–406.Google Scholar
  3. Beauchamp, J. (1992). “Will the Real FM Equation Please Stand Up”(letter), Comput. Music J. 16(4), pp. 6–7.CrossRefGoogle Scholar
  4. Beauchamp, J.W., R.C. Maher, & R. Brown (1993). “Detection of Musical Pitch from Recorded Solo Performances”, Audio Eng. Soc. Preprint No. 3541.Google Scholar
  5. Beauchamp, J.W., & A, Horner (1995). “Wave table Interpolation Synthesis Based on Time-Variant Spectral Analysis of Musical Sounds”, Audio Eng. Soc. Preprint No. 3960.Google Scholar
  6. Beauchamp, J., & A. Horner (1998). “Spectral Modeling and Timbre Hybridization Programs for Computer Music”, Organ. Sound 2(3), pp. 253–258.CrossRefGoogle Scholar
  7. Beauchamp, J.W. (2007). “Analysis and Synthesis of Musical Instrument Sounds”, in Analysis, Synthesis, and Perception of Musical Sounds; J.W. Beauchamp, ed., New York: Springer, pp. 1–89.CrossRefGoogle Scholar
  8. Bristow-Johnson, R. (1996). “Wavetable Synthesis 101, A Fundamental Perspective”, Audio Eng. Soc. Preprint No. 4400.Google Scholar
  9. Brown, J.C. (1996). “Frequency ratios of Spectral Components of Musical Sounds”, J. Acoust. Soc. Am. 99(2), 1210–1218.CrossRefADSGoogle Scholar
  10. Chamberlin, H. (1980). “Advanced Real-Timbre Music Synthesis Techniques”, Byte Magazine April, pp. 70–94, 180–196.Google Scholar
  11. Cheung, N.-M., & A. Horner (1996). “Group Synthesis with Genetic Algorithms”, J. Audio Eng. Soc. 44(3), pp. 130–147.Google Scholar
  12. Chowning, J. (1973). “The Synthesis of Complex Audio Spectra by Means of Frequency Modulation”, J. Audio Eng. Soc. 21(7), pp. 526–534.Google Scholar
  13. Chowning, J. (1980). “Computer Synthesis of the Singing Voice”, Sound Generation in Wind, Strings, Computers, Stockholm: The Royal Swedish Academy of Music, pp. 4–13.Google Scholar
  14. Delprat, N., P. Guillemain, & R. Kronland-Martinet (1990). “Parameter Estimation for Non-linear Resynthesis Methods with the Help of a Time–Frequency Analysis of Natural Sounds”, Proc. 1990 Int. Computer Music Conf., Glasgow, Scotland, pp. 88–90.Google Scholar
  15. Delprat, N. (1997). “Global Frequency Modulation Law Extraction from the Gabor Transform of a Signal: A First Study of the Interacting Components Case”, IEEE Trans. Speech Audio Process. 5(1), pp. 64–71.CrossRefGoogle Scholar
  16. Dubnof, S. & X. Rodet (2003), “Investigation of phase Coupling Phenomend in Sustained Portion of Musical Instrument Sound”, J. Acoust, Soc. 113(1), 348–359.CrossRefADSGoogle Scholar
  17. Dunteman, G. (1989). Principal Components Analysis, Newbury Park, CA: Sage.Google Scholar
  18. Ehmann, A. F., & J. W. Beauchamp (2002) “Musical sound analysis/synthesis using vector-quantized time-varying spectra” (abstract),J. Acoust. Soc. Am. 112 (5, pt. 2), p. 2239.Google Scholar
  19. Flanagan, J. L., & R. M. Golden (1966). “Phase Vocoder”, Bell Syst. Tech. J. 45, pp. 1493–1509.Google Scholar
  20. Fletcher, H., E. D. Blackham, & R. Stratton (1962). “Quality of Piano Tones”, J. Acoust. Soc. Am. 34(6), pp. 749–761.CrossRefADSGoogle Scholar
  21. Goldberg, D. (1989). Genetic Algorithms in Search, Optimization, and Machine Learning, Reading, MA: Addison-Wesley.MATHGoogle Scholar
  22. Grey, J. (1975). “An Exploration of Musical Timbre”, Ph.D. Dissertation, Stanford: Dept. of Music, Stanford Univ.Google Scholar
  23. Horner, A., J. Beauchamp, & L. Haken (1992). “Wavetable and FM Matching Synthesis of Musical Instrument Tones”, Proc. 1992 Int. Computer Music Conf., San Jose, CA, pp. 18–21.Google Scholar
  24. Horner, A., J. Beauchamp, & L. Haken (1993a). “Methods for Multiple Wavetable Synthesis of Musical Instrument Tones”, J. Audio Eng. Soc. 41(5), pp. 336–356.Google Scholar
  25. Horner, A., J. Beauchamp, & L. Haken (1993b). “Machine Tongues XVI: Genetic Algorithms and Their Application to FM Matching Synthesis”, Comput. Music J. 17(4), pp. 17–29.CrossRefGoogle Scholar
  26. Horner, A. (1995). “Wavetable Matching Synthesis of Dynamic Instruments with Genetic Algorithms”, J. Audio Eng. Soc. 43(11), pp. 916–931.Google Scholar
  27. Horner, A. & J. Beauchamp (1995), “Synthesis of Trumpet Tones Using a Wavetable and a Dynamic Filter”, J. Audio Eng. Soc. 43(10), 799–812.Google Scholar
  28. Horner, A. (1996a). “Double Modulator FM Matching of Instrument Tones”, Comput. Music J. 20(2), pp. 57–71.CrossRefGoogle Scholar
  29. Horner, A. (1996b). “Computation and Memory Tradeoffs with Multiple Wavetable Interpolation”, J. Audio Eng. Soc. 44(6), pp. 481–496.Google Scholar
  30. Horner, A., & J. Beauchamp (1996). “Piecewise Linear Approximation of Additive Synthesis Envelopes: A Comparison of Various Methods”, Comput. Music J. 20(2), pp. 72–95.CrossRefGoogle Scholar
  31. Horner, A. (1997). “A Comparison of Wavetable and FM Parameter Spaces”, Comput. Music J. 21(4), pp. 55–85.CrossRefGoogle Scholar
  32. Horner, A. (1998). “Nested Modulator and Feedback FM Matching of Instrument Tones”, IEEE Trans. Speech Audio Process. 6(4), pp. 398–409.CrossRefGoogle Scholar
  33. Horner, A., & L. Ayers (1998). “Modeling Acoustic Wind Instruments with Contiguous Group Synthesis”, J. Audio Eng. Soc. 46(10), pp. 868–879.Google Scholar
  34. Horner, A. (2001). “A Simplified Wavetable Matching Method Using Combinatorial Basis Spectra Selection”, J. Audio Eng. Soc. 49(11), pp. 1060–1066.Google Scholar
  35. Horner, A., J. Beauchamp, & R. So (2006). “A Search for Best Error Metrics to Predict Discrimination of Original and Spectrally Altered Musical Instrument Sounds”, J. Audio Eng. Soc. 54(3), 140–156.Google Scholar
  36. Horner, A. (2007). “A Comparison of Wavetable and FM Data Reduction Methods for Resynthesis of Musical Sounds”, in Analysis, Synthesis, and Perception of Musical Sounds, J. W. Beauchamp, ed., New York: Springer, pp. 228–249.Google Scholar
  37. Justice, J. (1979). “Analytic Signal Processing in Music Computation”, IEEE Trans. Acoust. Speech Signal Process. 27(6), pp. 670–684.CrossRefGoogle Scholar
  38. Kleczkowski, P. (1989). “Group Additive Synthesis”, Comput. Music J. 13(1), pp. 12–20.CrossRefMathSciNetGoogle Scholar
  39. Le Brun, M. (1977). “A Derivation of the Spectrum of FM with a Complex Modulating Wave”, Comput. Music J. 1(4), pp. 51–52.Google Scholar
  40. Lee, K., & A. Horner (1999). “Modeling Piano Tones with Group Synthesis”, J. Audio Eng. Soc. 47(3), pp. 101–111.MATHGoogle Scholar
  41. Lim, S. M., & B. T. G. Tan (1999). “Performance of the Genetic Annealing Algorithm in DFM Synthesis of Dynamic Musical Sound Samples”, J. Audio Eng. Soc. 47(5), pp. 339–354.Google Scholar
  42. Maher, R., & J. Beauchamp (1990). “An Investigation of Vocal Vibrato for Synthesis”, Appl. Acoust. 30, pp. 219–245.CrossRefGoogle Scholar
  43. Maher, R.C. & J.W. Beauchamp (1994). “Fundamental Frequency Estimation of Musical Signals Using a Two-way Mismatch Procedures”, J. Acoust. Soc. Am. 95(4), 2254–2263.CrossRefADSGoogle Scholar
  44. Mathews, M. V. (1969). The Technology of Computer Music, Cambridge, MA: MIT Press, p. 56.Google Scholar
  45. McAulay, R. J., & T. F. Quatieri (1986). “Speech Analysis/Synthesis Based on a Sinusoidal Representation”, IEEE Trans. Acoust. Speech Signal Process. 34(4), pp. 744–754.CrossRefGoogle Scholar
  46. Mitsuhashi, Y. (1982). “Musical Sound Synthesis by Forward Differences”, J. Audio Eng. Soc. 30(1/2), pp. 2–9.Google Scholar
  47. Morrill, D. (1977). “Trumpet Algorithms for Computer Composition”, Comput. Music J. 1(1), pp. 46–52.MathSciNetGoogle Scholar
  48. Oates, S., & B. Eaglestone (1997). “Analytic Methods for Group Additive Synthesis”, Comput. Music J. 21(2), pp. 21–39.CrossRefGoogle Scholar
  49. Payne, R. (1987). “A Microcomputer Based Analysis/Resynthesis Scheme for Processing Sampled Sounds Using FM”, Proc. 1987 Int. Computer Music Conf., Urbana, IL, pp. 282–289.Google Scholar
  50. Portnoff, M. R. (1976). “Implementation of the Digital Phase Vocoder Using the Fast Fourier Transform”, IEEE Trans. Acoust. Speech Signal Process. ASSP-24(3), pp. 243–248.CrossRefGoogle Scholar
  51. Rabiner, L., & B.-H. Juang (1993). Fundamentals of Speech Recognition, New Jersey: Prentice Hall, pp. 122–132.Google Scholar
  52. Sandell, G., & W. Martens (1992). “Prototyping and Interpolation of Multiple Musical Timbres Using Principal Component-Bases Synthesis”, Proc. 1992 Int. Computer Music Conf., San Jose, CA, pp. 34–37.Google Scholar
  53. Sandell, G., & W. Martens (1995). “Perceptual Evaluation of Principal-Component-Based Synthesis of Musical Timbres”, J. Audio Eng. Soc. 43(12), pp. 1013–1028.Google Scholar
  54. Schottstaedt, B. (1977). “The Simulation of Natural Instrument Tones Using Frequency Modulation with a Complex Modulating Wave”, Comput. Music J. 1(4), pp. 46–50.Google Scholar
  55. Schumacher, R.T. (1992). “Analysis of Aperiodicities in Nearly Periodic Waveforms”, J. Acoust. Soc. Am. 91(1), 438–451.CrossRefADSGoogle Scholar
  56. Serra, M.-H., D. Rubine, & R. Dannenberg (1990). “Analysis and Synthesis of Tones by Spectral Interpolation”, J. Audio Eng. Soc. 38(3), pp. 111–128.Google Scholar
  57. Smith, J. O., & X. Serra (1987). “PARSHL: An Analysis/Synthesis Program for Non-harmonic Sounds Based on a Sinusoidal Representation”, Proc. 1987 Int. Computer Music Conf., Urbana, IL, pp. 290–297.Google Scholar
  58. So, K. F., & A. Horner (2002). “Wavetable Matching of Inharmonic String Tones”, J. Audio Eng. Soc. 50(1/2), pp. 47–57.Google Scholar
  59. Tan, B. T. G., S. L. Gan, S. M. Lim, & S. H. Tang (1994). “Real-Time Implementation of Double Frequency Modulation (DFM) Synthesis”, J. Audio Eng. Soc. 42(11), pp. 918–926.Google Scholar
  60. Tan, B. T. G., & S. M. Lim, (1996). “Automated Parameter Optimization for Double Frequency Modulation Synthesis Using the Genetic Annealing Algorithm”, J. Audio Eng. Soc. 44(1/2), pp. 3–15.Google Scholar
  61. Tomisawa, N. (1981). “Tone Production Method for an Electronic Music Instrument”, U.S. Patent 4,249,447.Google Scholar
  62. Zahorian, S., & M. Rothenberg (1981). “Principal-Components Analysis for Low Redundancy Encoding of Speech Spectra”, J. Acoust. Soc. Am. 69(3), pp. 832–845.CrossRefADSGoogle Scholar
  63. Zheng, H., & J. Beauchamp (1999). “Analysis and Critical-Band-Based Group Wavetable Synthesis of Piano Tones”, Proc. 1999 Int. Computer Music Conf., Beijing, China, pp. 9–12.Google Scholar

Copyright information

© Springer Science+Business Media, LLC 2008

Authors and Affiliations

  • Andrew B. Horner
    • 1
  • James W. Beauchamp
    • 2
  1. 1.Department of Computer ScienceHong Kong University of Science and Technology Clear Water BayKowloonChina
  2. 2.School of Music and Department of Electrical and Computer EngineeringUniversity of Illinois at Urbana-ChampaignUrbanaUSA

Personalised recommendations