Skip to main content

Part of the book series: Springer Handbooks ((SHB))

Abstract

This chapter covers algorithms, technologies, computer languages, and systems for computer music. Computer music involves the application of computers and other digital/electronic technologies to music composition, performance, theory, history, and the study of perception. The field combines digital signal processing, computational algorithms, computer languages, hardware and software systems, acoustics, psychoacoustics (low-level perception of sounds from the raw acoustic signal), and music cognition (higher-level perception of musical style, form, emotion, etc.).

Although most people would think that analog synthesizers and electronic music substantially predate the use of computers in music, many experiments and complete computer music systems were being constructed and used as early as the 1950s.

Because of this rich legacy, and the large number of researchers working on digital audio (primarily in speech research laboratories), there are a large number of algorithms for synthesizing sound using computers. Thus, a significant emphasis in this chapter will be placed on digital sound synthesis and processing, first providing an overview of the representation of audio in digital systems, then covering most of the popular algorithms for digital analysis and synthesis of sound.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 269.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Hardcover Book
USD 349.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Abbreviations

A/D:

analog to digital

ADC:

analog-to-digital converter

ADSR:

attack time, decay time, sustain level, and release time

BoSSA:

bowed sensor speaker array

D/A:

digital-to-analog

DAC:

digital-to-analog converter

DAFX:

digital audio effects

DAW:

digital audio workstation

DFT:

discrete Fourier transform

DLS:

downloadable sounds

DSP:

digital signal processing

EMI:

experiments in musical intelligence

FFT:

fast Fourier transform

FM:

frequency modulation

FOF:

formes dʼonde formantiques

ICMC:

International Computer Music Conference

IDFT:

inverse DFT

IIR:

infinite impulse response

IP:

internet protocol

KLOrk:

Kalamazoo Laptop Orchestra

L2Ork:

Linux Laptop Orchestra of Virginia Tech

LEMUR:

League of Electronic Musical Urban Robots

LOL:

Laptop Orchestra of Louisiana

LORkAS:

Laptop Orchestra of Arizona State

LPC:

linear predictive coding

LTI:

linear and time invariant

MI:

mechanical index

MIDI:

musical instrument digital interface

MIR:

music information retrieval

MIREX:

music information retrieval evaluation exchange

MPEG4:

moving-picture experts group 4

MSE:

mean square error

MoPho:

Mobile Phone Orchestra

NIME:

new interfaces for musical expression

OLO:

Oslo Laptop Orchestra

OSC:

open sound control

PC:

personal computer

PCM:

pulse code modulation

PD:

pure data

PLOrk:

Princeton Laptop Orchestra

PM:

phase modulation

PhISEM:

physically informed stochastic event modeling

SAOL:

structured audio orchestra language

SARA:

simple analytic recombinant algorithm

SDIF:

sound description interchange format

SLOrk:

Stanford Laptop Orchestra

SNR:

signal-to-quantization-noise ratio

SRATE:

sampling rate

STFT:

short-time Fourier transform

TCP:

transmission control protocol

WASPAA:

IEEE Workshop on Applications of Signal Processing to Audio and Acoustics

XMF:

extensible music file

References

  1. K. Pohlmann: Principles of Digital Audio (McGraw Hill, New York 2000)

    Google Scholar 

  2. J.O. Smith, P. Gossett: A flexible sampling-rate conversion method, Proc. Int. Conf. Acoustics Speech and Signal Processing, Vol. 2 (IEEE, Piscataway 1984) pp. 19.4.1–19.4.2

    Google Scholar 

  3. T. Dutoit: An Introduction to Text-To-Speech Synthesis (Kluwer, Dordrecht 1996)

    Google Scholar 

  4. R. Bristow-Johnson: Wavetable synthesis 101: a fundamental perspective, AES 101 Conference (AES, New York 1996), Music-DSPSource Archive (http://www.musicdsp.org)

    Google Scholar 

  5. M.V. Mathews: The Technology of Computer Music (MIT Press, Cambridge 1969)

    Google Scholar 

  6. R. Bracewell: The Fourier Transform and itʼs Applications (McGraw Hill, New York 1999)

    Google Scholar 

  7. X. Serra, J.O. Smith: Spectral modeling synthesis: Sound analysis/synthesis based on a deterministic plus stochastic decomposition, Comput. Music J. 14(4), 1–2 (1990)

    Article  Google Scholar 

  8. R.J. McAulay, T. Quatieri: Speech analysis/synthesis based on a sinusoidal representation, IEEE Trans. ASSP 34, 744–754 (1986)

    Article  Google Scholar 

  9. T. Verma, T. Meng: An analysis/synthesis tool for transient signals that allows a flexible sines+transients+noise model for audio, 1998 IEEE ICASSP-98 (IEEE, Piscataway 1998)

    Google Scholar 

  10. A. Moorer: The use of the phase vocoder in computer music applications, J. Audio Eng. Soc. 26(1/2), 42–45 (1978)

    Google Scholar 

  11. M. Dolson: The phase vocoder: A tutorial, Comput. Music J. 10(4), 14–27 (1986)

    Article  Google Scholar 

  12. P. Cook: Real Sound Synthesis for Interactive Applications (AK Peters, Wellesley 2002)

    Google Scholar 

  13. P. Morse: Vibration and Sound (Acoustical Society of America, New York 1986)

    Google Scholar 

  14. K. Steiglitz: A Digital Signal Processing Primer (Addison Wesley, Boston 1996)

    Google Scholar 

  15. J.M. Adrien: The missing link: Modal synthesis. In: Representations of Musical Signals, ed. by G. de Poli, A. Piccialli, C. Roads (MIT Press, Cambridge 1991) pp. 269–297, Chap. 8

    Google Scholar 

  16. H. Dudley: The Vocoder (Bell Laboratories Record, Mirray Hill 1939), reprinted in IEEE Trans. ASSP29(3), 347–351 (1981)

    Google Scholar 

  17. B. Atal: Speech analysis and synthesis by linear prediction of the speech wave, J. Acoust. Soc. Am. A47(65), 65 (1970)

    ADS  Google Scholar 

  18. A. Moorer: The use of linear prediction of speech in computer music applications, J. Audio Eng. Soc. 27(3), 134–140 (1979)

    Google Scholar 

  19. D. Klatt: Software for a cascade/parallel formant synthesizer, J. Acoust. Soc. Am. 67(3), 971–995 (1980)

    Article  ADS  Google Scholar 

  20. J.L. Kelly Jr., C.C. Lochbaum: Speech synthesis, Proc. Fourth ICA (Paper G42, Copenhagen 1962)

    Google Scholar 

  21. J.M. Chowning: The synthesis of complex audio spectra by means of frequency modulation, J. Audio Eng. Soc. 21(7), 526–534 (1973)

    Google Scholar 

  22. J. Chowning: The synthesis of complex audio spectra by means of frequency modulation, Comput. Music J. 1(2) (1977), reprinted

    Google Scholar 

  23. J. Chowning: The synthesis of complex audio spectra by means of frequency modulation. In: Foundations of Computer Music, ed. by C. Roads, J. Strawn (MIT Press, Cambridge 1985), reprinted

    Google Scholar 

  24. J. Chowning: Frequency modulation synthesis of the singing voice. In: Current Directions in Computer Music Research, ed. by M.V. Mathews, J.R. Pierce (MIT Press, Cambridge 1980)

    Google Scholar 

  25. X. Rodet: Time-domain formant-wave-function synthesis, Comput. Music J. 8(3), 9–14 (1984)

    Article  Google Scholar 

  26. I. Daubechies: Orthonormal bases of compactly supported wavelets, Commun. Pure Appl. Math. 41, 909–996 (1988)

    Article  MATH  MathSciNet  Google Scholar 

  27. C. Roads: Asynchronous granular synthesis. In: Representations of Musical Signals, ed. by G. De Poli, A. Piccialli, C. Roads (MIT Press, Cambridge 1991) pp. 143–185

    Google Scholar 

  28. C. Roads: Microsound (MIT Press, Cambridge 2004)

    Google Scholar 

  29. P. Cook: Physically informed sonic modeling (PhISM): Percussion instruments, Proceedings of the ICMC (International Computer Music Association, San Francisco 1996)

    Google Scholar 

  30. P. Cook: Physically informed sonic modeling (PhISM): Synthesis of percussive sounds, Comput. Music J. 21, 3 (1997)

    Article  Google Scholar 

  31. C. Cadoz, A. Luciani, J.L. Florens: CORDIS-ANIMA: A modeling and simulation system for sound image synthesis. The general formalization, Comput. Music J. 17(1), 23–29 (1993)

    Article  Google Scholar 

  32. K. Karplus, A. Strong: Digital synthesis of plucked-string and drum timbres, Comput. Music J. 7(2), 43–55 (1983)

    Article  Google Scholar 

  33. J.O. Smith: Acoustic modeling using digital waveguides. In: Musical Signal Processing, ed. by C. Roads, S.T. Pope, A. Piccialli, G. de Poli (Swets Zeitlinger, Exton 1997) pp. 221–264

    Google Scholar 

  34. D.A. Jaffe, J.O. Smith: Extensions of the Karplus-Strong plucked string algorithm, Comput. Music J. 7(2), 56–69 (1983)

    Article  Google Scholar 

  35. P.R. Cook, D. Trueman: Spherical radiation from stringed instruments: Measured, modeled, and reproduced, J. Catgut Acoust. Soc. 1, 1 (1999)

    Google Scholar 

  36. J.O. Smith, S.A. Van Duyne: Overview of the commuted piano synthesis technique, Proc. IEEE Workshop on Applications of Signal Processing to Audio and Acoustics, ed. by E. Wenzel (IEEE, New York 1995)

    Google Scholar 

  37. M.E. McIntyre, R.T. Schumacher, J. Woodhouse: On the oscillations of musical instruments, J. Acoust. Soc. Am. 74(5), 1325–1345 (1983)

    Article  ADS  Google Scholar 

  38. J.O. Smith: Efficient simulation of the reed-bore and bow-string mechanisms, Proc. Int. Computer Music Conf. (International Computer Music Association, San Francisco 1986) pp. 275–280

    Google Scholar 

  39. G. Essl, P. Cook: Banded waveguides: Towards physical modeling of bar percussion instruments, Proc. 1999 Int. Computer Music Conf., Beijing, China (International Computer Music Association, San Francisco 1999)

    Google Scholar 

  40. W. Verplank, M. Mathews, R. Shaw: Scanned synthesis, Proc. 2000 Int. Computer Music Conf., Berlin, Germany (International Computer Music Association, San Francisco 2000)

    Google Scholar 

  41. MMA: The Complete MIDI 1.0 Detailed Specification (MIDI Manufacturers Association, La Habra 1996)

    Google Scholar 

  42. S. Jungleib: General MIDI (A-R Editions, Middleton 1995)

    Google Scholar 

  43. M. Wright, A. Chaudhary, A. Freed, D. Wessel, X. Rodet, D. Virolle, R. Woehrmann, X. Serra: New Applications for the Sound Description Interchange Format, Proc. of the ICMC 1998 (International Computer Music Association, San Francisco 1998)

    Google Scholar 

  44. M. Wright, A. Freed: Open sound control: A new protocol for communicating with sound synthesizers, Proc. Int. Computer Music Conf. 1997 (International Computer Music Association, San Francisco 1997)

    Google Scholar 

  45. S.T. Pope: Machine Tongues XV: Three packages for software sound synthesis, Comput. Music J. 17(2), 23–54 (1993), Note: these are cmix, csound, cmusic

    Article  Google Scholar 

  46. J. McCartney: SuperCollider: A new real-time synthesis language, Proc. Int. Computer Music Conference (International Computer Music Association, San Francisco 1996) pp. 257–258

    Google Scholar 

  47. P. Burk: JSyn – A real-time synthesis API for java, Proc. Int. Computer Music Conference (International Computer Music Association, San Francisco 1998) pp. 252–255

    Google Scholar 

  48. P.R. Cook, G. Scavone: The synthesis toolkit (STK), Proc. Int. Computer Music Conf. (International Computer Music Association, San Francisco 1999) pp. 164–166

    Google Scholar 

  49. R.B. Dannenberg, E. Brandt: A flexible realtime software synthesis system, Proc. Int. Computer Music Conf. (International Computer Music Association, San Francisco 1996) pp. 270–273

    Google Scholar 

  50. R.B Dannenberg: Machine Tongues XIX: Nyquist, a language for composition and sound synthesis, Comput. Music J. 21(3), 50–60 (1997)

    Article  Google Scholar 

  51. G. Wang, P.R. Cook: ChucK: A concurrent on-the-fly audio programming language, Proc. Int. Computer Music Conf. (International Computer Music Association, San Francisco 2003) pp. 219–226

    Google Scholar 

  52. M. Puckette: Combining event and signal processing in the MAX graphical programming environment, Comput. Music J. 15(3), 68–77 (1991)

    Article  Google Scholar 

  53. M. Puckette: Pure data, Proc. Int. Computer Music Conf. (International Computer Music Association, San Francisco 1996) pp. 269–272

    Google Scholar 

  54. C. Leider: Digital Audio Workstation (McGraw-Hill/TAB Electronics, New York 2004)

    Google Scholar 

  55. D. Trueman, P. Cook: BoSSA: The deconstructed violin reconstructed, J. New Music Res. 29(2), 120–130 (2000)

    Google Scholar 

  56. D. Trueman, C. Bahn, P. Cook: Alternative voices for electronic sound, Spherical speakers and sensor-speaker arrays (SenSAs), International Computer Music Conference, Berlin, Aug. 2000 (International Computer Music Association, San Francisco 2000)

    Google Scholar 

  57. M.V. Mathews: The radio baton and conductor program, or: Pitch, the most important and least expressive part of music, Comput. Music J. 15(4), 37–46 (1991)

    Article  Google Scholar 

  58. T. Marin Nakra: Inside the Conductorʼs Jacket: Analysis, Interpretation and Musical Synthesis of Expressive Gesture. Ph.D. Thesis (MIT Media Lab, Cambridge 2000)

    Google Scholar 

  59. J.A. Paradiso: The brain opera technology: New instruments and gestural sensors for musical interaction and performance, J. New Music Res. 28, 2 (1999)

    Article  Google Scholar 

  60. J. Freeman, S. Ramakrishnan, K. Varnik, M. Neuhaus, P. Burk, D. Birchfeld: Adaptive high-level classification of vocal gestures within a networked sound instrument, Proc. Int. Computer Music Conf. (International Computer Music Association, San Francisco 2004)

    Google Scholar 

  61. C. Chafe, S. Wilson, R. Leistikow, D. Chisholm, G. Scavone: A simplified approach to high quality music and sound over IP, Proc. Conf. Digital Audio Effects (DAFX), ed. by D. Rocchesso (University of Verona, Italy 2000)

    Google Scholar 

  62. A. Kapur, G. Wang, P. Davidson, P.R. Cook, D. Trueman, T.H. Park, M. Bhargava: The Gigapop Ritual: A Live Networked Performance Piece for Two Electronic Dholaks, Digital Spoon, DigitalDoo, 6 String Electric Violin, Rbow, Sitar, Tabla, and Bass Guitar, Proc. Int. Conf. New Interfaces for Musical Expression (NIME) (McGill University, Montreal 2003)

    Google Scholar 

  63. S. Smallwood, D. Trueman, P. Cook, G. Wang: Composing for laptop orchestra, Comput. Music J. 32(1), 9–25 (2008)

    Article  Google Scholar 

  64. J. Bischoff, R. Gold, J. Horton: Music for an interactive network of microcomputers, Comput. Music J. 2(3), 24–29 (1978)

    Article  Google Scholar 

  65. Trimpin: The Sound of Invention (Documentary Film, Microcinema Studio 2011)

    Google Scholar 

  66. E. Singer, D. Bianciardi, K. Larke: LEMUR GuitarBot, Proc. New Interfaces for Music Expression (Montreal 2003)

    Google Scholar 

  67. A. Kapur, M. Darling, R. Kapur: Donʼt forget the machines: Orchestras of humans, laptops, and robots, Proc. Symposium on Laptop Orchestras and Ensembles (Baton Rouge, LA 2012)

    Google Scholar 

  68. G. Tzanetakis, P. Cook: Multi-feature audio segmentation for browsing and annotation, Proc. IEEE Workshop on Applications of Signal Processing to Audio and Acoustics (WASPAA) (IEEE, Piscataway 1999)

    Google Scholar 

  69. D. Cope: Experiments in Musical Intelligence, Vol. 12 (A-R Editions, Madison 1996)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Perry R. Cook .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2014 Springer-Verlag

About this chapter

Cite this chapter

Cook, P.R. (2014). Computer Music. In: Rossing, T.D. (eds) Springer Handbook of Acoustics. Springer Handbooks. Springer, New York, NY. https://doi.org/10.1007/978-1-4939-0755-7_17

Download citation

Publish with us

Policies and ethics