The Visual Computer

, 27:905

Stereo music visualization through manifold harmonics

  • Thomas Lewiner
  • Clarissa Marques
  • João Paixão
  • Scarlett de Botton
  • Allyson Cabral
  • Renata Nascimento
  • Vinícius Mello
  • Adelailson Peixoto
  • Dimas Martinez
  • Thales Vieira
Original Article

DOI: 10.1007/s00371-011-0617-4

Cite this article as:
Lewiner, T., Marques, C., Paixão, J. et al. Vis Comput (2011) 27: 905. doi:10.1007/s00371-011-0617-4

Abstract

Music visualizations are nowadays included with virtually any media player. They usually rely on harmonic analysis of each sound channel, which automatically generate parameters for procedural image generation. However, only few music visualizations make use of 3d shapes. This paper proposes to use spectral mesh processing techniques, here manifold harmonics, to produce 3d stereo music visualization. The images are generated from 3d models by deforming an initial shape, mapping the sound frequencies to the mesh harmonics. A symmetry criterion is introduced to enhance the stereo effects on the deformed shape. A concise representation of the frequency mapping is proposed to allow for an animated gallery interface with genetic reproduction. Such galleries let the user quickly navigate between visual effects. Rendering such animated galleries in real time is a challenging task, since it requires computing and rendering the deformed shapes at a very high rate. This paper introduces a direct GPU implementation of manifold harmonics filters, which allows the displaying of the animated galleries.

Keywords

Manifold harmonicsSymmetrySound visualizationStereophonyGeometry processingGPUDesign galleries

Copyright information

© Springer-Verlag 2011

Authors and Affiliations

  • Thomas Lewiner
    • 1
  • Clarissa Marques
    • 1
  • João Paixão
    • 1
  • Scarlett de Botton
    • 1
  • Allyson Cabral
    • 1
  • Renata Nascimento
    • 1
  • Vinícius Mello
    • 3
  • Adelailson Peixoto
    • 2
  • Dimas Martinez
    • 2
  • Thales Vieira
    • 2
  1. 1.Department of MathematicsPUC-RioRio de JaneiroBrazil
  2. 2.Institute of MathematicsUFALMaceióBrazil
  3. 3.Institute of MathematicsUFBASalvadorBrazil