The Visual Computer

, 27:905

Stereo music visualization through manifold harmonics

Authors

    • Department of MathematicsPUC-Rio
  • Clarissa Marques
    • Department of MathematicsPUC-Rio
  • João Paixão
    • Department of MathematicsPUC-Rio
  • Scarlett de Botton
    • Department of MathematicsPUC-Rio
  • Allyson Cabral
    • Department of MathematicsPUC-Rio
  • Renata Nascimento
    • Department of MathematicsPUC-Rio
  • Vinícius Mello
    • Institute of MathematicsUFBA
  • Adelailson Peixoto
    • Institute of MathematicsUFAL
  • Dimas Martinez
    • Institute of MathematicsUFAL
  • Thales Vieira
    • Institute of MathematicsUFAL
Original Article

DOI: 10.1007/s00371-011-0617-4

Cite this article as:
Lewiner, T., Marques, C., Paixão, J. et al. Vis Comput (2011) 27: 905. doi:10.1007/s00371-011-0617-4
  • 217 Views

Abstract

Music visualizations are nowadays included with virtually any media player. They usually rely on harmonic analysis of each sound channel, which automatically generate parameters for procedural image generation. However, only few music visualizations make use of 3d shapes. This paper proposes to use spectral mesh processing techniques, here manifold harmonics, to produce 3d stereo music visualization. The images are generated from 3d models by deforming an initial shape, mapping the sound frequencies to the mesh harmonics. A symmetry criterion is introduced to enhance the stereo effects on the deformed shape. A concise representation of the frequency mapping is proposed to allow for an animated gallery interface with genetic reproduction. Such galleries let the user quickly navigate between visual effects. Rendering such animated galleries in real time is a challenging task, since it requires computing and rendering the deformed shapes at a very high rate. This paper introduces a direct GPU implementation of manifold harmonics filters, which allows the displaying of the animated galleries.

Keywords

Manifold harmonicsSymmetrySound visualizationStereophonyGeometry processingGPUDesign galleries

Copyright information

© Springer-Verlag 2011