Skip to main content

Compositional Sonification of Cybersecurity Data in a Baroque Style

Part of the Lecture Notes in Networks and Systems book series (LNNS,volume 271)

Abstract

Compositional sonification is a musical mapping algorithm that transforms a dataset into a soundscape for humans to hear numbers within a musical structure. In this study, we used three methods to sonify data: 1) a Baroque-style gestural mapping algorithm that emphasized timing and rhythm using an analog method of handwritten composition, 2) an electronic online pitch sequencer, and 3) the classical instrument Harp performing notated music. We investigated related sound mapping algorithms and the sensitivity of pattern representation of cybersecurity data, including the malware distribution network datasets. Our preliminary experiments showed that a Baroque-inspired timing element based on gestures plays a critical role in aural sonification. Using a sequencer with visualizers helped listeners grasp the patterns more effectively since they were able to watch and hear the results simultaneously. Performing the sonified data live on the harp helped make the compositions more relatable and thus connected with a broader audience. The harp also added a visual element which helped listeners identify patterns. We found that listeners were able to accurately identify the sonified data patterns in both the baroque-style analog handwritten compositions performed on harp and the compositions produced by the Online Sequencer. While non-musicians were able to answer questions about the data patterns they heard with a high percentage of accuracy, their results improved when visual elements were added.

Keywords

  • AI
  • Creativity
  • Sonification
  • Computer music
  • Baroque
  • Composition
  • Augmented reality
  • Malware
  • Computer virus
  • Network
  • Sequencer
  • Harp
  • Classical music
  • Classical instruments

This is a preview of subscription content, access via your institution.

Buying options

Chapter
USD   29.95
Price excludes VAT (USA)
  • DOI: 10.1007/978-3-030-80624-8_38
  • Chapter length: 9 pages
  • Instant PDF download
  • Readable on all devices
  • Own it forever
  • Exclusive offer for individuals only
  • Tax calculation will be finalised during checkout
eBook
USD   219.00
Price excludes VAT (USA)
  • ISBN: 978-3-030-80624-8
  • Instant PDF download
  • Readable on all devices
  • Own it forever
  • Exclusive offer for individuals only
  • Tax calculation will be finalised during checkout
Softcover Book
USD   279.99
Price excludes VAT (USA)
Fig. 1.
Fig. 2.
Fig. 3.
Fig. 4.
Fig. 5.

References

  1. Peryt, S., Cai, Y.: Visualization of malware distribution network. In: IEEE VizSec (2018)

    Google Scholar 

  2. Corey, M.: Turn your data into sound using our new MIDITime library, revealneews.org. https://revealnews.org/blog/turn-your-data-into-sound-using-our-new-miditime-library/

  3. Sonification, BBC. https://www.bbc.co.uk/programmes/articles/3clDSXN26N9lQtCwJgMb2tR/sonification

  4. DNA Sonification. http://dnasonification.org/

  5. Online Sequencer. https://onlinesequencer.net/

  6. Kosara, R.: Sonification: the power and problems, eagereyes, web blog site, 2 March 2017. https://eagereyes.org/techniques/sonification-the-power-the-problems

  7. SAS, SAS enables visually imparied to ‘visualize’ data. Cision, 22 Feb 2017. https://www.prnewswire.com/news-releases/sas-enables-visually-impaired-to-visualize-data-300411767.html

  8. Mauldin, M.: Birds in Winter: six preludes for harp. (1989)

    Google Scholar 

  9. Rensch, R.: Harps and Harpists. Indiana University Press, Bloomington (1998)

    Google Scholar 

  10. Tsuchiya, T.: Data-to-music API: real-time data-agnostic sonification with musical structure models. Georgia Tech Library (2015). Accessed 21 June 2017

    Google Scholar 

  11. Libermann, A.: Composer. https://www.instagram.com/lieberliner/

  12. Daquin, L.: Le coucou Cuckoo, Pièces de clavecin, Troisième Suite (1735)

    Google Scholar 

  13. Messiaen, O.: Oiseaux exotiques (1955)

    Google Scholar 

  14. Harvey, J.: Bird Concerto with Pianosong (2001)

    Google Scholar 

  15. Musicalgorithms.org. http://musicalgorithms.org/4.1/app/

Download references

Acknowledgement

The authors are grateful to students and interns Sebastian Peart, Lulan Harberson, Ben Graham, and Grace Kong for their programming. We would like to thank program managers Martin Otto, Jeb Benson, Scott Ledgewood, Sarah Houghs, Neta Ezer, Justin Vivirito, Erin A. Cherry, Isidoros Doxas, Donald D. Steiner, Paul Conoval, Jason B. Clark, and Dennis Fortner for discussions, reviews, and advice. This study is in part sponsored by Siemens, Northrop Grumman Corporation, NIST PSCR / PSIA programs.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Yang Cai .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and Permissions

Copyright information

© 2021 The Author(s), under exclusive license to Springer Nature Switzerland AG

About this paper

Verify currency and authenticity via CrossMark

Cite this paper

Polaczyk, J., Croft, K., Cai, Y. (2021). Compositional Sonification of Cybersecurity Data in a Baroque Style. In: Ahram, T.Z., Karwowski, W., Kalra, J. (eds) Advances in Artificial Intelligence, Software and Systems Engineering. AHFE 2021. Lecture Notes in Networks and Systems, vol 271. Springer, Cham. https://doi.org/10.1007/978-3-030-80624-8_38

Download citation