Research on the theory and practice of multimedia music image photography in music research

  • Yan ZhangEmail author
  • Chong Cheng


Note recognition is the core and key of music score recognition. In this paper, according to the diversity and polymorphism of notes, a structure-based recognition scheme is determined, and its recognition process is divided into two stages: primitive extraction and structure analysis. In the aspect of note primitive extraction, the rough extraction method based on vertical run-length coding and the fine detection method based on horizontal run-length coding are proposed, which overcome the shortcomings of the existing methods such as poor adaptability of complex notes and incomplete extraction results. A solid head extraction method is designed, which first divides and then detects the features. This method uses the prior knowledge of notes and the existing spectral lines and trunk recognition. In the aspect of note structure analysis, a new method of note structure analysis based on action field is proposed. In this method, the concept of action field in physics is introduced into the relationship expression of note primitives, and the unity of knowledge, generality and accuracy is realized. On this basis, six note substructures are defined, and a note structure analysis model of key structure priority location is established, which realizes the reconstruction of the note base metadata to the note object. This model reflects the thinking habit of highlighting key features and from the whole to the details in manual spectrum recognition. It not only reduces the complexity of analysis, but also has a strong ability of primitive redundancy error removal. The test results show that the overall recognition performance has reached the level of the current excellent commercial music score recognition system, and it has obvious advantages in note recognition, adaptability in different data environments and execution speed.


Ant colony algorithm Intelligent image information Modelling Travel route optimization Efficiency 



The authors acknowledge the National Natural Science Foundation of China (Grant: 111578109), the National Natural Science Foundation of China (Grant: 11111121005).


  1. 1.
    Al-Ariki HDE, Swamy MNS (2017) A survey and analysis of multipath routing protocols in wireless multimedia sensor networks[J]. Wirel Netw 23(6):1823–1835CrossRefGoogle Scholar
  2. 2.
    Álvarez-Alonso D, Andrés-Herrero MD, Díez-Herrero A et al (2016) Neanderthal settlement in Central Iberia: geo-archaeological research in the Abrigo del Molino site, MIS 3 (Segovia, Iberian Peninsula)[J]. Quat Int:1–13Google Scholar
  3. 3.
    Antal H, Bunnell HT, Mccahan SM et al (2017) A cognitive approach for design of a multimedia informed consent video and website in pediatric research ☆[J]. J Biomed Inform 66:248–258CrossRefGoogle Scholar
  4. 4.
    Arias J, Celerier JM, Desaintecatherine M Authoring and automatic verification of interactive multimedia scores[J]. Journal of New Music Research 2016:1–19Google Scholar
  5. 5.
    Bressan F, Canazza S, Declercq B (2017) Digital philology for multimedia cultural heritage[J]. Journal of New Music Research 46(2):iii–iivCrossRefGoogle Scholar
  6. 6.
    Cao N, Wu Y, Gotz D et al (2016) Guest editorial: visual analytics in multimedia—opportunities and research challenges[J]. IEEE Transactions on Multimedia 18(11):2133–2134CrossRefGoogle Scholar
  7. 7.
    Davis KC, Shafer PR, Robert R et al (2016) Does digital video advertising increase population-level reach of multimedia campaigns? Evidence from the 2013 tips from former smokers campaign:[J]. J Med Internet Res 18(9):e235CrossRefGoogle Scholar
  8. 8.
    Grachten M, Cancino-Chacón CE, Gadermaier T et al (2017) Toward computer-assisted understanding of dynamics in symphonic music [J]. IEEE Multimedia 24(1):36–46CrossRefGoogle Scholar
  9. 9.
    Kraft SA, Constantine M, Magnus D et al (2016) A randomized study of multimedia informational aids for research on medical practices: implications for informed consent[J]. Clin Trials 14(1):94CrossRefGoogle Scholar
  10. 10.
    Lv Z, Wang JJ, Yin T (2016) Editorial: recent research in medical technology based on multimedia and pattern recognition[J]. Neurocomputing 220Google Scholar
  11. 11.
    Murray N, Lee B, Qiao Y et al (2016) Olfaction-enhanced multimedia:a survey of application domains, displays, and research challenges[J]. ACM Comput Surv 48(4):1–34CrossRefGoogle Scholar
  12. 12.
    Niehaus WN, Silver JK, Katz MS (2017) The PM&R, journal implements a social media strategy to disseminate research and track alternative metrics in physical medicine and rehabilitation[J]. PM R 10(5):S1934148217314892Google Scholar
  13. 13.
    Nikhil R, Jose CP, Emanuele C, Gabriel D, Lanckriet1 GRG, Roger L, Nuno V (2010) A new approach to cross-modal multimedia retrieval. In: Proceedings of the 18th ACM international conference on multimedia, pp 251–260Google Scholar
  14. 14.
    Karpathy A, Fei-Fei L (2017) Deep visual-semantic alignments for generating image descriptions. IEEE Trans Pattern Anal Mach Intell 39:664–676Google Scholar
  15. 15.
    Shirmohammadi S, Zhang C (2017) The latest multimedia research from ISM 2016[J]. IEEE Multimedia 24(2):18–19CrossRefGoogle Scholar
  16. 16.
    Tian Y, Min C, Sousa L (2016) Ubiquitous multimedia: emerging research on multimedia computing[J]. IEEE Multimedia 23(2):12–15CrossRefGoogle Scholar
  17. 17.
    Topolovecvranic J, Natarajan K (2016) The use of social media in recruitment for medical research studies: a scoping review[J]. J Med Internet Res 18(11):e286CrossRefGoogle Scholar

Copyright information

© Springer Science+Business Media, LLC, part of Springer Nature 2019

Authors and Affiliations

  1. 1.Hubei University Of EducationWuhanChina
  2. 2.Wuhan Second Ship Design InstituteWuhanChina

Personalised recommendations