Advertisement

Apidologie

pp 1–9 | Cite as

Automated classification of bees and hornet using acoustic analysis of their flight sounds

  • Satoshi KawakitaEmail author
  • Kotaro Ichikawa
Original article
  • 70 Downloads

Abstract

To investigate how to accurately identify bee species using their sounds, we conducted acoustic analysis to identify three pollinating bee species (Apis mellifera, Bombus ardens, Tetralonia nipponensis) and a hornet (Vespa simillima xanthoptera) by their flight sounds. Sounds of the insects and their environment (background noises and birdsong) were recorded in the field. The use of fundamental frequency and mel-frequency cepstral coefficients to describe feature values of the sounds, and supported vector machines to classify the sounds, correctly distinguished sound samples from environmental sounds with high recalls and precision (0.96–1.00). At the species level, our approach could classify the insect species with relatively high recalls and precisions (0.7–1.0). The flight sounds of V.s. xanthoptera, in particular, were perfectly identified (precision and recall 1.0). Our results suggest that insect flight sounds are potentially useful for detecting bees and quantifying their activity.

Keywords

species classification Hymenoptera machine learning acoustic analysis 

Notes

Acknowledgments

We thank Dr. Fumio Sakamoto and Dr. Junichiro Abe for supporting our experiments and giving us the opportunity to record the flight sounds of insects.

Authors’ contribution

SK conceived the research; KI participated in the design and interpretation of the data; SK performed experiments and analysis. Both authors wrote the paper and approved the final manuscript.

Compliance with ethical standards

Conflict of interest

The authors declare that they have no conflict of interest

Supplementary material

13592_2018_619_MOESM1_ESM.wav (140 kb)
Flight sound sample of A. mellifera (WAV 140 kb)
13592_2018_619_MOESM2_ESM.wav (48 kb)
Flight sound sample of B. ardens (WAV 48 kb)
13592_2018_619_MOESM3_ESM.wav (57 kb)
Flight sound sample of T. nipponensis (WAV 56 kb)
13592_2018_619_MOESM4_ESM.wav (91 kb)
Flight sound sample of V. s. xanthoptera (WAV 90 kb)

References

  1. Acevedo, M.A., Corrada-Bravo, C.J., Corrada-Bravo, H., Villanueva-Rivera, L.J., Aide, T.M. (2009) Automated classification of bird and amphibian calls using machine learning: A comparison of methods. Ecol. Inform. 4, 206–214.  https://doi.org/10.1016/J.ECOINF.2009.06.005 CrossRefGoogle Scholar
  2. Blumstein, D.T., Mennill, D.J., Clemins, P., Girod, L., Yao, K., Patricelli, G., Deppe, J.L., Krakauer, A.H., Clark, C., Cortopassi, K.A., Hanser, S.F., McCowan, B., Ali, A.M., Kirschel, A.N.G. (2011) Acoustic monitoring in terrestrial environments using microphone arrays: applications, technological considerations and prospectus. J. Appl. Ecol.  https://doi.org/10.1111/j.1365-2664.2011.01993.x
  3. Burkart, A., Lunau, K., Schlindwein, C. (2011) Comparative bioacoustical studies on flight and buzzing of neotropical bees. J. Poll. Ecol. 6, 118–124Google Scholar
  4. Byrne, D.N., Buchmann, S.L., Spangler, H.G. (1988) Relationship between wing loading, wing stroke frequency and body mass in homopterous insects. J. Exp. Biol. 135, 9–23Google Scholar
  5. Byun, D., Hong, J., Saputra, Ko, J.H., Lee, Y.J., Park, H.C., Byun, B.K., Lukes, J.R. (2009) Wetting characteristics of insect wing surfaces. J. Bionic Eng.  https://doi.org/10.1016/S1672-6529(08)60092-X
  6. Celis-Murillo, A., Deppe, J.L., Allen, M.F. (2009) Using soundscape recordings to estimate bird species abundance, richness, and using soundscape recordings to estimate bird species abundance, richness, and composition. Source J. F. Ornithol.  https://doi.org/10.1111/j.1557-9263.2009.00206.x
  7. Chapelle, O., Vapnik, V., Bousquet, O., Mukherjee, S. (2002) Choosing multiple parameters for support vector machines. Mach. Learn.  https://doi.org/10.1023/A:1012450327387
  8. Chaves, V.A.E., Travieso, C.M., Camacho, A., Alonso, J.B. (2012) Katydids acoustic classification on verification approach based on MFCC and HMM, in: INES 2012 - IEEE 16th International Conference on Intelligent Engineering Systems, Proceedings.  https://doi.org/10.1109/INES.2012.6249897
  9. De Luca, P.A., Cox, D.A., Vallejo-Marín, M. (2014). Comparison of pollination and defensive buzzes in bumblebees indicates species-specific and context-dependent vibrations. Naturwissenschaften 101 (4), 331–338CrossRefGoogle Scholar
  10. Fisher, R.M., Pomeroy, N. (1989) Pollination of greenhouse muskmelons by bumble bees (Hymenoptera: Apidae). J. Econ. Entomol.  https://doi.org/10.1093/jee/82.4.1061
  11. Fleurat-Lessard, F., Tomasini, B., Kostine, L., Fuzeau, B. (2006). Acoustic detection and automatic identification of insect stages activity in grain bulks by noise spectra processing through classification algorithms. Proc. 9th Int. Work. Conf. Stored-Product Prot. ABRAPOS, Passo Fundo, RS, Brazil, 15–18 Oct. 2006 476–486Google Scholar
  12. Free, J.B. (1955) The division of labour within bumblebee colonies. Insectes Soc.  https://doi.org/10.1007/BF02224381
  13. Ganchev, T., Potamitis, I., Fakotakis, N. (2007) Acoustic monitoring of singing insects, in: ICASSP, IEEE International Conference on Acoustics, Speech and Signal Processing - Proceedings. IEEE, p. IV-721-IV-724.  https://doi.org/10.1109/ICASSP.2007.367014
  14. Gradišek, A., Slapničar, G., Šorn, J., Luštrek, M., Gams, M., Grad, J. (2017) Predicting species identity of bumblebees through analysis of flight buzzing sounds. Bioacoustics  https://doi.org/10.1080/09524622.2016.1190946
  15. Hill, A.P., Prince, P., Piña Covarrubias, E., Doncaster, C.P., Snaddon, J.L., Rogers, A. (2018) AudioMoth: Evaluation of a smart open acoustic device for monitoring biodiversity and the environment. Methods Ecol. Evol.  https://doi.org/10.1111/2041-210X.12955
  16. Ishay, J. (1975) Frequencies of the sounds produced by the oriental hornet, Vespa orientalis, J. Insect Physiol.  https://doi.org/10.1016/0022-1910(75)90233-4
  17. Karatzoglou, A., Smola, A., Hornik, K., Zeileis, A. (2004) Kernlab – An S4 package for kernel methods in R. J. Stat. Softw.  https://doi.org/10.1016/j.csda.2009.09.023
  18. Kiskin, I., Orozco, B.P., Windebank, T., Zilli, D., Sinka, M., Willis, K., Roberts, S. (2017) Mosquito detection with neural networks: the buzz of deep learning. eprint arXiv:1705.05180.Google Scholar
  19. Lampson, B.D., Han, Y.J., Khalilian, A., Greene, J., Mankin, R.W., Foreman, E.G. (2013) Automatic detection and identification of brown stink bug, Euschistus servus, and southern green stink bug, Nezara viridula, (Heteroptera: Pentatomidae) using intraspecific substrate-borne vibrational signals. Comput. Electron. Agric.  https://doi.org/10.1016/j.compag.2012.12.010
  20. Mennill, D.J., Vehrencamp, S.L. (2008) Context-dependent functions of avian duets revealed by microphone-array recordings and multispeaker playback. Curr. Biol.  https://doi.org/10.1016/J.CUB.2008.07.073
  21. Mennill, D.J., Burt, J.M., Fristrup, K.M., Vehrencamp, S.L. (2006) Accuracy of an acoustic location system for monitoring the position of duetting songbirds in tropical forest. J. Acoust. Soc. Am.  https://doi.org/10.1121/1.2184988
  22. Miller-Struttmann, N.E., Heise, D., Schul, J., Geib, J.C., Galen, C. (2017) Flight of the bumble bee: Buzzes predict pollination services. PLoS One  https://doi.org/10.1371/journal.pone.0179273
  23. Morandin, L.A., Laverty, T.M., Kevan, P.G., (2001) Bumble bee (Hymenoptera: Apidae) activity and pollination levels in commercial tomato greenhouses. J. Econ. Entomol.  https://doi.org/10.1603/0022-0493-94.2.462
  24. Nagamitsu T., Kenta T., Inari N., Kato E., Hiura T. (2007) Abundance, body size, and morphology of bumblebees in an area where an exotic species, Bombus terrestris, has colonized in Japan. Ecol. Res. 22, 331–341CrossRefGoogle Scholar
  25. Njoroge, A.W., Mankin, R.W., Smith, B.W., Baributsa, D. (2017) Effects of hermetic storage on adult Sitophilus oryzae L. (Coleoptera: Curculionidae) acoustic activity patterns and mortality. J. Econ. Entomol.  https://doi.org/10.1093/jee/tox260
  26. Obrist, M.K., Pavan, G., Sueur, J., Riede, K., Llusia, D., Márquez, R. (2010) Bioacoustics approaches in biodiversity inventories. ABC Taxa 8, 68–99.Google Scholar
  27. Potamitis, I., Rigakis, I., Fysarakis, K. (2015). Insect biometrics: optoacoustic signal processing and its applications to remote monitoring of McPhail Type Traps. PLoS One  https://doi.org/10.1371/journal.pone.0140474
  28. Raghavan, V., Bollmann, P., Jung, G.S. (1989) A critical investigation of recall and precision as measures of retrieval system performance. ACM Trans. Inf. Syst.  https://doi.org/10.1145/65943.65945
  29. Ruttner, F. (1988) Biogeography and taxonomy of honeybees, Springer-Verlag Berlin Heidelberg GmbH.  https://doi.org/10.1016/0169-5347(89)90176-6
  30. Sueur, J., Aubin, T., Simonis, C. (2008) Equipment review: Seewave, a free modular tool for sound analysis and synthesis. Bioacoustics  https://doi.org/10.1080/09524622.2008.9753600
  31. Tautz, J., Markl, H. (1978) Caterpillars detect flying wasps by hairs sensitive to airborne vibration. Behav. Ecol. Sociobiol.  https://doi.org/10.1007/BF00302564
  32. Towsey, M., Wimmer, J., Williamson, I., Roe, P. (2014) The use of acoustic indices to determine avian species richness in audio-recordings of the environment. Ecol. Inform.  https://doi.org/10.1016/j.ecoinf.2013.11.007
  33. Tsuyuki, K., Sudo, S. (2004) The properties of wing and airflow of flying insects, in: 24th International Congress of the Aeronautical Sciences.Google Scholar
  34. Wen, C., Guyer, D. (2012) Image-based orchard insect automated identification and classification method. Comput. Electron. Agric.  https://doi.org/10.1016/J.COMPAG.2012.08.008
  35. Zhang, B., Cheng, J., Han, Y., Ji, L., Shi, F. (2012) An acoustic system for the individual recognition of insects. J. Acoust. Soc. Am.  https://doi.org/10.1121/1.3692236
  36. Zhu, L.-Q., Ma, M.-Y., Zhang, Z., Zhang, P.-Y., Wu, W., Wang, D.-D., Zhang, D.-X., Wang, X., Wang, H.-Y. (2017) Hybrid deep learning for automated lepidopteran insect image classification. Orient. Insects.  https://doi.org/10.1080/00305316.2016.1252805
  37. Zilli, D., Parson, O., Merrett, G.V., Rogers, A. (2014) A hidden Markov model-based acoustic cicada detector for crowdsourced smartphone biodiversity monitoring. J. Artif. Intell. Res.  https://doi.org/10.1613/jair.4434

Copyright information

© INRA, DIB and Springer-Verlag France SAS, part of Springer Nature 2019

Authors and Affiliations

  1. 1.Western Region Agricultural Research CenterNational Agriculture and Food Research OrganizationHiroshimaJapan
  2. 2.Field Science Education and Research CenterKyoto UniversityKyotoJapan

Personalised recommendations