Classifying Flies Based on Reconstructed Audio Signals
Advancements in sensor technology and processing power have made it possible to create recording equipment that can reconstruct the audio signal of insects passing through a directed infrared beam. The widespread deployment of such devices would allow for a range of applications previously not practical. A sensor net of detectors could be used to help model population dynamics, assess the efficiency of interventions and serve as an early warning system. At the core of any such system is a classification problem: given a segment of audio collected as something passes through a sensor, can we classify it? We examine the case of detecting the presence of fly species, with a particular focus on mosquitoes. This gives rise to a range of problems such as: can we discriminate between species of fly? Can we detect different species of mosquito? Can we detect the sex of the insect? Automated classification would significantly improve the effectiveness and efficiency of vector monitoring using these sensor nets. We assess a range of time series classification (TSC) algorithms on data from two projects working in this area. We assess our prior belief that spectral features are most effective, and we remark on all approaches with respect to whether they can be considered “real-time”.
KeywordsInsect classification Time series classification Spectral features
This work is supported by the Biotechnology and Biological Sciences Research Council [grant number BB/M011216/1], and the UK Engineering and Physical Sciences Research Council (EPSRC) [grant number EP/M015807/1]. The experiments were carried out on the High Performance Computing Cluster supported by the Research and Specialist Computing Support service at the University of East Anglia and using a Titan X Pascal donated by the NVIDIA Corporation.
- 5.Large, J., Lines, J., Bagnall, A.: A probabilistic classifier ensemble weighting scheme based on cross-validated accuracy estimates. Data Min. Knowl. Discov., 1–36 (2019) Google Scholar
- 6.Li, Z., Zhou, Z., Shen, Z., Yao, Q.: Automated identification of mosquito (diptera: culicidae) wingbeat waveform by artificial neural network. In: Li, D., Wang, B. (eds.) AIAI 2005. ITIFIP, vol. 187, pp. 483–489. Springer, Boston, MA (2005). https://doi.org/10.1007/0-387-29295-0_52CrossRefGoogle Scholar
- 8.Lines, J., Davis, L.M., Hills, J., Bagnall, A.: A shapelet transform for time series classification. In: Proceedings of the 18th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, pp. 289–297. ACM (2012)Google Scholar
- 9.Moore, A.: Development of a data acquisition system for long-term outdoor recording of insect flight activity using a photosensor. In: 13th Conference on Aerobiology and Biometeorology, American Meteorological Society, Albuquerque, New Mexico (1998)Google Scholar
- 15.Reed, S., Williams, C., Chadwick, L.: Frequency of wing-beat as a character for separating species races and geographic varieties of drosophila. Genetics 27(3), 349 (1942)Google Scholar
- 17.Schäfer, P.: Bag-of-SFA-Symbols in Vector Space (BOSS VS) (2015)Google Scholar
- 18.Unwin, D., Ellington, C.: An optical tachometer for measurement of the wing-beat frequency of free-flying insects. J. Exp. Biol. 82(1), 377–378 (1979)Google Scholar