Abstract
We present a new and innovative identification method based on deep learning of the wing interferential patterns carried by mosquitoes of the Anopheles genus to classify and assign 20 Anopheles species, including 13 malaria vectors. We provide additional evidence that this approach can identify Anopheles spp. with an accuracy of up to 100% for ten out of 20 species. Although, this accuracy was moderate (> 65%) or weak (50%) for three and seven species. The accuracy of the process to discriminate cryptic or sibling species is also assessed on three species belonging to the Gambiae complex. Strikingly, An. gambiae, An. arabiensis and An. coluzzii, morphologically indistinguishable species belonging to the Gambiae complex, were distinguished with 100%, 100%, and 88% accuracy respectively. Therefore, this tool would help entomological surveys of malaria vectors and vector control implementation. In the future, we anticipate our method can be applied to other arthropod vector-borne diseases.
Similar content being viewed by others
Explore related subjects
Find the latest articles, discoveries, and news in related topics.Introduction
Pathogens transmitted by arthropods are devastating infectious agents and scourge the human population worldwide. Currently, the 3.719 valid species of Culicidae are classified into 2 subfamilies, Culicinae and Anophelinae (https://mosquito-taxonomic-inventory.myspecies.info/valid-species-list/ accessed on 8 Aug., 2023). Among Culicidae insects belonging to the Anopheles Meigen, 1818, some are proven vectors of protozoan pathogens (Plasmodium sp.)1, viruses (Zika, Rift Valley fever, etc.)2,3, bacteria (Rickettsia felis)4,5 pathogens, or a limited number of species are thought to act as phoretic vector for Dermatobia hominis6,7. Some species (An. gambiae Gilles, 1902, and An. bancrofti Gilles, 1902) are proven vectors of a filarial pathogen, Wuchereria bancrofti8. Nevertheless, pathogens’ detection in field-caught insects doesn’t imply their vectorial importance, and in all cases, additional demonstrations, including experimental infection and transmission, are needed to firmly prove their vectorial status2. Overall, malaria is a life-threatening disease with over 600 000 deaths annually (World Malaria Report; https://www.who.int/teams/global-malaria-programme/reports/world-malaria-report-2022), and Anopheles species as the vector are of significant importance in public health and disease control.
The Anopheles genus encompasses eight subgenera, with about 500 valid named species and 49 subspecies (https://www.itis.gov/ accessed on the 28th of November 2022 returns 477 named species). Out of 8 described subgenera, 4 hold named species whose medical or veterinary interests are documented (Anopheles Meigen, 1818; Cellia Theobald, 1905; Kerteszia Theobald, 1903; Nyssorhynchus Blanchard, 1902). The latter is exclusively present in the new world (south, central, north America, and the Caribbean). The highest species richness is recorded in the Asian and African continents, followed by the American, Oceanian, and European continents. Roughly 140 species have a well-documented medical or veterinary interest (Data compiled from WRBU website, https://wrbu.si.edu/ accessed on the 28th of November 2022).
Complexes of species encompass closely related organisms that are so similar in appearance and other features that the understanding of boundaries between them needs to be clarified. The study of differences between individual species of the complex requires the identification of minute morphological details, tests of reproductive isolation, or DNA-based methods, such as molecular phylogenetics and DNA barcoding. At least 27 species complexes, with up to 10 species per complexes, are documented for the Anopheles genus. The “Gambiae complex” (Anopheles gambiae sensu lato) was recognized in the 1960s9. Since then, additional evidence on population subgroups and genetic diversity in this African malaria vector emerged10,11,12. To date, the Gambiae complex gathers nine closely related species (An. amharicus Hunt, Wilkerson & Coetzee, 2013; An. arabiensis Patton, 1905; An. bwambae White, 1985; An. coluzzii Coetzee & Wilkerson, 2013; An. gambiae Giles, 1902; An. melas Theobald, 1903; An. merus Dönitz, 1902; An. quadriannulatus Theobald, 1911), and a last included species, An. fontenillei Barron, 2019, collected in Gabon13, of which seven are proven vectors of various Plasmodium sp. Some species (An. melas, An. merus, An. quadriannulatus, An. amharicus, and An. bwambae) do not overlap in their distributions, unlike 3 of the most important malaria vectors in sub-Saharan Africa: An. gambiae s. s., An. coluzzii and An. arabiensis. Entomological surveys and follow-up of malaria vectors in time and space require identification at the species level because malaria is transmitted by multiple and often barely morphologically distinguishable mosquito species that differ in their longevity, behaviors, and vectorial competence and hence vectorial capacity11,14.
Entomological investigations are fastidious and nowadays primarily dependent on highly skilled specialists. Morphology-independent methodologies, even the most complex ones as geometric morphology, rely on genetic, protein, or other specific biochemical markers (DNA barcode, MALDI-TOF, Near, and Middle-infrared spectroscopy) can partially resolve the taxonomic status of some specimens but cannot be considered as amenable for entomological survey15,16,17,18,19. In addition, acoustic, like flight tone and wing beat20,21,22, and optical characters like WIPs (Wing Interference Patterns)23,24,25,26,27, were developed and tested on insects’ members of various families. Finally, the advances in Deep learning (DL) processes, a branch of machine learning (ML) and artificial intelligence (AI), have incredibly increased the identification capability of arthropods27,28,29,30,31,32,33,34.
In this study, we aimed to develop a supervised DL approach on Anopheles WIPs to predict individual species. We tested the robustness of this approach in differentiating closely related species belonging to the same “Gambiae complex,” i.e., An. gambiae, An. coluzzii and An. arabiensis, using insectary-reared specimens. The results prove how this low-cost, artificial intelligence-based approach can determine the species composition of natural vector populations and constitute a new identification tool in the fight against malaria.
Material and methods
Anopheles collection and storage
The first WIPs reference collection of Culicidae gathers samples belonging to the Anopheles genus using well-established laboratory breeds of An. gambiae, An. coluzzii and An. arabiensis and An. stephensi (MIVEGEC, IRD Montpellier, France and IRRS Bobo Dioulasso, Burkina Fasso). Specimens were also selected in the ARIM collection (https://arim.ird.fr/) of IRD (Institut de Recherche pour le Développement). In addition, specimens collected in natura, whose identification was performed at the time of their traping with available regional morphological identification keys, and confirmed before their entry in the ARIM collection, were also included in the database. The description of the samples used in this study is given in Table 1.
Image acquisition and database construction
The same standard operational procedures (SOP) described to capture WIPs of Glossina were also used for Anopheles27. This process is easy to handle and inexpensive. It consists of dissecting the wings and mounting them on a glass slide. A cover slide was deposited, annotated specimens were photographed using the xVH-Z20r camera, and the VH K20 adapter (Keyence™) was set to 10°of illumination incidence. The function High Dynamic Range (HDR) was used for all pictures. All pictures were enlarged to get sized photos that exclude the wing size as a discriminating criterion for species identification by deep learning approaches. Geographical origin, sampling date, and the sex and identity of the filed-caught species and the entomologist who identified them in the sampling location were recorded individually. The numerical parameters of the camera were as follows: white Balance 3200 K, Shutter Speed 1/15(sec), gain 0db, frame rate 15F/s, brightness 15%, texture 15%, contrast 45%, color 100%. The luminosity, contrast, shadow, reflection, and saturation were settled at 80, 100, 0, 0, and 100% using Windows 7 familial edition. All pictures were dusted off manually before being filled in the database.
Collected dataset, image pre-processing, and dataset splitting for training/learning and validation
The annotated image dataset, including 843 pictures of 42 Anopheles species belonging to 3 subgenera (Anopheles, Cellia, Nyssorhynchus) were prepared to undergo learning Anopheles classification. For training purposes, the sample sex, geographic origin (population), age, and physiological state (blood feed or not) were not considered to get a general classifier model. The 4688 pictures of WIPs belonging to the Diptera family encompassing Glossinidae, Psychodidae, Culididae, and other genera were added. Under-sampled Anopheles species (less than ten samples/pictures) and An. multicolor were discarded for the training of Anopheles identification at the species level to prevent overfitting. Still, they were included in the training dataset at the subgenus level. All processed images were resized to 256 and 116 pixels for width and height, respectively. Pixel values were normalized within the (0,1) range. The dataset was then prepared for k-fold cross-validation, with k = 5, similar to what have been performed for Glossina sp WIPs analyses27. K-fold cross-validation is a classic approach to evaluate the robustness of a machine learning method, including Deep Learning ones. For this study, the dataset was randomly shuffled and partitioned into k equal-size subsets with similar class distributions. A separately learned classifier was evaluated for each subgroup using the kth of all datasets for validation and the remaining k−1 as training data.
This strategy allowed measuring the mean accuracy of the five distinct generated classifiers. Among all existing machine learning methods, Deep Convolutional Neural Networks and their different architectures have shown in the last decade to be the most adapted for image classification. Compared to classic shallow methods (Support Vector Machine, Random Forest, and Boosting-based approaches for the main ones), they do not need hand-crafted features as input of the learning process: the selection of the best features is intrinsic to the method itself and is particularly well adapted to the particular scenario of WIPs. A pipeline overview of the complete training procedure using CNN is shown in Fig. 1.
Schematic representation of the pipeline process developed for Anopheles identification using the Convolutional Neural Network approach. Example of classification output with the associated probability. The class of a given Anopheles WIPs image is predicted by two steps: (1) extracting hierarchical features (Convolutional layer) and (2) classifying these features (Fully-connected layer and softmax layer). In the feature extractor part, feature maps generated by filters at each convolution layer are indicated. These feature maps are used for visualization by weighting them with channel-wise averaged gradients.
Training of the convolutional neural network (CNN)
The original CNN architecture MobileNet36, ResNet37, and YOLOv238 architecture were deemed for the automatic classification with the abovementioned dataset. Compared to classic Deep Learning, ours is more compact to cope with our dataset's specificity in terms of size; therefore, thinner image recognition and classification architecture were developed to consider its reduced size. The first one is inspired by MobileNet, which takes advantage of depth-wise convolution36. We propose to work with only one depth-wise convolution per layer of the CNN architecture to reduce the complexity and the number of extracted features. In addition, batch normalization was set to speed up and stabilize the training process39.
In this first compact CNN architecture based on MobileNet, two interconnected layers like VGG40 for YOLOv2 were applied with a DarkNet-1938architecture. As this kind of architecture tends to over-fit the training set (which means a lack of generalization of the performance when other data than the training data set is considered), we tested two reduced architectures, i.e., using 1 or 2 scales less than the original network. For clarity, we called them DarkNet-9 (8 convolution layers and one classification layer) and DarkNet-14 (13 convolution layers and one classification layer). We also reproduced the ResNet18 architecture37 and trained it from random initialization. Even if this architecture seems too “deep” (may lead to overfitting) compared to our other architectures, the intrinsic properties of ResNet18, residual connections, allow convergence of the training procedure. Finally, a standard approach (shallow approach) based on extracting SURF descriptors (an efficient implementation of the classic SIFT descriptors), a Bag of Features (BoF) representation using a 4000 codewords dictionary, and an SVM with a standard polynomial kernel similar to it was proposed in Sereno et al.26. For each task, we only use 1 fully connected layer with the softmax activation to predict the probability that an image belongs to the correct class. We train our networks using Stochastic Gradient Descent (SGD) with a learning rate of 102 and a momentum of 0:9 for 30 epochs. The method was developed on a workstation with a quad-core CPU at 3.0 GHz and 16Go RAM. Information on the training options, accuracy and sensitivity, as well as the code, are available at https://github.com/marcensea/diptera-wips/commit/12f39ab500a3f820cfb817c67ef25c580942301d.
From the appurtenance probabilities matrix, an Euclidean distances (function dist in R package stats) distance matrix between pictures was computed. Then, from this distance matrix, a hierarchical cluster representation showing all photos of the test dataset was drawn using the average method of clustering (function hclust in R package stats) and plotted using the ape functions of the R package.
Results
Wing interferential pattern according to anopheles wings genera, species, sex, and date of sampling
Sexual dimorphism
WIPs significantly vary among specimens belonging to different species but moderately amongst specimens of the same species or between sexes (Fig. 3). WIPs were explored on the broader panel of Anopheles specimens available and from 3 subgenera over the eight currently described. We previously documented the conservation of the interferential pattern on the wings of Glossina according to the position of the radial symmetry (intrados/extrado) and axial symmetry (left and right)27. We also investigate the sexual dimorphism of WIPS in studied samples (Fig. 2). Sexual dimorphism of WIPs is documented for numerous dipteran families, including Culicidae, Glossinidae, Muscidae, Calliphoridae, Ceratopogonidae…41,42,43. Picture of WIPs disclosed that for the Anopheles specimens we examined, the sexual dimorphism is weak and difficult to delineate with the naked eye (Fig. 3). A more in-depth study would be necessary to investigate its presence.
Date of sampling
Knowing that the sample dataset is filled with a variety of specimens collected and identified as early as 1951, we checked the stability of WIPs according to the age of collection of the specimen (Fig. 3). WIPs, when microscopically observable, appear unaffected by the conservatory period, allowing us to enrich our dataset with samples from the IRD collection. Although in some older samples and/or heavily damaged ones, WIPs cannot always be revealed. This lack of WIPs happened for 50% of specimens collected before the 80 s and preserved in the collection (Data not shown).
Training and classification
We explored the training classifier accuracy on the Anopheles dataset and on datasets of Culicidae that do not belong to the Anopheles genus (non-Anopheles) and from mosquitoes that do not belong to the Culicidae family (non-Culicidae), as negative samples. We trained the CNN on such a combination to improve the model's accuracy. The database initially filled with a total of 843 pictures of Anopheles sp. WIPs pictures, 710 illustrating species documented with more than ten pictures and 133 with less than 10. Our dataset contains photos of species acting as primary vectors of viruses, parasites, or bacteria having a medical interest (Table 1). Our database is filled with 25 Anopheles sp, out of the 140 with documented medical or veterinary interests. Overall, the WIPs of 43 Anopheles species were filled in our dataset. However, only 20 species have encompassed the training process because at least ten pictures are available in our dataset. The other specimens were used only to train the classifier recognition at the genus (Anopheles) and subgenus (Anopheles, Cellia, Nyssorhynchus) taxonomic levels.
Classification at the genus level
Using this dataset, we first ascertained the accuracy of the process to discriminate the Anopheles genus Meigen, 1818, from other members of the Culicidae Meigen, 1818 family and belonging to the Culicinae Meigen, 1818 subfamily. These specimens belonged to the Culex Linnaeus, 1758; Lutzia Theobald, 1903; Aedes Meigen, 1818. Non-Culicidae sample members belonging to the Psychodidae, Glossinidae, and Ceratopogonidae families were also filled in the dataset to test the classification accuracy. The automatic classification process accuracy for Anopheles Meigen, 1818 is incredibly high, with more than 99% of accuracy (Table 2). A sole picture was badly classified as belonging to the Culex genus.
Classification at the subgenus level
In the second step, we investigate the capacity of our DL process to correctly address the identification of the specimens at the subgenus level. The training and testing dataset included a set of 833 pictures representative of 43 Anopheles species and three subgenera. Table 3 shows that the subgenus assignation accuracy is high for Cellia, moderate for Anopheles, and faint for Nyssorhynchus. The Cellia subgenus is documented by more species and pictures, followed by the Anopheles subgenus and the Nyssorhynchus. Therefore, the accuracy discrepancy ranging from 38.8% to 96.6% might be due to the low representativity of species and specimens for the Anopheles and Cellia subgenera. In addition, the selected descriptors and the training process might need to be revised to train an accurate classifier to identify Anopheles at the subgenus taxonomic level. These questions must be further addressed.
Classification at the species level
A circular dendrogram reflecting the proximity of each picture belonging to the Anopheles dataset was drawn (Fig. 4), depicting the presence of clusters. Some clusters match all the pictures of WIPs of the same species: An. mascarensis, cluster 2; An. darlingi cluster 3; An. listeri, cluster 11; An. punctimacula, cluster 12; An. pharoensis, cluster 15. Other clusters include all members of the same species plus some pictures of other related species: cluster 1, all An. funestus pictures plus one picture of An. barberellus; cluster 4, all An. obscurus plus one picture of An. nili Theobald, 1904 and An. paludis; cluster 7 gathering all An. arabiensis but including six extra-specie pictures and cluster 14, all An. gambiae plus three pictures of An. colluzzii. The last category of clusters included most pictures of a species, but not all of them: cluster 5, mainly An. paludis; cluster 6, primarily An. maculipennis; cluster 9, mainly An. cinctus; cluster 10, mainly An. squamosus; cluster 13, mostly An. coluzzi and cluster 8, gathering the An. multicolor photos with three pictures of An. cinereus. Notably, no species out of the 20 under study scattered into more than two clusters.
Finally, the reliability of the DL model to accurately classify WIPs pictures of 19 Anopheles species was calculated, and results are presented in Table 4. Variable level of accuracy is recorded, ranging from faintly (50.00%) to perfect classification (100.00%). A perfect accuracy (100.00% level) is achieved for ten species whose WIPs pictures were filled in the dataset. More than 50% of accuracy in classification is recorded for three species, but the DL methods failed to assign 7 Anopheles species with an accuracy superior to 50% (Table 4). For most of the species whose assignation accuracy falls below 70%, a low number of representative pictures is available; indeed, only a small number of pictures are available for the test process (An. demeilloni 2, An. maculipennis 4, An. barberelus, 2, etc.). More than ten pictures per species might be a prerequisite to get good accuracy with our process; this will be further investigated. Only 14 pictures of the test dataset were misclassified (Fig. 2B), and the computed specific recognition of Anopheles remains astonishing, considering our dataset's species richness.
The Anopheles genus encompasses numerous morphologically indistinguishable species, ranging into the species complex level, e.g., ‘morphologically similar or identical natural populations that are reproductively isolated’. According to this definition, 27 species complexes are currently described for Anopheles. Our dataset gathers specimens from 4 complexes, the Claviger, Gambiae, Marshallii, and Nili complexes. Anopheles nili belongs to a complex of 4 species (An. nili; An. somalicus Rivola & Holstein, 1957; An. carnevalei Brunhes, Le Goff & Geoffroy, 1999; An. ovengensis Awono-Ambene, Kengne, Simard, Antonio-Nkondjio & Fontenille, 2004). Unfortunately, we cannot address the accuracy of the identification process for 3 of them because species were documented in our dataset with less than ten pictures for the Marshallii and Claviger complexes, or only one species for the Nili complex.
As early as 1968, morphological variations in An. nili s.l populations suggest that An. nili is a complex of species whose members were further identified44,45. Our set of pictures of An. nili, gathers specimens date back to 1966 and might, therefore, encompass species belonging to the Nili complex not described before shreds of evidence for the presence of this complex. In addition to the few pictures available to train the classifier, other underlying factors might result in the fair identification accuracy we recorded. For other mispredicted pictures, the small number of samples available and the age of specimens age might have altered the prediction approach’s power. Even if An. maculipennis can be misidentified as An. arabiensis see Fig. 5, these two species are not sympatric in their natural environment.
The “Gambiae complex9”, first described in 1960, is documented in our dataset by four species over the nine currently described. Nevertheless, fewer than ten pictures are present in the dataset for one species. Nevertheless, our DL approach on WIPs demonstrates an astonishing identification accuracy of 100% for An. arabiensis and An. gambiae and 88% for An. coluzzii (Table 4). All specimens were collected from colonies avoiding misidentification ambiguity. Strikingly An. coluzzii is frequently misidentified as An. gambiae but never as An. arabiensis. It appears that An. gambiae and An. arabiensis are always correctly identified.
Overall photos of mispredicted species (Fig. 5) show that the samples of An. obscurus miss-predicted as a non-Anopheles specimen is of interest since this specimen bears wings characters of Anopheles, smooth and patchy areas on the wing costa and subcosta. This sample originated from Congo and was collected in 1988; the interferential pattern was still present but appeared slightly degraded during the preservation period. Such modification might have affected the recognition process, and it is documented that some slight picture modifications (blur lens, etc..) can significantly alter the recognition accuracy of our process27. The An. coluzzii misidentified as An. gambiae presents morphological alteration with damage on the wing; nevertheless, this hasn’t prevented a correct classification at the genus and subgenus taxonomic level.
Discussion
In this study, we present clues on the accuracy of WIPs with DL to identify Anopheles specimens at various taxonomic levels, genus of subgenus, species, and complexes. Our results reveal that WIPs generated at the surface of Anopheles wings are a proper fingerprinting method to decipher specimens’ identity at taxonomic levels of interest for the entomological survey and vector control follow-up.
Since the 2010s, WIPs (Wing Interference Patterns) have received significant attention for their potential as a diagnostic method for species identification, used in taxonomic and systematic studies23,25,46. The transparent wings with a thin membrane, i.e., mainly in small insects, allow the formation of a colored pattern via thin-film interference. In a dark and light-absorbing environment with incoming external light (sunshine, for example), conspicuous WIPs are displayed on the wing membranes. These WIPs significantly vary among specimens belonging to distinct species but moderately between specimens of the same species or between sexes. The observed newton color series is similar to that appearing on a soap bubble and is directly proportional to the thickness of the wing membrane at any given point. Unlike the angle-dependent iridescence effect of a flat film, wing structures in an insect’s thin wing membrane act as diopters ensuring the WIPs appear essentially non-iridescent23. The role played by WIPs on sexual selection in Drosophila melanogaster was addressed, demonstrating that males with more vivid wings are more attractive to females than males with dull wings. These experimental results add a visual element to the mating tool array of Drosophila47. The role of WIP during courtship points to a function during insects’ speciation. This point is interesting and will deserve further exploration for explaining assortative mating of the Gambiae complex members in their natural environment.
The genus Anopheles encompasses eight subgenera, Anopheles, Baimaia, Cellia, Christya, Kerteszia, Lophopodomyia, Nyssorhynchus, and Stethomyia. The largest cosmopolitan genera are Anopheles and Cellia. From a malaria transmission standpoint, a relatively small number of species of the Cellia subgenus (i.e., the Gambiae complex) are responsible for most of the world’s malaria transmission; for a broader entomological survey point of view, more than 100 species of Anopheles are of medical and veterinary interest. With about 500 inventoried and validated species, accurately identifying Anopheles is challenging, even using published identification keys48,49,50,51,52. The presence of species complexes further puzzled the survey in areas where vector and non-vector species belonging to the same complex are sympatric. The two most known examples of such complexes are the An. maculipennis complex, with at least nine species in Europe45, and the Gambiae complex, with nine species in Africa. Besides diversity, microscopic observation is a time-consuming and challenging process, mainly owing to the skills and experience of dedicated public health personnel. In addition, variability in the morphological characteristics of mosquitoes collected in the fields may be degraded due to discoloration or damages caused during the capture and processing at the study site or during the freezing and drying preservation protocols.
Methodologies relying on genetic or biochemical criteria were tested to overcome such identification challenges. The DNA employs short molecular sequence tags from standardized genomic regions for species identification. Actually, 16,948 records forming 378 clusters, are available for the Anopheles genus (http://v4.boldsystems.org/index.php request performed on 12/7/2022). DNA barcoding can complement the morphological assessment of specimens but present several flattens and needs to be better suited for field entomological surveys53,54. Biochemical markers include protein profiling using MALDI-TOF analysis or other biochemical characteristics of the sample, like the cuticle carbohydrate composition and chemical formula55. The MALDI-TOF profiling was first applied with relative success to a restricted number of Anopheles species (An. albimanus, An. minimus, An. freeborni, An. farauti, An. atroparvus, An. funestus), but including members of the Gambiae complex (An. quadrimaculatus, An. merus, An. gambiae, An. arabiensis), using head and thoraces of females mosquitoes56,57. This methodology was further applied to some neotropical anophele vectors (An. albimanus, An. apimacula, An. aquasalis, An. darlingi, An. malefactor, An. nuneztovari, An. pseudopunctipennis, An. punctimacula) with an identification success between 78 to 100%, comparable to our accuracy rate58. Nevertheless, few works were subsequently performed on Anopheles specimens with protein profiling59. Altogether, these methodology helps to solve some taxonomic and ambiguous identification problems but could not be amenable for entomological survey purposes due to their cost, requirements in infrastructures and material, and trained personnel. Infrared spectroscopy (NIR and MIR) can detect changes in mosquito cuticles by quantifying light absorbed60. The discriminative capability of such methodology at the species level has yet to be thoroughly investigated and is restricted to very few members of the Anopheles genus, i.e., An. gambiae s.s, An. coluzzii, and An. arabiensis but appears to be well fitted for age grading of populations34,60,61,62,63,64,65, but also, interestingly, on pathogen (Plasmodium) detection within the arthropod vector66. Here, we provide clues on the reliable Anopheles species identification using WIPs and the DL process. We identified some species with 100% accuracy, even those belonging to the Gambiae complex of species34,62. This precision is higher than those provided by MIR or NIR technology. We also provide pieces of information on the capability of this method to be successfully translated on field-collected samples and old specimens. In addition, our methodology allows for identifying specimens at various taxonomic levels and, even for damaged specimens, addressing classification at the genus and/or subgenus levels. This is of interest for medical entomology purposes, knowing that species having a medical or veterinary interest are gathered in four out of the eight subgenera described. It might also be helpful for taxonomic studies involving old specimens.
The advance in Deep learning (DL) processes have opened a new perspective for arthropod identification. This branch of machine learning has the versatility to be employed on various markers of use in entomology, including protein profiling and image analysis for morphological characteristics. The latter, which includes typical morphological characteristics used to identify Culicidae specimens, can potentially be used in “citizen sciences” projects. Such community surveillance has been applied for mosquitoes 67,68, and a citizen science approach in conjunction with a deep learning method was developed to follow Aedes albopictus (Skuse, 1895) from pictures taken by citizen69. Nevertheless, for instance, the accuracy of such methods has not been evaluated in areas with high Culicidae diversity or for Anopheles recognition. Nonetheless, we can anticipate that this process will suffer from the same limitation in identifying species belonging to the same complex. Although DL approaches have also been applied for training Anopheles belonging to the Gambiae complex identification and age grading using MIR34, its interest for a taxonomic purpose has not been thoroughly probed.
Therefore, it will be of interest to further explore the capacity of WIPs in couple with DL to address challenges concerning delineating geographically distinct populations, sex, physiological state identification, and its versatility to perform age grading in natural populations, if any. We anticipate this method can be applied to other arthropod vector-borne diseases. Assuming that Deep learning analysis results in robust classification outcomes, it is worth evaluating, even qualitatively, whether the proposed approach could be scalable and usable in real-life conditions regarding several essential criteria: cost (infrastructure, material, technically skilled personnel), computational resources, analyzing time, sample destructiveness, and taxonomic level of the classification.
Data availability
The source code is publicly available on GitHub, with a direct https://github.com/marcensea/diptera-wips.git. Dataset is available with a direct https://doi.org/10.6084/m9.figshare.22083050.v1.
References
Shaw, W. R., Marcenac, P. & Catteruccia, F. Plasmodium development in Anopheles: A tale of shared resources. Trends Parasitol 38, 124–135. https://doi.org/10.1016/j.pt.2021.08.009 (2022).
Epelboin, Y., Talaga, S., Epelboin, L. & Dusfour, I. Zika virus: An updated review of competent or naturally infected mosquitoes. PLoS Negl Trop Dis 11, e0005933. https://doi.org/10.1371/journal.pntd.0005933 (2017).
Ratovonjato, J. et al. Detection, isolation, and genetic characterization of Rift Valley fever virus from Anopheles (Anopheles) coustani, Anopheles (Anopheles) squamosus, and Culex (Culex) antennatus of the Haute Matsiatra region, Madagascar. Vector Borne Zoonotic Dis 11, 753–759. https://doi.org/10.1089/vbz.2010.0031 (2011).
Dieme, C. et al. Transmission potential of Rickettsia felis infection by Anopheles gambiae mosquitoes. Proc Natl Acad Sci USA 112, 8088–8093. https://doi.org/10.1073/pnas.1413835112 (2015).
Socolovschi, C., Pages, F., Ndiath, M. O., Ratmanov, P. & Raoult, D. Rickettsia species in African Anopheles mosquitoes. PLoS One 7, e48254. https://doi.org/10.1371/journal.pone.0048254 (2012).
Marston, B. Mosquitoes as vectors of Dermatobia in eastern Colombia. Ann Entomol Soc Am 36, 21–24. https://doi.org/10.1093/aesa/36.1.21 (1943).
Alencar, R. B., Saraiva, J. F., Oliveira, A. F. J. & Scarpassa, V. M. First record of Anopheles konderi Galvão & Damasceno (Diptera: Culicidae) carrying eggs of Dermatobia hominis (Linnaeus Jr.) (Diptera: Oestridae), from Oriximiná municipality, Pará, Brazil. Rev Soc Bras Med Trop 50, 388–390. https://doi.org/10.1590/0037-8682-0446-2016 (2017).
Sudomo, M. et al. Elimination of lymphatic filariasis in Southeast Asia. Adv Parasitol 72, 205–233. https://doi.org/10.1016/s0065-308x(10)72008-x (2010).
Davidson, G. Anopheles gambiae Complex. Nature 196, 907–907. https://doi.org/10.1038/196907a0 (1962).
Torre, A. d. et al. Molecular evidence of incipient speciation within Anopheles gambiae s.s. in West Africa. Insect Mol Biol 10, 9–18, https://doi.org/10.1046/j.1365-2583.2001.00235.x (2001).
Riehle, M. M. et al. A cryptic subgroup of Anopheles gambiae is highly susceptible to human malaria parasites. Science 331, 596–598. https://doi.org/10.1126/science.1196759 (2011).
Loughlin, S. O. The expanding Anopheles gambiae species complex. Pathog Glob Health 114, 1. https://doi.org/10.1080/20477724.2020.1722434 (2020).
Barrón, M. G. et al. A new species in the major malaria vector complex sheds light on reticulated species evolution. Sci Rep 9, 14753. https://doi.org/10.1038/s41598-019-49065-5 (2019).
Van Bortel, W. et al. Identification of two species within the Anopheles minimus complex in northern Vietnam and their behavioural divergences. Trop Med Int Health 4, 257–265. https://doi.org/10.1046/j.1365-3156.1999.00389.x (1999).
Yssouf, A., Almeras, L., Raoult, D. & Parola, P. Emerging tools for identification of arthropod vectors. Future Microbiol 11, 549–566. https://doi.org/10.2217/fmb.16.5 (2016).
Muhammad Tahir, H. & Akhtar, S. Services of DNA barcoding in different fields. Mitochondrial DNA A DNA Mapp Seq Anal 27, 4463–4474, https://doi.org/10.3109/19401736.2015.1089572 (2016).
Beebe, N. W. DNA barcoding mosquitoes: advice for potential prospectors. Parasitology 145, 622–633. https://doi.org/10.1017/s0031182018000343 (2018).
Johnson, J. B. & Naiker, M. Seeing red: A review of the use of near-infrared spectroscopy (NIRS) in entomology. Appl Spectrosc Rev 55, 810–839. https://doi.org/10.1080/05704928.2019.1685532 (2020).
Johnson, J. B. Near-infrared spectroscopy (NIRS) for taxonomic entomology: A brief review. J Appl Entomol 144, 241–250 (2020).
Moore, A., Miller, J. R., Tabashnik, B. E. & Gage, S. H. Automated identification of flying insects by analysis of wingbeat frequencies. J Econ Entomol 79, 1703–1706. https://doi.org/10.1093/jee/79.6.1703 (1986).
Moore, A. Artificial neural network trained to identify mosquitoes in flight. J Insect Beh 4, 391–396. https://doi.org/10.1007/BF01048285 (1991).
Genoud, A. P., Basistyy, R., Williams, G. M. & Thomas, B. P. Optical remote sensing for monitoring flying mosquitoes, gender identification and discussion on species identification. Appl Phys B 124, https://doi.org/10.1007/s00340-018-6917-x (2018).
Shevtsova, E., Hansson, C., Janzen, D. H. & Kjærandsen, J. Stable structural color patterns displayed on transparent insect wings. Proc Natl Acad Sci USA 108, 668–673. https://doi.org/10.1073/pnas.1017393108 (2011).
Shevtsova, E. & Hansson, C. Species recognition through wing interference patterns (WIPs) in Achrysocharoides Girault (Hymenoptera, Eulophidae) including two new species. Zookeys, 9–30. https://doi.org/10.3897/zookeys.154.2158 (2011).
Buffington, L. M. & Sandler, J. R. The occurrence and phylogenetic implications of wing interference patterns in Cynipoidea (Insecta : Hymenoptera). Invertebr Syst 25, 586–597 (2012).
Sereno, D., Cannet, A., Akhoundi, M., Romain, O. & Histace, A. Système et procédé d'identification automatisée de diptères hématophages. France PCT/FR15/000229. patent (2015).
Cannet, A. et al. Wing interferential patterns (WIPs) and machine learning, a step toward automatized tsetse (Glossina spp.) identification. Sci Rep 12, 20086. https://doi.org/10.1038/s41598-022-24522-w (2022).
Motta, D. et al. Application of convolutional neural networks for classification of adult mosquitoes in the field. PLoS One 14, e0210829. https://doi.org/10.1371/journal.pone.0210829 (2019).
Lorenz, C., Ferraudo, A. S. & Suesdek, L. Artificial neural network applied as a methodology of mosquito species identification. Acta Trop 152, 165–169. https://doi.org/10.1016/j.actatropica.2015.09.011 (2015).
Park, J., Kim, D. I., Choi, B., Kang, W. & Kwon, H. W. Classification and morphological analysis of vector mosquitoes using deep convolutional neural networks. Sci Rep 10, 1012. https://doi.org/10.1038/s41598-020-57875-1 (2020).
Kittichai, V. et al. Deep learning approaches for challenging species and gender identification of mosquito vectors. Sci Rep 11, 4838. https://doi.org/10.1038/s41598-021-84219-4 (2021).
Zhao, D.-Z. et al. A swin transformer-based model for mosquito species identification. Sci Rep 12, 18664. https://doi.org/10.1038/s41598-022-21017-6 (2022).
Yin, M. S. et al. A deep learning-based pipeline for mosquito detection and classification from wingbeat sounds. Multimed Tools Appl https://doi.org/10.1007/s11042-022-13367-0 (2022).
Siria, D. J. et al. Rapid age-grading and species identification of natural mosquitoes for malaria surveillance. Nat Commun 13, 1501. https://doi.org/10.1038/s41467-022-28980-8 (2022).
Wilkerson, R. C. et al. Making mosquito taxonomy useful: A stable classification of tribe Aedini that balances utility with current knowledge of evolutionary relationships. PLoS One 10, e0133602, doi:https://doi.org/10.1371/journal.pone.0133602 (2015).
Howard, A. G. et al. MobileNets: Efficient convolutional neural networks for mobile vision applications. ArXiv abs/1704.04861 (2017).
He, K., Zhang, X., Ren, S. & Sun, J. Deep residual learning for image recognition. In 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 770–778 (2016).
Redmon, J. & Farhadi, A. YOLO9000: Better, Faster, Stronger. In 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 6517–6525 (2017).
Ioffe, S. & Szegedy, C. Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift. ArXiv abs/1502.03167 (2015).
Simonyan, K. & Zisserman, A. Very deep convolutional networks for large-scale image recognition. CoRR abs/1409.1556 (2015).
Butterworth, N. J., White, T. E., Byrne, P. G. & Wallman, J. F. Love at first flight: wing interference patterns are species-specific and sexually dimorphic in blowflies (Diptera: Calliphoridae). J Evol Biol 34, 558–570. https://doi.org/10.1111/jeb.13759 (2021).
Hawkes, M. F. et al. Sexual selection drives the evolution of male wing interference patterns. Proc Biol Sci 286, 20182850–20182850. https://doi.org/10.1098/rspb.2018.2850 (2019).
Pielowska-Ceranowska, A. & Szwedo, J. Wing interference patterns in patterned wings of Culicoides Latreille, 1809 (Diptera: Ceratopogonidae)-exploring potential identification tool. Zootaxa 4868, zootaxa.4868.4863.4864. https://doi.org/10.11646/zootaxa.4868.3.4 (2020).
Brunhes, J., Le Goff, G. & Geoffroy, B. Afro-tropical anopheline mosquitoes. III. Description of three new species: Anopheles carnevalei sp. nov., An. hervyi sp. nov., and An. dualaensis sp. nov., and resurrection of An. rageaui Mattingly and Adam. J Am Mosq Control Assoc 15, 552–558 (1999).
Fontenille, D. & Simard, F. Unravelling complexities in human malaria transmission dynamics in Africa through a comprehensive knowledge of vector populations. Comp Immunol Microbiol Infect Dis 27, 357–375. https://doi.org/10.1016/j.cimid.2004.03.005 (2004).
Simon, E. Preliminary study of wing interference patterns (WIPs) in some species of soft scale (Hemiptera, Sternorrhyncha, Coccoidea, Coccidae). Zookeys, 269–281, https://doi.org/10.3897/zookeys.319.4219 (2013).
Katayama, N., Abbott, J. K., Kjærandsen, J., Takahashi, Y. & Svensson, E. I. Sexual selection on wing interference patterns in Drosophila melanogaster. Proc Natl Acad Sci U S A 111, 15144–15148. https://doi.org/10.1073/pnas.1407595111 (2014).
Harbach, R. E. in Anopheles mosquitoes-New insights into malaria vectors (IntechOpen, 2013).
Sallum, M. A. M., Schultz, T. R. & Wilkerson, R. C. Phylogeny of Anophelinae (Diptera Culicidae) based on morphological characters. Ann Entomol Soc Am 93, 745–775. https://doi.org/10.1603/0013-8746(2000)093[0745:Poadcb]2.0.Co;2 (2000).
Sallum, M. A. M. et al. Phylogeny of Anophelinae (Diptera: Culicidae) based on nuclear ribosomal and mitochondrial DNA sequences. Syst Entomol 27, 361–382. https://doi.org/10.1046/j.1365-3113.2002.00182.x (2002).
Foster, P. G. et al. Phylogeny of Anophelinae using mitochondrial protein coding genes. R Soc. Open Sci. 4, 170758, https://doi.org/10.1098/rsos.170758 (2017).
Sallum, M. A. M., Obando, R. G., Carrejo, N. & Wilkerson, R. C. Identification keys to the Anopheles mosquitoes of South America (Diptera: Culicidae) I. Introduction. Parasites Vect 13, 583. https://doi.org/10.1186/s13071-020-04298-6 (2020).
Chan, A. et al. DNA barcoding: Complementing morphological identification of mosquito species in Singapore. Parasites Vect 7, 569. https://doi.org/10.1186/s13071-014-0569-4 (2014).
Collins, R. A. & Cruickshank, R. H. The seven deadly sins of DNA barcoding. Mol Ecol Resour 13, 969–975. https://doi.org/10.1111/1755-0998.12046 (2013).
Johnson, B. J., Hugo, L. E., Churcher, T. S., Ong, O. T. W. & Devine, G. J. Mosquito age grading and vector-control programmes. Trends Parasitol 36, 39–51. https://doi.org/10.1016/j.pt.2019.10.011 (2020).
Müller, P. et al. Identification of cryptic Anopheles mosquito species by molecular protein profiling. PLoS One 8, e57486. https://doi.org/10.1371/journal.pone.0057486 (2013).
Nabet, C. et al. New assessment of Anopheles vector species identification using MALDI-TOF MS. Malaria J 20, 33. https://doi.org/10.1186/s12936-020-03557-2 (2021).
Loaiza, J. R. et al. Application of matrix-assisted laser desorption/ionization mass spectrometry to identify species of Neotropical Anopheles vectors of malaria. Malaria J 18, 95. https://doi.org/10.1186/s12936-019-2723-0 (2019).
Sánchez-Juanes, F. et al. Applications of MALDI-TOF mass spectrometry to the identification of parasites and arthropod vectors of human diseases. Microorganisms 10, 2300 (2022).
Mayagaya, V. S. et al. Non-destructive determination of age and species of Anopheles gambiae s. l. using near-infrared spectroscopy. Am J Trop Med Hyg 81, 622–630, doi:https://doi.org/10.4269/ajtmh.2009.09-0192 (2009).
Lambert, B. et al. Monitoring the age of mosquito populations using Near-Infrared Spectroscopy. Sci Rep 8, 5274. https://doi.org/10.1038/s41598-018-22712-z (2018).
Somé, B. M. et al. Adapting field-mosquito collection techniques in a perspective of near-infrared spectroscopy implementation. Parasit Vectors 15, 338. https://doi.org/10.1186/s13071-022-05458-6 (2022).
Sikulu, M. T. et al. Using a near-infrared spectrometer to estimate the age of Anopheles mosquitoes exposed to pyrethroids. PLoS One 9, e90657, https://doi.org/10.1371/journal.pone.0090657 (2014).
Milali, M. P. et al. Age grading An. gambiae and An. arabiensis using near infrared spectra and artificial neural networks. PLoS One 14, e0209451, https://doi.org/10.1371/journal.pone.0209451 (2019).
Ntamatungiro, A. J. et al. The influence of physiological status on age prediction of Anopheles arabiensis using near infra-red spectroscopy. Parasit Vectors 6, 298. https://doi.org/10.1186/1756-3305-6-298 (2013).
Da, D. F. et al. Detection of Plasmodium falciparum in laboratory-reared and naturally infected wild mosquitoes using near-infrared spectroscopy. Sci Rep 11, 10289. https://doi.org/10.1038/s41598-021-89715-1 (2021).
Braz Sousa, L. et al. Citizen science and smartphone e-entomology enables low-cost upscaling of mosquito surveillance. Sci Total Environ 704, 135349, https://doi.org/10.1016/j.scitotenv.2019.135349 (2020).
Jordan, R. C., Sorensen, A. E. & Ladeau, S. Citizen science as a tool for mosquito control. J Am Mosq Control Assoc 33, 241–245. https://doi.org/10.2987/17-6644r.1 (2017).
Pataki, B. A. et al. Deep learning identification for citizen science surveillance of tiger mosquitoes. Sci Rep 11, 4718. https://doi.org/10.1038/s41598-021-83657-4 (2021).
Acknowledgements
We thank Pr. P. Marty and P. Delaunay (CHU Nice) for gaining access to the microscopic facility of the CHU. Dr. D. Fontenille (UMR MIVEGEC, Montpellier, France) for his support and fruitfully scientific discussions on medical entomology aspects. Mr JP Commes, former CEO of 2CSI, for his enthusiasm for the digital aspects of the project.
Author information
Authors and Affiliations
Contributions
Conceptualisation De.S., A.C., M.A., A.H., C.S.C., O.R. Data acquisition De.S., A.C., M.S., A.H., Da.S. Database construction De.S., Da.S., A.H., P.J., M.S., O.R. Sample collection and arthropod management P.B., De.S., F.L. Code management: M.S., A.H., C.S.C., O.R., P.J. Data analysis M.S., A.H., De.S., C.B., Project management De.S., A.H., C.S.C. Writing first draft A.H., De.S., A.C. Writing and editing: De.S. A.C., M.A., C.S.C., P.B., A.H., K.M., C.B., F.L.
Corresponding author
Ethics declarations
Competing interests
The authors declare no competing interests.
Additional information
Publisher's note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/.
About this article
Cite this article
Cannet, A., Simon-Chane, C., Akhoundi, M. et al. Deep learning and wing interferential patterns identify Anopheles species and discriminate amongst Gambiae complex species. Sci Rep 13, 13895 (2023). https://doi.org/10.1038/s41598-023-41114-4
Received:
Accepted:
Published:
DOI: https://doi.org/10.1038/s41598-023-41114-4
- Springer Nature Limited
This article is cited by
-
An annotated wing interferential pattern dataset of dipteran insects of medical interest for deep learning
Scientific Data (2024)
-
Wing Interferential Patterns (WIPs) and machine learning for the classification of some Aedes species of medical interest
Scientific Reports (2023)
-
Species identification of phlebotomine sandflies using deep learning and wing interferential pattern (WIP)
Scientific Reports (2023)