, Volume 49, Issue 1, pp 59–71 | Cite as

Decision-Level Fusion-Based Structure of Autism Diagnosis Using Interpretation of EEG Signals Related to Facial Expression Modes


A structure of decision-level fusion-based autism diagnosis using analysis of EEG signals related to presentation of facial expression modes has been proposed. EEG signals of autistic and normal children were recorded during processing images of emotional facial expression modes, such as sadness, happiness, and calmness. Then brain signals were mapped into the feature space by applying a novel hybrid model utilizing the brain potentials recorded during the examination task. The aim of mapping was to achieve separation of the autistic samples from normal ones with the highest precision. The created map provides the feature vectors that reflected spatial, temporal, and spectral data, as well as the coherence degrees for distinct areas of the brain. The mapping process was optimized using a genetic algorithm by assigning weighs to the feature vectors. Then the feature vectors corresponding to the three facial expressions of emotional modes were classified by support vector machines. Finally, using decision-level fusion through a majority voting rule, we see that the proposed structure is able to effectively distinguish the autistic individuals from normal ones.


autism spectrum disorders (ASDs) facial expression modes EEG signal interpretations hybrid model decision-level fusion 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    American Psychiatric Association, Diagnostic and Statistical Manual of Mental Disorders (fourth ed.), Am. Psychiat. Ass., USA (2000).Google Scholar
  2. 2.
    J. L. Matson and J. A. Boisijoli, “Strategies for assessing Asperger’s syndrome: A critical review of data based methods,” Res. Autism Spectrum Disord., 2, No. 2, 237-248 (2008).Google Scholar
  3. 3.
    J. L. Matson and N. F. Minshawi, Early Intervention for Autism Spectrum Disorders: A Critical Analysis, Elsevier Sci. Inc, Oxford (2006).Google Scholar
  4. 4.
    S. Baron-Cohen, F. J. Scott, C. Allison, et al., “Prevalence of autism-spectrum conditions: UK school-based population study,” Brit. J. Psychiat., 194, No. 6, 500-509 (2009).CrossRefPubMedGoogle Scholar
  5. 5.
    T. S. Brugha, S. McManus, J. Bankart, et al., “Epidemiology of autism spectrum disorders in adults in the community in England,” Arch. Gen. Psychiat., 68, No. 5, 459-465 (2011).CrossRefPubMedGoogle Scholar
  6. 6.
    C. Rice, “Prevalence of autism spectrum disorders - Autism and developmental disabilities monitoring network, United States,” MMWR Surveill Summ., 58, 1-20 (2009).Google Scholar
  7. 7.
    E. Fombonne, “Epidemiology of pervasive developmental disorders,” Pediat. Res., 65, No. 6, 591-598 (2009).CrossRefPubMedGoogle Scholar
  8. 8.
    A. Ghanizadeh, “A preliminary study on screening prevalence of pervasive developmental disorder in school children in Iran,” J. Autism Dev. Disord., 38, No. 4, 759-763 (2008).CrossRefPubMedGoogle Scholar
  9. 9.
    A. Nejatisafa, M. R. Kazemi, and J. Alaghebandrad, “Autistic features in adult population: evidence for continuity of autistic symptoms with normality,” Adv. Cogn. Sci., 5, No. 3, 34-39 (2003).Google Scholar
  10. 10.
    M. Othman and A. Wahab, “Affective face processing analysis in autism using electroencephalogram,” in: 3rd Int. Conf. Inform. Commun. Technol. Muslim World (ICT4M), Jakarta, Dec. 3-4 (2010), pp. E23-E27.Google Scholar
  11. 11.
    M. Hashemian and H. Pourghassem, “Facial emotion processing in autism spectrum disorder based on spectral features of EEG signals,” Int. J. Imag. Robotics, 11, No. 3, 68-80 (2013).Google Scholar
  12. 12.
    M. Ahmadlou, H. Adeli, and A. Adeli, “Fractality and a wavelet-chaos-neural network methodology for EEG-based diagnosis of autistic spectrum disorder,” J. Clin. Neurophysiol., 27, No. 5, 328-333 (2010).CrossRefPubMedGoogle Scholar
  13. 13.
    M. Hashemian and H. Pourghassem, “Autism spectrum disorders analysis based on EEG signal: a survey,” Neurophysiology, 46, No. 2, 183-195 (2014).CrossRefGoogle Scholar
  14. 14.
    A. Sheikhani, H. Behnam, M. Mohammadi, and M. Noroozian, “Analysis of quantitative electroencephalogram background activity in autism disease patients with Lempel-Ziv complexity and short time fourier transform measure,” in: Proc. 4th IEEE-EMBS, Cambridge (2007), pp. 19-22.Google Scholar
  15. 15.
    H. Behnam, A. Sheikhani, M. R. Mohammadi, et al., “Abnormalities in connectivity of quantitative electroencephalogram background activity in autism disorders especially in left hemisphere and right temporal,” in: Proc. 10th Int. Conf. Computer Model. Simul., 1-3 April (2008).Google Scholar
  16. 16.
    N. Razali and A. Wahab, “2D Affective Space Model (ASM) for detecting autistic children,” in: Proc. 15th IEEE Int. Sympos. Consumer Electron., Singapore (2011), pp. 536-541.Google Scholar
  17. 17.
    W. Bosl, A. Tierney, H. Tager-Flusberg, and C. Nelson, “EEG complexity as a biomarker for autism spectrum disorder risk,” BMC Med., 9, No. 18 (2011).Google Scholar
  18. 18.
    W. Khazal Shams and A. Wahab, “Characterizing autistic disorder based on principal component analysis,” Austral. J. Basic Appl. Sci., 6, No. 1, 149-155 (2012).Google Scholar
  19. 19.
    F. H. Duffy and H. Als, “A stable pattern of EEG spectral coherence distinguishes children with autism from neurotypical controls - a large case control study,” BMC Med., 10, No. 64 (2012).Google Scholar
  20. 20.
    M. Behnam and H. Pourghassem, “Real-time seizure prediction using rls filtering and interpolated histogram feature based on hybrid optimization algorithm of bayesian classifier and hunting search,” Comput. Methods Prog. Biomed., 132, No. 8, 115-136 (2016).CrossRefGoogle Scholar
  21. 21.
    S. Nasehi and H. Pourghassem, “Mental task classification based on HMM and BPNN,” in” Proc. Int. Conf. Commun. Systems Network Technol. (CSNT 2013), Gwalior, India, 6-8 Apr. (2013), pp. 210-214.Google Scholar
  22. 22.
    M. Behnam and H. Pourghassem, “Seizure-specific wavelet (seizlet) design for epileptic seizure detection using correntropy ellipse features based on seizure modulus maximas patterns,” J. Neurosci. Methods, 276, No. 2, 84-107 (2017).CrossRefPubMedGoogle Scholar
  23. 23.
    H. Adeli, S. Ghosh-Dastidar, and N. Dadmehr, “A wavelet-chaos methodology for analysis of EEGs and EEG subbands to detect seizure and epilepsy,” IEEE Trans. Biomed. Engineer., 54, No. 2, 205-211 (2007).CrossRefGoogle Scholar
  24. 24.
    S. Nasehi and H. Pourghassem, “A novel fast epileptic seizure onset detection algorithm using general tensor discriminant analysis,” J. Clin. Neurophysiol., 30, No. 4, 362-370 (2013).CrossRefPubMedGoogle Scholar
  25. 25.
    S. Nasehi and H. Pourghassem, “Online mental task classification based on DWT-PCA features and probabilistic neural network,” Int. J. Imag. Robotics, 7, No. 1, 110-118 (2012).Google Scholar
  26. 26.
    B. Danny Oude, “EEG-based emotion recognition. The influence of visual and auditory stimuli,” Emotion, 57, No. 7, 1798-1806 (2006).Google Scholar
  27. 27.
    P. L. Nunez, R. Srinivasan, A. F. Westdorp, et al., “EEG coherency. I. Statistics, reference electrode, volume conduction, Laplacians, cortical imaging, and interpretation at multiple scales,” Electroencephalogr. Clin. Neurophysiol., 103, No. 5, 499-515 (1997).CrossRefPubMedGoogle Scholar
  28. 28.
    R. Srinivasan, P. L. Nunez, and R. B. Silberstein, “Spatial filtering and neocortical dynamics: Estimates of EEG coherence,” IEEE Trans. Biomed. Engineer., 45, No. 7, 814-826 (1998).CrossRefGoogle Scholar
  29. 29.
    H. Pourghassem and S. Daneshvar, “A framework for medical image retrieval using merging-based classification with dependency probability-based relevance feedback,” Turk. J. Electr. Eng.. Comput. Sci., 21, No. 3, 882-896 (2013).Google Scholar
  30. 30.
    M. Nurmohamadi and H. Pourghassem, “Clavulanic acid production estimation based on color and structural features of Streptomyces clavuligerus bacteria using self-organizing map and genetic algorithm,” Comput. Methods Prog. Biomed., 114, No. 3, 337-348 (2014).CrossRefGoogle Scholar
  31. 31.
    S. Nasehi and H. Pourghassem, “Seizure detection algorithms based on analysis of EEG and ECG signals: A survey,” Neurophysiology, 44, No. 2, 174-186 (2012).Google Scholar
  32. 32.
    S. M. Zhou, J. Q. Gan, and F. Sepulveda, “Classifying mental tasks based on features of higher-order statistics from EEG signals in brain–computer interface,” Inform. Sci., 178, 1629-1640 (2008).CrossRefGoogle Scholar
  33. 33.
    M. Behnam and H. Pourghassem, “Optimal query-based relevance feedback in medical image retrieval using score fusion-based classification,” J. Digital Imag., 28, No. 2, 160-178 (2015).CrossRefGoogle Scholar
  34. 34.
    S. Momeni and H. Pourghassem, “An automatic fuzzy-based multi-temporal brain digital subtraction angiography image fusion algorithm using curvelet transform and content selection strategy,” J. Med. Syst., 38, No. 8, 1-16 (2014).CrossRefGoogle Scholar
  35. 35.
    R. Rastghalam and H. Pourghassem, “Breast cancer detection using MRF-based probable texture feature and decision-level fusion-based classification using HMM on thermography images,” Pattern Recogn., 51, No. 3, 176-186 (2016).CrossRefGoogle Scholar
  36. 36.
    L. Xu, A. Krzyzak, and C. Y. Suen, “Methods of combining multiple classifiers and their applications to handwriting recognition,” IEEE Trans. Syst., Man, Cybern., 22, 418-435 (1992).Google Scholar
  37. 37.
    L. I. Kuncheva, Combining Pattern Classifiers: Methods and Algorithms, Wiley Interscience (2004).Google Scholar
  38. 38.
    L. Lam and C. Y. Suen, “Optimal combinations of pattern classifiers,” Pattern Recogn. Lett., 16, 945-954 (1995).CrossRefGoogle Scholar
  39. 39.
    U. G. Mangai, S. Samanta, S. Das, and P. R. Chowdhury, “A survey of decision fusion and feature fusion strategies for pattern classification,” IETE Tech. Rev., 27, 293-307 (2010).CrossRefGoogle Scholar
  40. 40.
    J. V. Kittler, M. Hatef, R. P. W. Duin, and J. Matas, “On combining classifiers,” IEEE Trans. Pattern Anal. Mach. Intelligence, 20, No. 3, 226-239 (1998).CrossRefGoogle Scholar
  41. 41.
    L. Lam and C. Y. Suen, “Optimal combinations of pattern classifiers,” Pattern Recogn. Lett., 16, Nos. 1/3, 945-954 (1995).CrossRefGoogle Scholar
  42. 42.
    A. Tahmasebi and H. Pourghassem, “A novel intra-class distance-based signature identification algorithm using weighted gabor features and dynamic characteristics,” Arab. J. Sci. Eng.., 38, No. 11, 3019-3029 (2013).CrossRefGoogle Scholar
  43. 43.
    M. Behnam and H. Pourghassem, “Periodogram pattern feature-based seizure detection algorithm using optimized hybrid model of MLP and ant colony,” in: Proc. 23rd Iranian Conf. Electrical Engineer. (ICEE 2015), Tehran, Iran, May (2015), pp. 32-37.Google Scholar
  44. 44.
    M. J. Alhaddad, M. I. Kamel, H. M. Malibary, et al., “Diagnosis of autism by Fisher linear discriminant analysis FLDA via EEG,” Int. J. Biosci. Biotechnol., 4, No. 2, 45-54 (2012).Google Scholar

Copyright information

© Springer Science+Business Media New York 2017

Authors and Affiliations

  1. 1.Digital Processing and Machine Vision Research Center, Najafabad BranchIslamic Azad UniversityNajafabadIran
  2. 2.Department of Electrical Engineering, Najafabad BranchIslamic Azad UniversityNajafabadIran

Personalised recommendations