EAR-Math: Evaluation of Audio Rendered Mathematics

  • Hernisa Kacorri
  • Paraskevi Riga
  • Georgios Kouroupetroglou
Part of the Lecture Notes in Computer Science book series (LNCS, volume 8514)


Audio rendering of mathematical expressions has accessibility benefits for people with visual impairment. Seeking a systematic way to measure participants’ perception of the rendered formulae with audio cues, we investigate the design of performance metrics to capture the distance between reference and perceived math expressions. We propose EAR-Math, a methodological approach for user-based evaluation of math rendering against a baseline. EAR-Math measures systems’ performance using three fine-grained error rates based on the structural elements, arithmetic operators, numbers and identifiers in a formula. The proposed methodology and metrics were successfully applied in a pilot study, where 5 sighted and 2 blind participants evaluated 39 stimuli rendered by MathPlayer in Greek. In the obtained results, we observed that structural elements had the highest mean and variance of errors, which improved from 18% in the first attempt to 10% and 7% in two following attempts.


mathematics audio rendering visually impaired blind evaluation user study 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    World Health Organization. Fact Sheet 282: Visual Impairment and Blindness (2013),
  2. 2.
    Dick, T., Kubiak, E.: Issues and aids for teaching mathematics to the blind. The Mathematics Teacher 90(5), 344–349 (1997)Google Scholar
  3. 3.
    Freitas, D., Kouroupetroglou, G.: Speech Technologies for Blind and Low Vision Persons. Technology and Disability 20, 135–156 (2008)Google Scholar
  4. 4.
    Chang, L.A., White, C.M., Abrahamson, L.: Handbook for spoken mathematics. Lawrence Livermore National Laboratory (1983)Google Scholar
  5. 5.
    Nemeth, A.: Tips for Reading Math Out loud to Blind Students,
  6. 6.
    Edwards, A.D., McCartney, H., Fogarolo, F.: Lambda: a multimodal approach to making mathematics accessible to blind students. In: Proceedings of the 8th International ACM SIGACCESS Conference on Computers and Accessibility, pp. 48–54 (2006)Google Scholar
  7. 7.
    Raman, T.V.: ASTER-Towards modality-independent electronic documents. In: Electronic Multimedia Publishing, pp. 53-63, Springer US (1998)Google Scholar
  8. 8.
    Soiffer, N.: A flexible design for accessible spoken math. In: Stephanidis, C. (ed.) UAHCI 2009, Part III. LNCS, vol. 5616, pp. 130–139. Springer, Heidelberg (2009)CrossRefGoogle Scholar
  9. 9.
    Stevens, R.D.: Principles for the design of auditory interfaces to present complex information to blind people. Doctoral dissertation, University of York (1996)Google Scholar
  10. 10.
    Yamaguchi, K., Komada, T., Kawane, F., Suzuki, M.: New features in math accessibility with infty software. In: Miesenberger, K., Klaus, J., Zagler, W.L., Karshmer, A.I. (eds.) ICCHP 2008. LNCS, vol. 5105, pp. 892–899. Springer, Heidelberg (2008)CrossRefGoogle Scholar
  11. 11.
    Bates, E., Fitzpatrick, D.: Spoken mathematics using prosody, earcons and spearcons. In: Miesenberger, K., Klaus, J., Zagler, W., Karshmer, A. (eds.) ICCHP 2010, Part II. LNCS, vol. 6180, pp. 407–414. Springer, Heidelberg (2010)CrossRefGoogle Scholar
  12. 12.
    Brewster, S.A.: Using non-speech sound to overcome information overload. Displays 17(3), 179–189 (1997)CrossRefGoogle Scholar
  13. 13.
    Murphy, E., Bates, E., Fitzpatrick, D.: Designing auditory cues to enhance spoken mathematics for visually impaired users. In: Proceedings of the 12th International ACM SIGACCESS Conference on Computers and Accessibility, pp. 75–82 (2010)Google Scholar
  14. 14.
    Kouroupetroglou, G., Kacorri, H.: Deriving Accessible Science Books for the Blind Students of Physics. Proceedings of the American Institute of Physics 1203, 1308–1313 (2010)Google Scholar
  15. 15.
    Tsonos, D., Kacorri, H., Kouroupetroglou, G.: A design-for-all approach towards multimodal accessibility of mathematics. Assistive Technology Research Series 25, 393–397 (2009)Google Scholar
  16. 16.
    Fitzpatrick, D.: Towards Accessible Technical Documents: Production of Speech and Braille Output from Formatted Documents. Doctoral dissertation, Dublin City University (1999)Google Scholar
  17. 17.
    Gellenbeck, E., Stefik, A.: Evaluating prosodic cues as a means to disambiguate algebraic expressions: an empirical study. In: Proceedings of the 11th International ACM SIGACCESS Conference on Computers and Accessibility, pp. 139–146 (2009)Google Scholar
  18. 18.
    Wongkia, W., Naruedomkul, K., Cercone, N.: I-Math: an Intelligent Accessible Mathematics system for People with Visual Impairment. Computational Approaches to Assistive Technologies for People with Disabilities 253, 83–108 (2013)Google Scholar
  19. 19.
    Raman, T.V.: Mathematics for computer generated spoken documents - ASTeR Demonstration,
  20. 20.
    Acapela text-to-speech,
  21. 21.
    Kouroupetroglou, G., Florias, E.: Greek Braille Scientific Notation – Application in Information Systems for the Blind. Education and Rehabilitation Center for the Blind, Athens (2003) ISBN 960-87918-0-4Google Scholar
  22. 22.
    Nemeth, A.: The Nemeth Braille code for mathematics and science notation: 1972 revision. Produced in braille for the Library of Congress, National Library Service for the Blind and Physically Handicapped by the American Printing House for the Blind (1972)Google Scholar
  23. 23.
    Kacorri, H.: Audio Rendering Rules for Mathematical MathML Expressions in Greek, Diploma Thesis, University of Athens (2006)Google Scholar
  24. 24.
    Ferreira, H., Freitas, D.: Audio rendering of mathematical formulae using MathML and AudioMath. In: Stary, C., Stephanidis, C. (eds.) UI4ALL 2004. LNCS, vol. 3196, pp. 391–399. Springer, Heidelberg (2004)CrossRefGoogle Scholar

Copyright information

© Springer International Publishing Switzerland 2014

Authors and Affiliations

  • Hernisa Kacorri
    • 1
    • 2
  • Paraskevi Riga
    • 1
  • Georgios Kouroupetroglou
    • 1
  1. 1.Department of Informatics and TelecommunicationsNational and Kapodistrian University of AthensAthensGreece
  2. 2.Doctoral Program in Computer Science, The Graduate CenterCity University of New York (CUNY)New YorkUSA

Personalised recommendations