An Evaluation Methodology of Math-to-Speech in Non-English DAISY Digital Talking Books

  • Paraskevi Riga
  • Georgios Kouroupetroglou
  • Polyxeni-Parthena Ioannidou
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 9758)


The DAISY 3 MathML Modular Extension allows all of the features of a Digital Talking Book to work for math, just as they do for literary text. But this extension does not specify details about advanced MathML players on the localization (i.e. support of a specific native language), support of multilingual mathematical or textual content, cultural differences or user preferences. In this work we present the methodology, we have developed to evaluate in a systematic way the correctness of the Math-to-Speech rendering by investigating specific steps during the production and rendering phases for non-English DAISY Digital Talking Math Books. We define four types of errors in the math expressions: deletions (D), insertions (I), substitutions (S) and translations (T). More-over, we propose an appropriate corpus of mathematical expressions that facilitates the evaluation of the proposed methodology. Then, we have applied the above in the case of the Greek language, a not widespread inflectional natural language. The results of the evaluation for the Greek language and the Math-Player working with the ReadHear player are for each category of math expressions in the whole corpus: trigonometry = 2D, fractions = 3D, matrices = 18T & 4D, integrals = 10T, 12S & 4D, limits = 2T, 12S & 4D, powers-indicators = 8T, 4S & 1D and sets = 9T, 1S, 5D & 3I.


DAISY Digital talking books Math-to-Speech MathML Accessible math 



This research has been co-financed by the European Union (European Social Fund – ESF) and Greek national funds through the Operational Program “Education and Lifelong Learning” of the National Strategic Reference Framework (NSRF) under the Research Funding Project: “THALIS-University of Macedonia- KAIKOS: Audio and Tactile Access to Knowledge for Individuals with Visual Impairments”, MIS 380442.


  1. 1.
    DAISY Consortium.
  2. 2.
    Leas, D., Persoon, E., Soiffer, N., Zacherle, M.: Daisy 3: a standard for accessible multimedia books. IEEE Multimedia 4, 28–37 (2008)CrossRefGoogle Scholar
  3. 3.
    Ausbrooks, R., Buswell, S., Carlisle, D., Dalmas, S., Devitt, S., Diaz, A., Miner, R.: Mathematical Markup Language (MathML) version 2.0. W3C Recommendation. World Wide Web Consortium (2003)Google Scholar
  4. 4.
    ANSI/NISO 2008. Z39.83-2008 NISO Circulation Interchange Protocol. ISSN: 1041-5653, ISBN: 978-1-880124-97-0. NISO Press, Bethesda. Accessed 24 Mar 2016
  5. 5.
    Yamaguchi, K., Suzuki, M.: On necessity of a new method to read out math contents properly in DAISY. In: Miesenberger, K., Klaus, J., Zagler, W., Karshmer, A. (eds.) ICCHP 2010, Part II. LNCS, vol. 6180, pp. 415–422. Springer, Heidelberg (2010)CrossRefGoogle Scholar
  6. 6.
    Ferreira, H., Freitas, D.: AudioMath: using MathML for speaking mathematics. In: XATA 2005 (2005)Google Scholar
  7. 7.
    Stevens, R., Edwards, A., Harling, P.: Access to mathematics for visually disabled students through multimodal interaction. Hum.-Comput. Interact. 12, 47–92 (1997)CrossRefGoogle Scholar
  8. 8.
    Isaacson, M.D., Srinivasan, S., Lloyd, L.: Development of an algorithm for improving quality and information processing capacity of MathSpeak synthetic speech renderings. J. Disabil. Rehabil. Assistive Technol. 5, 83–93 (2010)CrossRefGoogle Scholar
  9. 9.
    Isaacson, M.D., Lloyd, L.L., Schleppenbach, D.: Reducing multiple interpretations of mathematical expressions with MathSpeak. In: 1st International Conference on Technology-Based Learning with Disability, pp. 1–10. Wright State University, Dayton, Ohio (2007)Google Scholar
  10. 10.
    Soiffer, N.: MathPlayer v2. 1: web-based math accessibility. In: Proceedings of the 9th International ACM SIGACCESS Conference on Computers and Accessibility, pp. 257–258. ACM Press, New York (2007)Google Scholar
  11. 11.
  12. 12.
    Strobbe, C., Engelen, J., Spiewak, V.: Generating DAISY books from In: Miesenberger, K., Klaus, J., Zagler, W., Karshmer, A. (eds.) ICCHP 2010, Part 1. LNCS, vol. 6179, pp. 5–11. Springer, Heidelberg (2010)CrossRefGoogle Scholar
  13. 13.
    Archambault, D., Spiewak, V.: Save-as-Daisy extension. In: Emiliani, P.L., et al. (eds.) Assistive Technology Research Series AAATE 2009, vol. 25, pp. 212–216. IOS Press, Amsterdam (2009)Google Scholar
  14. 14.
  15. 15.
  16. 16.
    Yamaguchi, K., Suzuki, M.: Accessible authoring tool for DAISY ranging from mathematics to others. In: Miesenberger, K., Karshmer, A., Penaz, P., Zagler, W. (eds.) ICCHP 2012, Part I. LNCS, vol. 7382, pp. 130–137. Springer, Heidelberg (2012)CrossRefGoogle Scholar
  17. 17.
    Davydov, M.V., Lozytskyy, O., Nikolskyy, Y.: Method of Automatic Formulas Reading in Ukrainian. Lviv Polytechnic National University MES of Ukraine, Ukraine (2013)Google Scholar
  18. 18.
    Bernier, A., Burger, D.: AcceSciTech: a global approach to make scientific and technical literature accessible. In: Stephanidis, C., Antona, M. (eds.) UAHCI 2013, Part III. LNCS, vol. 8011, pp. 283–290. Springer, Heidelberg (2013)Google Scholar
  19. 19.
    Kacorri, H., Riga, P., Kouroupetroglou, G.: EAR-math: evaluation of audio rendered mathematics. In: Stephanidis, C., Antona, M. (eds.) UAHCI 2014, Part II. LNCS, vol. 8514, pp. 111–120. Springer, Heidelberg (2014)Google Scholar
  20. 20.
    Raman, T.V.: ASTER-towards modality-independent electronic documents. Multimedia Tools Appl. 6, 141–151 (1998)CrossRefGoogle Scholar
  21. 21.
    Fitzpatrick, D.: Towards Accessible Technical Documents: Production of Speech and Braille Output from Formatted Documents. Doctoral dissertation, Dublin City University (1999)Google Scholar
  22. 22.
    Spiegel, M., Lipschutz, S., Liu, J.: Mathematical Handbook of Formulas and Tables, 3rd edn. McGraw-Hill, New York (1968)Google Scholar
  23. 23.
    Bradji, A., Fuhrmann, J.: Some error estimates in finite volume method for parabolic equations. In: Eymard, R., H´erard, J.-M. (eds.) Finite Volumes for Complex Applications V, Proceedings of the 5th International Symposium on Finite Volume for Complex Applications, pp. 233–240. Wiley, Chichester (2008)Google Scholar
  24. 24.
    Zhang, X., Zhou, Y.: Periodic solutions of non-autonomous second order Hamiltonian systems. J. Math. Anal. Appl. 345, 929–933 (2008)MathSciNetCrossRefzbMATHGoogle Scholar
  25. 25.
    Hung, N.M., Long, H.V., Son, N.T.K.: On the asymptotics of solutions to the second initial boundary value problem for Schrödinger systems in domains with conical points. J. Appl. Math. 58, 63–91 (2013)CrossRefzbMATHGoogle Scholar
  26. 26.
    Yao, Q.: Positive solutions for eigenvalue problems of fourth-order elastic beam equations. J. Appl. Math. Lett. 17, 237–243 (2004)MathSciNetCrossRefzbMATHGoogle Scholar
  27. 27.
    Kubáček, L.: Seemingly unrelated regression models. Appl. Math. 58, 111–123 (2013)MathSciNetCrossRefzbMATHGoogle Scholar
  28. 28.
    Argirakis, D., Vourganas, P., Mentis, K., Tsikopoulou, S., Chrisovergis, M.: Mathematics 3rd Class of Gymnasium, pp. 38–39.
  29. 29.
    Andreadakis, S., Katsargiris, V., Papastavridis, S., Polizos, G., Sverkos, A.: Mathematics 2nd Class of Lyceum, pp. 97–98.
  30. 30.
  31. 31.
    Polewczac, J.: LaTeX, MathML, and TEX4HT: Tools for creating accessible documents. Mathematics, CSUN, Northridge (2005)Google Scholar
  32. 32.
  33. 33.
    Kacorri, H., Riga, P., Kouroupetroglou, G.: Performance metrics and their extraction methods for audio rendered mathematics. In: Miesenberger, K., Fels, D., Archambault, D., Peňáz, P., Zagler, W. (eds.) ICCHP 2014, Part I. LNCS, vol. 8547, pp. 614–621. Springer, Heidelberg (2014)CrossRefGoogle Scholar

Copyright information

© Springer International Publishing Switzerland 2016

Authors and Affiliations

  • Paraskevi Riga
    • 1
    • 2
  • Georgios Kouroupetroglou
    • 1
    • 2
  • Polyxeni-Parthena Ioannidou
    • 1
  1. 1.Department of Informatics and TelecommunicationsNational and Kapodistrian University of AthensAthensGreece
  2. 2.Accessibility Unit for Students with DisabilitiesNational and Kapodistrian University of AthensAthensGreece

Personalised recommendations