Skip to main content

Performance Metrics and Their Extraction Methods for Audio Rendered Mathematics

  • Conference paper
Computers Helping People with Special Needs (ICCHP 2014)

Abstract

We introduce and compare three approaches to calculate structure- and content-based performance metrics for user-based evaluation of math audio rendering systems: Syntax Tree alignment, Baseline Structure Tree alignment, and MathML Tree Edit Distance. While the first two require “manual” tree transformation and alignment of the mathematical expressions, the third obtains the metrics without human intervention using the minimum edit distance algorithm on the corresponding MathML representations. Our metrics are demonstrated in a pilot user study evaluating the Greek audio rendering rules of MathPlayer with 7 participants and 39 stimuli. We observed that the obtained results for the metrics are significantly correlated between all three approaches.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

Similar content being viewed by others

References

  1. Freitas, D., Kouroupetroglou, G.: Speech Technologies for Blind and Low Vision Persons. Technology and Disability 20, 135–156 (2008)

    Google Scholar 

  2. Archambault, D., Stoger, B., Fitzpatrick, D., Miesenberger, K.: Access to scientific content by visually impaired people. UPGRADE VIII(2), 1–14 (2007)

    Google Scholar 

  3. Bates, E., Fitzpatrick, D.: Spoken mathematics using prosody, earcons and spearcons. In: Miesenberger, K., Klaus, J., Zagler, W., Karshmer, A. (eds.) ICCHP 2010, Part II. LNCS, vol. 6180, pp. 407–414. Springer, Heidelberg (2010)

    Chapter  Google Scholar 

  4. Kouroupetroglou, G., Kacorri, H.: Deriving Accessible Science Books for the Blind Students of Physics. Proceedings of the American Institute of Physics 1203, 1308–1313 (2010)

    Google Scholar 

  5. Karshmer, A., Gupta, G., Pontelli, E., Miesenberger, K., Ammalai, N., Gopal, D., Batusic, M., Stöger, B., Palmer, B., Guo, H.: UMA: A System for Universal Mathematics Accessibility. In: Proceedings ASSETS 2004, the 6th Intern. ACM SIGACCESS Conference on Computers and Accessibility, Atlanta, Georgia, USA, October 18-20, vol. 196, p. 55. ACM (2004)

    Google Scholar 

  6. Tsonos, D., Kacorri, H., Kouroupetroglou, G.: A design-for-all approach towards multimodal accessibility of mathematics. Assistive Technology Research Series 25, 393–397 (2009)

    Google Scholar 

  7. Kacorri, H., Riga, P., Kouroupetroglou, G.: EAR-Math: Evaluation of Audio Rendered Mathematics. In: Stephanidis, C., Antona, M. (eds.) UAHCI 2014, Part II. LNCS, vol. 8514, pp. 111–120. Springer, Heidelberg (2014)

    Google Scholar 

  8. Soiffer, N.: A flexible design for accessible spoken math. In: Stephanidis, C. (ed.) UAHCI 2009, Part III. LNCS, vol. 5616, pp. 130–139. Springer, Heidelberg (2009)

    Chapter  Google Scholar 

  9. Stevens, R.D.: Principles for the design of auditory interfaces to present complex information to blind people. Doctoral dissertation, University of York (1996)

    Google Scholar 

  10. Wongkia, W., Naruedomkul, K., Cercone, N.: I-Math: an Intelligent Accessible Mathematics system for People with Visual Impairment. Computational Approaches to Assistive Technologies for People with Disabilities 253, 83–108 (2013)

    Google Scholar 

  11. Fitzpatrick, D.: Towards Accessible Technical Documents: Production of Speech and Braille Output from Formatted Documents. Doctoral dissertation, Dublin City University (1999)

    Google Scholar 

  12. Murphy, E., Bates, E., Fitzpatrick, D.: Designing auditory cues to enhance spoken mathematics for visually impaired users. In: Proceedings of the 12th International ACM SIGACCESS Conference on Computers and Accessibility, pp. 75–82 (2010)

    Google Scholar 

  13. Zanibbi, R., Blostein, D., Cordy, J.R.: Baseline structure analysis of handwritten mathematics notation. In: Proc. of the 6th Int. Conf. Document Analysis and Recognition, pp. 768–773. IEEE (2001)

    Google Scholar 

  14. Zhang, K., Shasha, D.: Simple fast algorithms for the editing distance between trees and related problems. SIAM Journal on Computing 18(6), 1245–1262 (1989)

    Article  MathSciNet  MATH  Google Scholar 

  15. Pawlik, M., Augsten, N.: RTED: A Robust Algorithm for the Tree Edit Distance. PVLDB 5(4), 334–345 (2011)

    Google Scholar 

  16. Raman, T.V.: Mathematics for computer generated spoken documents–ASTeR Demonstration, http://www.cs.cornell.edu/home/raman/aster/demo.html

  17. Acapela text-to-speech, http://www.acapela-group.com/

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2014 Springer International Publishing Switzerland

About this paper

Cite this paper

Kacorri, H., Riga, P., Kouroupetroglou, G. (2014). Performance Metrics and Their Extraction Methods for Audio Rendered Mathematics. In: Miesenberger, K., Fels, D., Archambault, D., Peňáz, P., Zagler, W. (eds) Computers Helping People with Special Needs. ICCHP 2014. Lecture Notes in Computer Science, vol 8547. Springer, Cham. https://doi.org/10.1007/978-3-319-08596-8_95

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-08596-8_95

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-08595-1

  • Online ISBN: 978-3-319-08596-8

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics