Performance Metrics and Their Extraction Methods for Audio Rendered Mathematics
- Cite this paper as:
- Kacorri H., Riga P., Kouroupetroglou G. (2014) Performance Metrics and Their Extraction Methods for Audio Rendered Mathematics. In: Miesenberger K., Fels D., Archambault D., Peňáz P., Zagler W. (eds) Computers Helping People with Special Needs. ICCHP 2014. Lecture Notes in Computer Science, vol 8547. Springer, Cham
We introduce and compare three approaches to calculate structure- and content-based performance metrics for user-based evaluation of math audio rendering systems: Syntax Tree alignment, Baseline Structure Tree alignment, and MathML Tree Edit Distance. While the first two require “manual” tree transformation and alignment of the mathematical expressions, the third obtains the metrics without human intervention using the minimum edit distance algorithm on the corresponding MathML representations. Our metrics are demonstrated in a pilot user study evaluating the Greek audio rendering rules of MathPlayer with 7 participants and 39 stimuli. We observed that the obtained results for the metrics are significantly correlated between all three approaches.
KeywordsMath Audio Rendering Metrics Accessibility MathML Usability
Unable to display preview. Download preview PDF.