Abstract
Subjective methods are widely used to determine whether audio and video quality in networked multimedia applications is sufficient. Recent findings suggest that, due to contextual factors, users often accept levels of media quality known to be below the threshold required for such tasks. Therefore, we propose the use of physiological methods to assess the user cost of different levels of media quality. Physiological responses (HR, GSR and BVP) to two levels of video quality (5 vs. 25 frames per second — fps) were measured in a study with 24 users. Results showed that there was a statistically significant effect of frame rate, in the direction that 5fps caused responses to indicate stress. However, only 16% of the users noticed the difference subjectively. We propose a 3-tier assessment method that combines task performance, user satisfaction and user cost to obtain a meaningful indication of the media quality required by users.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Anderson, A., Smallwood, L., MacDonald, R., Mullin, J., Fleming, A. & O’Malley, O. (2000), “Video Data and Video Links in Mediated Communication: What Do Users Value”, International Journal of Human-Computer Studies 52(1), 165–87.
Bouch, A. & Sasse, M. A. (1999), Network Quality of Service: What do Users Need, in Proceedings of the 4th International Distributed Conference.
Bouch, A., Watson, A. & Sasse, M. A. (1998), QUASS — A Tool for Measuring the Subjective Quality of Real-time Multimedia Audio and Video, inJ. May, J. Siddiqi & J. Wilkinson (eds.), Adjunct Proceedings of HCI’98, pp. 94–5.
Cacioppo, J. T. & Louis, G. T. (1990), “Inferring Psychological Significance from Physiological Signals”, American Psychologist 45(1), 16–28
Daly-Jones, O., Monk, A. & Watts, L. (1998), “Some Advantages of Videoconferencing Over High-quality Audio Conferencing: Fluency and Awareness of Attentional Focus”, International Journal of Human—Computer Studies 45, 21–58.
Edelberg, R. & Wright, D. J. (1962), “Two GSR Effector Organs and their Stimulus Specificity”. Paper Read at the Society for Psychophysiological Research.
Frijda, N. H. (1986), The Emotions, Chapter Physiology of Emotion, in Studies in Emotion and Social Interaction, Cambridge University Press, pp. 124–75.
Gili Manzanaro, J., Janez Escalada, L., Hemandez Lioreda, M. & Szymanski, M. (1991), Subjective Image Quality Assessment and Prediction in Digital Videocommunications, Technical Report COST 212 HUFIS Report.
Healey, J., Seger, J. & Picard, R. W. (1999), Quantifying Driver Stress: Developing a System for Collecting and Processing Biometric Signals in Natural Situations, Technical Report TR-483, Affective Computing Group, MIT. http://vismod.www.media.mit.edu/techreports/TR-483/index.html.
ITU (2000), “ITU-R BT.500–8 Methodology for the Subjective Assessment of the Quality of Television Pictures” http://www.itu.int/publications/itu-t/iturec.htm. Last accessed 2000.06.11.
Jones, B. L. & McManus, P. R. (1986), “Graphic Scaling of Qualitative Terms”, SMPTE Journal pp. 1166–71.
Kies, J. K., Williges, R. C. & Rosson, M. B. (1996), Controlled Laboratory Experimentation and Field Study Evaluation of Videoconferencing for Distance Learning Applications, Technical Report, Virginia Tech. http://www.hci.ise.vt.edu/ hcil/.
Kitawaki, N. & Nagabuchi, H. (1998), “Quality Assessment of Speech Coding and Speech Synthesis Systems”, IEEE Communications Magazine pp. 36–44.
Knoche, H., De Meer, H. G. & Kirsh, D. (1999), Utility Curves: Mean Opinion Scores Considered Biased, inS. Crowcroft, S. Bhatti & C. Diot (eds.), Proceedings of 7th International Workshop on Quality of Service, IEEE/IFIP, pp. 12–4.
Millard, N., Coe, T., Gardner, M., Gower, A., Hole, L. & Crowle, S. (1999), “The Future of Customer Contact” BT Technical Journal. http://www.bt.co.uk/bttj/vol18nol/today.htm.
Monk, A., McCarthy, J., Watts, L. & Daly-Jones, O. (1996), Measures of Process, inM. MacLeod & D. Murray (eds.), Evaluation for CSCW, Springer-Verlag, pp. 125–40.
Nardi, B., Kuchinsky, A., Whittaker, S., Leichner, R. & Schwarz, H. (1997), Video-as-data: Technical and Social Aspects of a Collaborative Multimedia Application, inK. Finn, A. Sellen & S. Wilbur (eds.), Video-mediated Communication, Lawrence Erlbaum Associates, pp. 487–518.
Nardi, B., Kuchinsky, A., Whittaker, S., Leichner, R. & Schwarz, H. (1997), Video-as-data: Technical and Social Aspects of a Collaborative Multimedia Application, inK. Finn, A. Sellen & S. Wilbur (eds.), Video-mediated Communication, Lawrence Erlbaum Associates, pp. 487–518.
Seyle, H. (1956), The Stress of Life, McGraw-Hill.
Short, J., Williams, E. & Christie, B. (1976), The Social Psychology of Telecommunications, John Wiley & Sons.
Tang, J. C. & Isaacs, E. A. (1993), “Why Do Users Like Video: Study of Multimedia Supported Collaboration”, Computer Supported Cooperative Work 1, 163–96.
Teunissen, K. (1996), “The Validity of CCIR Quality Indicators Along a Graphical Scale”, SMPTE Journalpp. 144–9.
Veinott, E. S., Olson, J. S., Olson, G. M. & Fu, X. (1997), Video matters! When Communication Ability is Stressed, Video Helps, inS. Pemberton (ed.), Proceedings of CHI’97: Human Factors in Computing Systems, ACM Press, pp. 315–6.
Vyzas, E. & Picard, R. W. (1999), Offline and Online Recognition of Emotion Expression from Physiological Data, Technical Report TR-488, Affective Computing Group, MIT. ftp://whitechapel.media.mit.edu/pub/tech-reports/TR-488/abstract.html.
Watson, A. & Sasse, M. A. (1997), Multimedia Conferencing via Multicast: Determining the Quality of Service required by the End User, inM. Gambari & I. Richardson (eds.), Proceedings of AVSPN ‘87 — International Workshop on Audio-visual Services over Packet Networks, pp. 189–94.
Watson, A. & Sasse, M. A. (1998), Measuring Perceived Quality of Speech and Video in Multimedia Conferencing Applications, inH. J. Zhang & L. Can (eds.), Proceedings of Multimedia’98, ACM Press, pp. 55–60.
Wilcott, R. C. (1967), “Arousal Sweating and Electrodermal Phenomena”, Psychological Bulletin 67, 58–72.
Wilson, F. & Descamps, P. T. (1996), “Should We Accept Anything Less than TV Quality: Visual Communication”. Paper presented at International Broadcasting Convention, 12th-16th September 1996.
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2000 Springer-Verlag London
About this paper
Cite this paper
Wilson, G.M., Sasse, M.A. (2000). Do Users Always Know What’s Good For Them? Utilising Physiological Responses to Assess Media Quality. In: McDonald, S., Waern, Y., Cockton, G. (eds) People and Computers XIV — Usability or Else!. Springer, London. https://doi.org/10.1007/978-1-4471-0515-2_22
Download citation
DOI: https://doi.org/10.1007/978-1-4471-0515-2_22
Publisher Name: Springer, London
Print ISBN: 978-1-85233-318-8
Online ISBN: 978-1-4471-0515-2
eBook Packages: Springer Book Archive