The Usability Perception Scale (UPscale): A Measure for Evaluating Feedback Displays

  • Beth Karlin
  • Rebecca Ford
Part of the Lecture Notes in Computer Science book series (LNCS, volume 8012)


This paper proposes and tests the Usability Perception Scale (UPscale), developed to evaluate the perceived usability of eco-feedback. This tool builds on previous system usability scales and includes sub-scales for ease of use and engagement. The scale was tested via an online survey of 1103 US residents. Factor analysis supported a two-factor solution, supporting subscales for ease of use and engagement. Reliability tests revealed high levels of internal consistency for the overall scale and both subscales. A test of criterion validity with behavioral intention found significant correlations with both subscales, suggesting that usability is a key mediator for behavior change. Finally, ANOVA results found differences between randomly assigned images, suggesting the scale has sufficient sensitivity for use in experimental research. Future research is suggested to test abbreviated versions as well as to further assess this scale with actual behavioral pilot studies.


evaluation scale energy feedback usability user experience 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Granade, H.C., Creyts, J., Derkach, A., Farese, P., Nyquist, S., Ostrowski, K.: Unlocking energy efficiency in the U.S. economy. Technical Report, McKinsey (2009)Google Scholar
  2. 2.
    Dietz, T., Gardner, G.T., Gilligan, J., Stern, P.C., Vandenbergh, M.P.: Household actions can provide a behavioral wedge to rapidly reduce US carbon emissions. Proceedings of the National Academy of Sciences 106, 18452–18456 (2009)CrossRefGoogle Scholar
  3. 3.
    Fischer, C.: Feedback on household electricity consumption: A tool for saving energy? Energy Efficiency 1, 79–104 (2008)CrossRefGoogle Scholar
  4. 4.
    Darby, S.: A Review for Defra of the literature on metering, billing, and direct displays.Technical Report, Environmental Change Institute (2006)Google Scholar
  5. 5.
    Darby, S.: Smart metering: what potential for householder engagement? Building Research & Information 38, 442–457 (2010)CrossRefGoogle Scholar
  6. 6.
    Ehrhardt-Martinez, K., Donnelly, K.A., Laitner, J.A.: Advanced metering initiatives and residential feedback programs: a meta-review for household electricity-saving opportunities. Technical report, ACEEE (2010)Google Scholar
  7. 7.
    Froehlich, J., Findlater, L., Landay, J.: The Design of Eco-Feedback Technology. In: Proc. CHI 2010, pp. 1999–2008. ACM Press (2010)Google Scholar
  8. 8.
    Karlin, B., Zinger, J.: Residential energy feedback: A meta-analysis and methodological review (manuscript submitted for publication)Google Scholar
  9. 9.
    Card, S.K., Moran, T.P., Newell, A.: The Psychology of Human-Computer Interaction. Lawrence Erlbaum Associates (1983)Google Scholar
  10. 10.
    Toomim, M., Kriplean, T., Pörtner, C., Landay, J.A.: Utility of human-computer interactions: Toward a science of preference measurement. In: Proc. CHI 2011, pp. 2275–2284. ACM Press (2011)Google Scholar
  11. 11.
    Davis, F.D.: Perceived usefulness, perceived ease of use, and user acceptance of information technology. MIS Quarterly, 319–340 (1989)Google Scholar
  12. 12.
    Kline, P.: Handbook of Psychological Testing. Routledge, London (2000)Google Scholar
  13. 13.
    Quesenbery, W.: What Does Usability Mean: Looking Beyond ‘Ease of Use’. In: Proceedings of the 48th Annual Conference, Society for Technical Communication (2001)Google Scholar
  14. 14.
    Lewis, J.R.: IBM computer usability satisfaction questionnaires: Psychometric evaluation and instructions for use. International Journal of Human-Computer Interaction 7, 57–78 (1995)CrossRefGoogle Scholar
  15. 15.
    Nielsen, J., Hackos, J.T.: Usability engineering. Academic Press, San Diego (1993)zbMATHGoogle Scholar
  16. 16.
    Chin, J.P., Diehl, V.A., Norman, K.L.: Development of an Instrument Measuring Human-Computer User Satisfaction Interface. In: Proc. CHI 1988, pp. 213–218. ACM Press (1988)Google Scholar
  17. 17.
    Brooke, J.: SUS - A quick and dirty usability scale. In: Jordan, Thomas, Weerdmeester, McClelland (eds.) Usability Evaluation in Industry, vol. 189, pp. 189–194 (1996)Google Scholar
  18. 18.
    Kirakowski, J., Corbett, M.: SUMI: The software usability measurement inventory. British Journal of Educational Technology 24, 210–212 (1993)CrossRefGoogle Scholar
  19. 19.
    Finstad, K.: The Usability Metric for User Experience. Interacting with Computers 22, 323–327 (2010)CrossRefGoogle Scholar
  20. 20.
    Bangor, A., Kortum, P.T., Miller, J.T.: An Empirical Evaluation of the System Usability Scale. International Journal of Human-Computer Interaction 24, 574–594 (2008)CrossRefGoogle Scholar
  21. 21.
    Lewis, J., Sauro, J.: The factor structure of the system usability scale. Human Centered Design, 94–103 (2009)Google Scholar
  22. 22.
    Borsci, S., Federici, S., Lauriola, M.: On the dimensionality of the System Usability Scale: a test of alternative measurement models. Cognitive Processing 10, 193–197 (2009)CrossRefGoogle Scholar
  23. 23.
    De Angeli, A., Sutcliffe, A., Hartmann, J.: Interaction, Usability and Aesthetics: What In-fluences Users’ Preferences? In: 8th ACM Conference on Designing Interactive Systems, pp. 271–280 (2006)Google Scholar
  24. 24.
    Chopra, A.: Modeling a green energy challenge after a blue button,
  25. 25.
    Karlin, B., Ford, R., Squiers, C.: Energy Feedback: A Review and Taxonomy of Products and Technologies (manuscript submitted for publication)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2013

Authors and Affiliations

  • Beth Karlin
    • 1
  • Rebecca Ford
    • 2
  1. 1.School of Social EcologyUniversity of California, IrvineIrvineUSA
  2. 2.Centre for SustainabilityUniversity of OtagoDunedinNew Zealand

Personalised recommendations