Skip to main content

Lecture 12 Methodology for Information Systems: System Design, Usability, and Evaluation

  • Chapter
  • First Online:
Biomedical Informatics
  • 2277 Accesses

Abstract

At the end of this last lecture, you

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 54.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  • Alagoez F, Valdez AC, Wilkowska W, Ziefle M, Dorner S, Holzinger A (2010) From cloud computing to mobile Internet, from user focus to culture and hedonism: the crucible of mobile health care and Wellness applications. 5th International conference on pervasive computing and applications (ICPCA). IEEE, pp 38–45

    Google Scholar 

  • Beck K (1999) Extreme programming explained: embracing change. Addison Wesley, Boston, MA

    Google Scholar 

  • Bevan N (1995) Usability is quality of use. In: Anzai Y, Ogawa K, Mori H (eds) 6th International conference on human computer interaction. Elsevier, Tokyo

    Google Scholar 

  • Bevan N (1997) Quality in use: incorporating human factors into the software engineering lifecycle. 3rd International software engineering standards symposium (ISESS ‘97), Walnut Creek, CA, 01–06 June 1997, pp 169–179

    Google Scholar 

  • Bevan N (2009) Extending quality in use to provide a framework for usability measurement. In: Kurosu M (ed) Human centered design HCII 2009, vol 5619, Lecture notes in computer science (LNCS). Springer, Berlin, pp 13–22

    Chapter  Google Scholar 

  • Breitwieser C, Terbu O, Holzinger A, Brunner C, Lindstaedt S, Müller-Putz G (2013) iScope—viewing biosignals on mobile devices. In: Zu Q, Hu B, Elçi A (eds) Pervasive computing and the networked world, vol 7719, Lecture notes in computer science (LNCS). Springer, Berlin, pp 50–56

    Chapter  Google Scholar 

  • Brooke J (1996) SUS: a “quick and dirty” usability scale. In: Jordan PW, Thomas B, Weerdmeester BA, Mcclelland AL (eds) Usability evaluation in industry. Taylor and Francis, London

    Google Scholar 

  • Brown S, Holzinger A (2008) Low cost prototyping: Part 1, or how to produce better ideas faster by getting user reactions early and often. In: Abuelmaatti O, England D (eds) Proceedings of HCI 2008. John Moores University, British Computer Society, Liverpool, UK, pp 213–214

    Google Scholar 

  • Buschmann F (2010) Learning from failure, Part 2: featuritis, performitis, and other diseases. IEEE Softw 27(1):10–11

    Article  Google Scholar 

  • Catelani M, Ciani L, Diciotti S, Dori F, Giuntini M (2011) ISO 14971 as a methodological tool in the validation process of a RIS-PACS system. IEEE International workshop on medical measurements and applications proceedings (MeMeA) 2011. IEEE, pp 408–412

    Google Scholar 

  • Cavallin H, Martin WM, Heylighen A (2007) How relative absolute can be: SUMI and the impact of the nature of the task in measuring perceived software usability. AI & Soc 22(2):227–235

    Article  Google Scholar 

  • Challis BH, Krane RV (1988) Mood induction and the priming of semantic memory in a lexical decision task: asymmetric effects of elation and depression. Bull Psychonomic Soc 26(4):309–312

    Article  Google Scholar 

  • Cleary BA (1995) Supporting empowerment with Deming’s PDSA cycle. Empower Organ 3(2):34–39

    Article  Google Scholar 

  • Cosgriff P (1994) Quality assurance of medical software. J Med Eng Technol 18(1):1–10

    Article  Google Scholar 

  • Davis FD (1989) Perceived usefulness, perceived ease of use, and user acceptance of information technology. MIS Q 13(3):319–339

    Article  Google Scholar 

  • Davis FD (1993) User acceptance of information technology: system characteristics, user perceptions and behavioral impacts. Int J Man Mach Stud 38(3):475–487

    Article  Google Scholar 

  • Davis W, Rahman MA, Smith LJ, Burns A, Senecal L, Mcarthur D, Halpern JA, Perlmutter A, Sickels W, Wagner W (1995) Properties of human affect induced by static color slides (IAPS): dimensional, categorical and electromyographic analysis. Biol Psychol 41(3):229–253

    Article  Google Scholar 

  • Deming WE (1994) The new economics. MIT Press, Cambridge, MA

    Google Scholar 

  • Duncker K (1945) On problem-solving. In: Dashiell JF (ed) Psychological monographs of the American Psychological Association, vol 58. APA, Washington, DC, pp 1–114

    Google Scholar 

  • Earthy J, Jones BS, Bevan N (2001) The improvement of human-centred processes—facing the challenge and reaping the benefit of ISO 13407. Int J Hum Comput Stud 55(4):553–585

    Article  MATH  Google Scholar 

  • Ekman P, Friesan WV (1982) Felt, false, and miserable smiles. J Nonverbal Behav 6(4):238–252

    Article  Google Scholar 

  • Fishbein M, Ajzen I (1975) Belief, attitude, intention and behavior: an introduction to theory and research. Addison-Wesley, Reading, MA

    Google Scholar 

  • Helander MG, Khalid HM (2006) Affective and pleasurable design. In: Salvendy G (ed) Handbook of human factors and ergonomics, 3rd edn. Wiley, Hoboken, NJ

    Google Scholar 

  • Holzinger A (2002) User-centered interface design for disabled and elderly people: first experiences with designing a patient communication system (PACOSY). In: Miesenberger K, Klaus J, Zagler W (eds) 8th International conference on computer helping people with special needs, ICCHP 2002, vol 2398, Lecture notes in computer science (LNCS). Springer, Berlin, pp 34–41

    Google Scholar 

  • Holzinger A (2003) Experiences with user centered development (UCD) for the front end of the virtual medical campus Graz. In: Jacko JA, Stephanidis C (eds) Human-computer interaction, theory and practice. Lawrence Erlbaum, Mahwah, NJ, pp 123–127

    Google Scholar 

  • Holzinger A (2004) Application of rapid prototyping to the user interface development for a virtual medical campus. IEEE Softw 21(1):92–99

    Article  Google Scholar 

  • Holzinger A (2005) Usability engineering methods for software developers. Commun ACM 48(1):71–74

    Article  Google Scholar 

  • Holzinger A (2010) Process guide for students for interdisciplinary work in computer science/informatics, 2nd edn. BoD, Norderstedt

    Google Scholar 

  • Holzinger A (2011) Successful management of research and development. BoD, Norderstedt

    Google Scholar 

  • Holzinger A, Brown S (2008) Low cost prototyping: Part 2, or how to apply the thinking-aloud method efficiently. In: Abuelmaatti O, England D (eds) Proceedings of HCI 2008. John Moores University, British Computer Society, Liverpool, UK, pp 217–218

    Google Scholar 

  • Holzinger A, Bruschi M, Eder W (2013) On interactive data visualization of psychological low-cost-sensor data with focus on mental stress. In: Cuzzocrea A, Kittl C, Simos DE, Weippl E, Xu L (eds) Multidisciplinary research and practice for information systems. Springer lecture notes in computer science LNCS 8127. Springer, Heidelberg, pp 469–480

    Google Scholar 

  • Holzinger A, Dorner S, Födinger M, Valdez A, Ziefle M (2010) Chances of increasing youth health awareness through mobile wellness applications. In: Leitner G, Hitz M, Holzinger A (eds) HCI in work and learning, life and leisure, vol 6389, Lecture notes in computer science (LNCS). Springer, Berlin, pp 71–81

    Chapter  Google Scholar 

  • Holzinger A, Errath M, Searle G, Thurnher B, Slany W (2005) From extreme programming and usability engineering to extreme usability in software engineering education. 29th International annual IEEE computer software and applications conference (IEEE COMPSAC 2005), Edinburgh (UK). IEEE, pp. 169–172

    Google Scholar 

  • Holzinger A, Geierhofer R, Ackerl S, Searle G (2005b) CARDIAC@VIEW: the user centered development of a new medical image viewer. In: Zara J, Sloup J (eds) Central European multimedia and virtual reality conference (available in eurographics library). Czech Technical University (CTU), Prague, pp 63–68

    Google Scholar 

  • Holzinger A, Kosec P, Schwantzer G, Debevc M, Hofmann-Wellenhof R, Frühauf J (2011a) Design and development of a mobile computer application to reengineer workflows in the hospital and the methodology to evaluate its effectiveness. J Biomed Inform 44(6):968–977

    Article  Google Scholar 

  • Holzinger A, Leitner H (2005) Lessons from real-life usability engineering in hospital: from software usability to total workplace usability. In: Holzinger A, Weidmann K-H (eds) Empowering software quality: how can usability engineering reach these goals? Austrian Computer Society, Vienna, pp 153–160

    Google Scholar 

  • Holzinger A, Searle G, Kleinberger T, Seffah A, Javahery H (2008) Investigating usability metrics for the design and development of applications for the elderly. In: Miesenberger K, Klaus J, Zagler W, Karshmer A (eds) 11th International conference on computers helping people with special needs, vol 5105, Lecture notes in computer science (LNCS). Springer, Heidelberg, pp 98–105

    Chapter  Google Scholar 

  • Holzinger A, Searle G, Wernbacher M (2011b) The effect of previous exposure to technology (PET) on acceptance and its importance in usability engineering. Univers Access Inform Soc Int J 10(3):245–260

    Article  Google Scholar 

  • Holzinger A, Slany W (2006) XP + UE - > XU Praktische Erfahrungen mit eXtreme Usability. Informatik Spektrum 29(2):91–97

    Article  Google Scholar 

  • Holzinger A, Stickel C, Fassold M, Ebner M (2009) Seeing the system through the end users’ eyes: shadow expert technique for evaluating the consistency of a learning management system. In: Holzinger A, Miesenberger K (eds) HCI and usability for e-inclusion, vol 5889, Lecture notes in computer science (LNCS). Springer, Berlin, pp 178–192

    Chapter  Google Scholar 

  • Holzinger A, Treitler P, Slany W (2012) Making apps useable on multiple different mobile platforms: on interoperability for business application development on smartphones. In: Quirchmayr G, Basl J, You I, Xu L, Weippl E (eds) Multidisciplinary research and practice for information systems, vol 7465, Lecture notes in computer science (LNCS). Springer, Berlin, pp 176–189

    Chapter  Google Scholar 

  • Holzinger A, Wascher I, Steinmann C (2003) Design and development of a LO-editor for the virtual medical campus Graz. In: Bode A, Desel J, Rathmayer S, Wessner M (eds) Lecture notes in informatics (LNI), volume P-37, DeLFI 2003. Köllen, Bonn, pp 440–449

    Google Scholar 

  • Hussain Z, Slany W, Holzinger A (2009a) Current state of agile user-centered design: a survey. HCI and usability for e-inclusion, USAB 2009, vol 5889, Lecture notes in computer science (LNCS). Springer, Berlin, pp 416–427

    Google Scholar 

  • Hussain Z, Slany W, Holzinger A (2009b) Investigating agile user-centered design in practice: a grounded theory perspective. HCI and usability for e-inclusion, USAB 2009, vol 5889, Lecture notes in computer science, LNCS. Springer, Berlin, pp 279–289

    Google Scholar 

  • Izard CE (1979) Emotions in personality and psychopathology. Plenum, Oxford

    Book  Google Scholar 

  • Jordan PW (2000) Inclusive design: an holistic approach. Proceedings of the human factors and ergonomics society annual meeting, SAGE Publications, pp 917–920

    Google Scholar 

  • Kirakowski J, Corbett M (1993) SUMI: the software usability measurement inventory. Br J Educ Technol 24(3):210–212

    Article  Google Scholar 

  • Kosec P, Debevc M, Holzinger A (2009) Towards equal opportunities in computer engineering education: design, development and evaluation of video-based e-lectures. Int J Eng Educ 25(4):763–771

    Google Scholar 

  • Larson R, Csikszentmihalyi M (1983) The experience sampling method. New Dir Meth Soc Behav Sci 15:41–56

    Google Scholar 

  • Larsen RJ, Ketelaar T (1991) Personality and susceptibility to positive and negative emotional states. J Pers Soc Psychol 61(1):132

    Article  Google Scholar 

  • Lopatovska I, Arapakis I (2011) Theories, methods and current research on emotions in library and information science, information retrieval and human–computer interaction. Inf Process Manag 47(4):575–592

    Article  Google Scholar 

  • Maslow AH, Frager R, Fadiman J (1970) Motivation and personality. Harper & Row, New York

    Google Scholar 

  • McCleary RA (1950) The nature of the galvanic skin response. Psychol Bull 47(2):97–117

    Article  Google Scholar 

  • Melas CD, Zampetakis LA, Dimopoulou A, Moustakis V (2011) Modeling the acceptance of clinical information systems among hospital medical staff: an extended TAM model. J Biomed Inform 44(4):553–564

    Article  Google Scholar 

  • Morris MG, Turner JM (2001) Assessing users’ subjective quality of experience with the world wide web: an exploratory examination of temporal changes in technology acceptance. Int J Hum Comput Stud 54(6):877–901

    Article  MATH  Google Scholar 

  • Nagamachi M (2001) Kansei engineering: a powerful ergonomic technology for product development. In: Helander MG, Khalid HM, Tham MP (eds) Proceedings of the international conference of affective human factors design, ASEAN Academic Press, London, pp 9–14

    Google Scholar 

  • Neuhaus C, Polze A, Chowdhuryy MMR (2011) Survey on healthcare IT systems: standards, regulations and security (Technical report). Hasso-Plattner-Institute for Software Engineering, Potsdam

    Google Scholar 

  • Niedenthal PM, Setterlund MB (1994) Emotion congruence in perception. Pers Soc Psychol Bull 20(4):401–411

    Article  Google Scholar 

  • Nisbett RE, Wilson TD (1977) Telling more than we can know: verbal reports on mental processes. Psychol Rev 84(3):231–259

    Article  Google Scholar 

  • Novak J, Ziegler J, Hoppe U, Holzinger A, Heintze C, Böckle M (2012) Mobile Anwendungen für Medizin und Gesundheit. In: Reiterer H, Deussen O (eds) Mensch & computer workshopband: interaktiv informiert—allgegenwärtig und allumfassend!? Oldenbourg, München, pp 227–230

    Google Scholar 

  • Nowlis DP, Greenberg N (1979) Empirical description of effects of exercise on mood. Percept Mot Skills 49(3):1001–1002

    Article  Google Scholar 

  • Peischl B, Ferk M, Holzinger A (2013) On the success factors for mobile data acquisition in healthcare. Human aspects in mobile apps engineering at the British HCI ‘13. Brunel University, British Computer Society, London

    Google Scholar 

  • Picard RW (2000) Perceptual user interfaces: affective perception. Comm ACM 43(3):50–51

    Article  Google Scholar 

  • Seffah A, Donyaee M, Kline RB, Padda HK (2006) Usability measurement and metrics: a consolidated model. Softw Qual J 14(2):159–178

    Article  Google Scholar 

  • Seffah A, Kececi N, Donyaee M (2001) QUIM: a framework for quantifying usability metrics in software quality models. Second Asia-Pacific conference on quality software (APAQS‘01), Hong Kong, 10–11 Dec 2001, pp 311–318.

    Google Scholar 

  • Shackel B (1991) Usability—context, framework, definition, design and evaluation. In: Shackel B, Richardson SJ (eds) Human factors for informatics usability. Cambridge University Press, New York, pp 21–37

    Google Scholar 

  • Thimbleby H (2007) User-centered methods are insufficient for safety critical systems. In: Holzinger A (ed) HCI and usability for medicine and health care: third symposium of the workgroup human-computer interaction and usability engineering of the Austrian computer society, USAB 2007, vol 4799, Lecture notes in computer science (LNCS). Springer, Berlin, pp 1–20

    Chapter  Google Scholar 

  • Van Der Sluis F, Van Den Broek EL, Van Dijk B (2010) Information Retrieval eXperience (IRX): towards a human-centered personalized model of relevance. 2010 IEEE/WIC/ACM international conference on web intelligence and intelligent agent technology (WI-IAT), 31 Aug 2010–3 Sept 2010, pp 322–325

    Google Scholar 

  • Veer GCVD, Welie MV (2004) DUTCH: designing for users and tasks from concepts to handles. In: Diaper D, Stanton N (eds) The handbook of task analysis for human-computer interaction. Lawrence Erlbaum, Mahwah, NJ, pp 155–173

    Google Scholar 

  • Warr P (1999) Logical and judgmental moderators of the criterion-related validity of personality scales. J Occup Organ Psychol 72(2):187–204

    Article  Google Scholar 

  • Watson D, Clark LA, Tellegen A (1988) Development and validation of brief measures of positive and negative affect: the PANAS scales. J Pers Soc Psychol 54(6):1063

    Article  Google Scholar 

  • Westerink JH, Van Den Broek EL, Schut MH, Van Herk J, Tuinenbreijer K (2008) Computing emotion awareness through galvanic skin response and facial electromyography. Probing experience. Springer, Dordrecht, pp 149–162

    Google Scholar 

  • Wiklund ME, Wilcox SB (2005) Designing usability into medical products. Taylor & Francis, Boca Raton, FL

    Book  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

1 Supplementary Materials

Below is the link to the electronic supplementary material.

12_LV444_152_SYSTEM_DESIGN_USABILITY_EVALUATION_2013_14_lowres.pdf (PDF 3.66 MB)

Rights and permissions

Reprints and permissions

Copyright information

© 2014 Springer International Publishing Switzerland

About this chapter

Cite this chapter

Holzinger, A. (2014). Lecture 12 Methodology for Information Systems: System Design, Usability, and Evaluation. In: Biomedical Informatics. Springer, Cham. https://doi.org/10.1007/978-3-319-04528-3_12

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-04528-3_12

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-04527-6

  • Online ISBN: 978-3-319-04528-3

  • eBook Packages: EngineeringEngineering (R0)

Publish with us

Policies and ethics