Skip to main content

Beyond Usability: Methodologies and Bias – Surveying the Surveys

  • 1293 Accesses

Part of the Lecture Notes in Computer Science book series (LNISA,volume 11572)

Abstract

Surveys are a tool used in everyday usability testing to gather data and confirm findings amongst target populations; however, usability researchers must be aware of biases which can be introduced through certain types of survey questions. Survey instruments are a popular way to quickly gather qualitative and quantitative data from target populations for use in usability studies. These instruments may, at times, introduce unforeseen bias, and information participants may be unaware of when questions are triangulated and results combined during the analysis phase.

Certain populations may be hesitant to answer certain questions which may divulge immigrations status, sexual orientation, marriage status, age, and socio-economic status to name a few. Of even greater concern occurs when answers to these, and other, questions are triangulated and combined to form inferences with regard to the population. For example, imagine the survey instrument contained questions regarding sexual orientation, marital status, and income levels – when triangulated and analyzed, the target population could be deemed marginalized and their results deemed unnecessary to the study, when in reality this population could potentially affect the outcome of the survey had their results been included.

Keywords

  • Usability
  • Bias
  • Marginalized populations
  • Idiosyncratic populations
  • Data triangulation
  • Usability testing bias
  • IRB

This is a preview of subscription content, access via your institution.

Buying options

Chapter
USD   29.95
Price excludes VAT (USA)
  • DOI: 10.1007/978-3-030-23560-4_1
  • Chapter length: 10 pages
  • Instant PDF download
  • Readable on all devices
  • Own it forever
  • Exclusive offer for individuals only
  • Tax calculation will be finalised during checkout
eBook
USD   84.99
Price excludes VAT (USA)
  • ISBN: 978-3-030-23560-4
  • Instant PDF download
  • Readable on all devices
  • Own it forever
  • Exclusive offer for individuals only
  • Tax calculation will be finalised during checkout
Softcover Book
USD   109.99
Price excludes VAT (USA)
Fig. 1.
Fig. 2.
Fig. 3.
Fig. 4.

References

  1. usability.gov Usability Testing. https://www.usability.gov/how-to-and-tools/methods/usability-testing.html. Accessed 20 Feb 2019

  2. Merriam-Webster No Title. https://www.merriam-webster.com/dictionary/survey. Accessed 5 Feb 2019

  3. Ruel, E.: 100 Questions (and Answers) About Survey Research. SAGE Publications, Inc., Thousand Oaks (2019)

    Google Scholar 

  4. NIH National Institute of Environmental Health Sciences. https://www.niehs.nih.gov/research/resources/bioethics/whatis/index.cfm. Accessed 15 Feb 2019

  5. Perlman, G.: Electronic surveys. Behav. Res. Methods Instrum. Comput. 17, 203–205 (1985). https://doi.org/10.3758/BF03214383

    CrossRef  Google Scholar 

  6. Root, R.W., Draper, S.: Questionnaires as a software evaluation tool. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems—CHI 1983. ACM Press, New York, pp. 83–87 (1983)

    Google Scholar 

  7. Usability.gov Surveys. http://usability.gov. Accessed 16 Feb 2019

  8. Sauro J Surveys. https://measuringu.com/survey-biases/. Accessed 18 Feb 2019

  9. Indiana.edu NSSE. http://nsse.indiana.edu/html/survey_instruments.cfm. Accessed 1 Feb 2019

  10. UCLA Higher Education Surveys: CIRP. https://heri.ucla.edu/cirp-freshman-survey/. Accessed 1 Feb 2019

  11. Sauro J Survey Bias. https://measuringu.com/survey-biases/. Accessed 10 Feb 2019

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Troy D. Abel .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and Permissions

Copyright information

© 2019 Springer Nature Switzerland AG

About this paper

Verify currency and authenticity via CrossMark

Cite this paper

Abel, T.D. (2019). Beyond Usability: Methodologies and Bias – Surveying the Surveys. In: Antona, M., Stephanidis, C. (eds) Universal Access in Human-Computer Interaction. Theory, Methods and Tools. HCII 2019. Lecture Notes in Computer Science(), vol 11572. Springer, Cham. https://doi.org/10.1007/978-3-030-23560-4_1

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-23560-4_1

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-23559-8

  • Online ISBN: 978-3-030-23560-4

  • eBook Packages: Computer ScienceComputer Science (R0)