Research through Design: Qualitative Analysis to Evaluate the Usability
The present need to identify and understand non-measurable/non-quantifiable of the user experience with software has been the moto for may researchers in the area of Human Computer Interaction (HCI) to adopt qualitative methods. On the other hand, the use of qualitative analysis to support software has been growing. The integration of these types of tools in research is accompanied by an increase in the number of software packages available. Depending on the design and research questions, researchers can explore various solutions available in the market. Thus, it is urgent to ensure that these tools, apart from containing the necessary functionality for the purposes of research projects, are also usable. This study presents an assessment of the usability of the qualitative data analysis software webQDA® (version 2.0). To assess its usability, Content Analysis was used. The results indicate that the current version is “acceptable” in terms of usability, as users, in general, show a positive perception is perceived from users with completed PhDs as compared to those who are still doing their PhDs; no relevant differences can be found between the views obtained from different professional or research areas, although a more positive assessment may be drawn from Education and Teaching. Suggestions for future studies are put forward, even though we recognise that, in spite of most studies on usability defining quantitative metrics, the present study is offered as a contribution that aims to show that qualitative analysis has a great potential to deepen various dimensions of usability and functional and emotional interrelationships that are not by any means quantifiable.
KeywordsUsability Qualitative computing Qualitative research Qualitative data analysis Research through design
The first author thanks the Foundation for Science and Technology (FCT) the financial support that enabled the development of this study and presentation. The authors thank Micro IO company and its employees for the development of the new version of webQDA and participants of this study.
- Corti, L., & Gregory, A. (2011). CAQDAS comparability. what about CAQDAS data exchange? forum: Qualitative. Social Research, 12(1), 1–17.Google Scholar
- Costa, A. P., et al. (2016). webQDA—Qualitative data analysis software usability assessment. In: Conferência Ibérica de Sistemas e Tecnologias de Informação. Gran Canária—Espanha: AISTI—Associação Ibérica de Sistemas e Tecnologias de Informação, (in press).Google Scholar
- Costa, A.P., Faria, B.M. & Reis, L.P. (2015). Investigação através do Desenvolvimento: Quando as Palavras “Contam.” RISTI—Revista Ibérica de Sistemas e Tecnologias de Informação, (E4), pp.vii–x. Available at: Investiga??o atrav?s do Desenvolvimento: Quando as.Google Scholar
- ISO9241-210. (2010). Ergonomics of human-system interaction (210: Human-centred design for interactive systems).Google Scholar
- Kaefer, F., Roper, J. & Sinha, P. (2015). A software-assisted qualitative content analysis of news articles : Example and reflections. Forum Qualitative Sozialforschung, 16(2).Google Scholar
- Maguire, M., (2001). Methods to support human-centred design. International Journal of Human-Computer Studies, 55(4), 587–634. Available at: http://linkinghub.elsevier.com/retrieve/pii/S1071581901905038 Accessed November 1, 2013.
- Neri de Souza, F., Costa, A.P. & Moreira, A. (2011). Questionamento no Processo de Análise de Dados Qualitativos com apoio do software webQDA. EduSer: revista de educação, Inovação em Educação com TIC, 3(1), 19–30.Google Scholar
- Pierce, J. (2014). On the presentation and production of design research artifacts in HCI. In: Proceedings of the 2014 conference on Designing interactive systems—DIS’14. New York, New York, USA: ACM Press, pp. 735–744. Available at: http://dl.acm.org/citation.cfm?doid=2598510.2598525.
- Pinho, I., et al. (2014). Determinantes na Adoção e Recomendação de Software de Investigação Qualitativa: Estudo Exploratório. Internet Latent Corpus Journal, 4(2), 91–102.Google Scholar
- Puebla, C.A.C. & Davidson, J. (2012). Qualitative computing and qualitative research: Addressing the challenges of technology and globalization. Historical Social Research, 37(4), 237–248. Available at: http://www.jstor.org/stable/41756484.
- Scanlon, E., Mcandrew, P., & Shea, T. O. (2015). Designing for educational technology to enhance the experience of learners in distance education: How open educational resources, learning design and moocs are influencing learning. Journal of Interactive Media in Education, 1(6), 1–9.Google Scholar
- Seffah, A., et al. (2008). Reconciling usability and interactive system architecture using patterns. Journal of Systems and Software, 81(11), 1845–1852. Available at: http://linkinghub.elsevier.com/retrieve/pii/S016412120800085X Accessed November 1, 2013.
- Souza, F. N., Costa, A. P., & Moreira, A. (2011). Análise de Dados Qualitativos Suportada pelo Software webQDA. VII Conferência Internacional de TIC na Educação: Perspetivas de Inovação (pp. 49–56). VII Conferência Internacional de TIC na Educação: Braga.Google Scholar
- Souza, F.N. de, Costa, A.P. & Moreira, A. (2016). webQDA. Available at: www.webqda.net.
- Teixeira, R. A. G., Neri de Souza, F., & Vieira, R. M. (2015). Docentes Investigadores de Programas de Pós-graduação em Educação no Brasil: Estudo Sobre o Uso de Recursos Informaticos no Processo de Pesquisa (pp. 741–768). No prelo (: Revista da Avaliação da Educação Superior.Google Scholar
- Van Velsen, L. et al. (2008). User-centered evaluation of adaptive and adaptable systems: A literature review. The Knowledge Engineering Review, 23(03), 261–281. Available at: http://www.journals.cambridge.org/abstract_S0269888908001379.
- Zimmerman, J., Forlizzi, J. & Evenson, S. (2007). Research through design as a method for interaction design research in HCI. In Proceedings of the SIGCHI conference on Human factors in computing systems—CHI’07. New York, New York, USA: ACM Press, p. 493. Available at: http://portal.acm.org/citation.cfm?doid=1240624.1240704.