User-Centered Evaluation of a Virtual Environment Training System: Utility of User Perception Measures
This study assessed the utility of measures of Self-efficacy (SelfEfficacy) and Perceived VE efficacy (PVEefficacy) for quantifying how effective VEs are in procedural task training. SelfEfficacy and PVEefficacy have been identified as affective construct potentially underlying VE efficacy that is not evident from user task performance. The motivation for this study is to establish subjective measures of VE efficacy and investigate the relationship between PVEefficacy, SelfEfficacy and User task performance. Results demonstrated different levels of prior experience in manipulating 3D objects in gaming or computer environment (LOE3D) effects on task performance and user perception of VE efficacy. Regression analysis revealed LOE3D, SelfEfficacy, PVEefficacy explain significant portions of the variance in VE efficacy. Results of the study provide further evidence that task performance may share relationships with PVEefficacy and SelfEfficacy, and that affective constructs, such as PVEefficacy, and SelfEfficacy may serve as alternative, subjective measures of task performance that account for VE efficacy.
KeywordsUser-based evaluation Virtual Environment Evaluation methodology
Unable to display preview. Download preview PDF.
- 1.Bandura, A.: Self-efficacy: the Exercise of Control. W.H. Freeman, New York (1997)Google Scholar
- 4.DeVellis, R.F.: Scale Development: Theory and Applications, 2nd edn. Sage Publications, Thousand Oaks (2003)Google Scholar
- 7.Isdale, J.: Introduction to VRTechnology. In: IEEE Virtual Reality Conference, p. 302. IEEE Computer Society Press, Los Alamitos (2003)Google Scholar
- 8.Jia, D., Bhatti, A., Nahanandi, S.: Computer-simulated Environment (VE) for training: Challenge of Efficacy Evaluation. In: The Simulation Technology and Training Conference (SimTecT 2008), p. 63. Simulation Industry Association of Australia (2008)Google Scholar
- 9.Lin, J.J.W.: Virtual Guiding Avatar: an Effective Procedure to Reduce Simulator Sickness in Virtual Environments. In: SIGCHI Conference on Human Factors in Computing Systems, pp. 719–726. ACM Press, New York (2004)Google Scholar
- 10.Mantovani, F.: VR Learning: Potential and Challenges for the Use of 3D Environments in Education and Training. In: Giuseppe, R., Carlo, G. (eds.) Towards CyberPsychology: Mind, Cognitions and Society in the Internet Age, pp. 207–226. IOS Press, Amsterdam (2001)Google Scholar
- 13.North, M.M., Mathis, J.R., Madajewski, A., Brown, J.T., Cupp, S.M.: Virtual Reality and Transfer of Learning. In: Michael, J.S., Richard, J.K., Gavriel, S., Don, H. (eds.) Usability Evaluation and Interface Design: Cognitive Engineering, Intelligent Agents and Virtual Reality, vol. 1, pp. 634–638. Lawrence Erlbaum Associates, London (2001)Google Scholar
- 14.Papasratorn, B., Wangpipatwong, T.: The Effects of Self-Efficacy and Attitude on E-learning Outcomes. In: World Conference on E-Learning in Corporate, Government, Healthcare, & Higher Education, pp. 226–2270. Association for the Advancement of Computing in Education (AACE) (2006)Google Scholar
- 17.Stanney, K.M.: Handbook of Virtual Environments Design, Implementation, and Applications. Lawrence Erlbaum Associates, London (2002)Google Scholar
- 18.Tesfazgi, S.H.: Survey on Behavioral Observation Methods in Virtual Environments. Research Assignment, Delft University of Technology (2003)Google Scholar