Investigation of Visual Features for Augmented Reality Assembly Assistance

Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 9179)


The overall goal of this research is to investigate the effectivity of augmented reality (AR) assembly assistance in relation to the difficulty of a particular assembly task since advantages of AR, such as time and error reduction, have not been consequently reported in literature. The research aims to identify additional factors that affect the design of virtual instructions for AR applications. This paper intends to discuss a suggested classification of visual features for AR assembly assistance applications. The classification suggests visual features for different assembly activities and distinguishes significant from less significant parts. It represents a theoretical framework for this research. A user study was conducted to verify the suggested visual features. The results are not significant and do not support the classification. However, observations made during the study indicate additional factors.


Significant Part Augmented Reality Visual Feature Assembly Activity Assembly Task 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.



The author thanks Jordan Herrema for conducting the user study.


  1. 1.
    Agrawala, M., Phan, D., Heiser, J., Haymaker, J., Klingner, J., Hanrahan, P., Tversky, B.: Designing effective step-by-step assembly instructions. J. ACM Trans. Graph. (TOG) Proc. ACM. 2003 22(3), 828–837 (2003)Google Scholar
  2. 2.
    Azuma, R.: A survey of augmented reality. Presence Teleoperators Virtual Environments 6, 355–385 (1997)Google Scholar
  3. 3.
    Baggett, P., Ehrenfeucht, A.: Building physical and mental models in assembly tasks. Int. J. Ind. Ergon. 7, 217–227 (1991)CrossRefGoogle Scholar
  4. 4.
    Baird, K.M., Barfield, W.: Evaluating the effectiveness of augmented reality displays for a manual assembly task. Virtual Reality 4(4), 250–259 (1999)CrossRefGoogle Scholar
  5. 5.
    Boud, A., Haniff, D., Baber, C., Steiner, S.: Virtual reality and augmented reality as a training tool for assembly tasks. In: Proceedings of the 1999 IEEE International Conference on Information Visualization, pp. 32–36. London, UK, July 14–16 1999Google Scholar
  6. 6.
    Chimienti, V., Iliano, S., Dassisti, M., Dini, G., Failli, F.: Guidelines for implementing augmented reality procedures in assisting assembly operations. In: Ratchev, S. (ed.) IPAS 2010. IFIP AICT, vol. 315, pp. 174–179. Springer, Heidelberg (2010) CrossRefGoogle Scholar
  7. 7.
    Ganier, F.: Factors affecting the processing of procedural instructions: implications for document design. IEEE Trans. Prof. Commun. 47(1), 15–26 (2004)CrossRefGoogle Scholar
  8. 8.
    Henderson, S., Feiner, S.: Augmented reality in the psychomotor phase of a procedural task. In: Proceedings of the 2011 10th IEEE International Symposium on Mixed and Augmented Reality. Basel, Switzerland, October 26–29 2011Google Scholar
  9. 9.
    Ikeuchi, K., Suehiro, T.: Towards an assembly plan from observation. In: Proceedings of the 1992 IEEE International Conference on Robotics and Automation, pp. 2171–2177. Nice, France, May 12–14, 1992Google Scholar
  10. 10.
    Kosslyn, S.: Image and Brain. MIT press, Cambridge (1994)Google Scholar
  11. 11.
    Lee, D.Y., Shin, D.H.: An empirical evaluation of multi-media based learning of a procedural task. Comput. Hum. Behav. 28, 1072–1081 (2012)CrossRefGoogle Scholar
  12. 12.
    Mayer, R.E., Hegarty, M., Mayer, S., Campbell, J.: When static media promote active learning: annotated illustrations versus narrated animations in multimedia instruction. J. Exp. Psychol. Appl. 11(4), 256–265 (2005)CrossRefGoogle Scholar
  13. 13.
    Michas, I.C., Berry, D.C.: Learning a procedural task: effectiveness of multimedia presentations. Appl. Cognitive Psychol. 14(6), 555–575 (2000)CrossRefGoogle Scholar
  14. 14.
    Nilsson, S., Johansson, B.: Fun and usable: augmented reality instructions in a hospital setting. In: Proceedings of the 19th Australasian conference on Computer-Human Interaction, OZCHI 2007, Adelaide, Australia, November 28–30 2007Google Scholar
  15. 15.
    Nof, S.Y., Wilhelm, W.E., Warnecke, H.J.: Industrial Assembly. Chapman & Hall, London (1997)CrossRefGoogle Scholar
  16. 16.
    Radkowski, R., Herrema, J., Oliver, J.: Augmented reality based manual assembly support with visual features for different degree of difficulty. J. Hum. Comput. Interact. (2015, in press)Google Scholar
  17. 17.
    Schnotz, W., Bannert, M.: Construction and interface in learning from multiple representation. Learn. Instr. 13, 141–156 (2003)CrossRefGoogle Scholar
  18. 18.
    Siltanen, S., Hakkarainen, M., Korkalo, O., Salonen, T., Sääski, J., Woodward, C., Kannetis, T., Perakakis, M., Potamianos, A.: Multimodal user interface for augmented assembly. In: 2007 International Workshop on Multimedia Signal Processing, MMSP 2007, Chania, Greece, October 1–3, 2007Google Scholar
  19. 19.
    Swan, R., Allan, J.: Aspect windows, 3-d visualization, and indirect comparison of information retrieval systems. In: Proceedings of the 21st annual international ACM SIGIR conference on research and development in information retrieval, SIRIR 1998, pp. 173–181, Copenhagen, Denmark, June 21–24, 1998Google Scholar
  20. 20.
    Tang, A., Owen, C., Biocca, F., Mou, W.: Comparative effectiveness of augmented reality in object assembly. In: Proceedings of the Conference on Human Factors in Computing Systems, CHI 2003, Fort Lauderdale, FL, USA, April 05–10, 2003Google Scholar
  21. 21.
    Tory, M., Kirkpatrick, A., Atkins, S., Möller, T.: Visualization task performance with 2d, 3d and combined displays. IEEE Trans. Vis. Comput. Graph. 12(1), 2–13 (2006)CrossRefGoogle Scholar
  22. 22.
    Wang, Z.B., Ong, S.K., Nee, A.Y.C.: Augmented reality aided interactive manual assembly design. Int. J. Adv. Manuf. Technol. 2013(68), 1311–1321 (2013)CrossRefGoogle Scholar
  23. 23.
    Webel, S., Bockholt, U., Engelke, T., Gavish, N., Olbrich, M., Preusche, C.: An augmented reality training platform for assembly and maintenance skills. J. Rob. Auton. Syst. 61(4), 398–403 (2011)CrossRefGoogle Scholar
  24. 24.
    Westerfield, G., Mitrovic, A., Billinghurst, M.: Intelligent augmented reality training for assembly tasks. In: Lane, H.C., Yacef, K., Mostow, J., Pavlik, P. (eds.) AIED 2013. LNCS, vol. 7926, pp. 542–551. Springer, Heidelberg (2013) CrossRefGoogle Scholar
  25. 25.
    Wiedenmaier, S., Oehme, O., Schmidt, L., Luczak, H.: Augmented reality (ar) for assembly processes design and experimental evaluation. Int. J. Hum. Comput. Interact. 16(3), 497–514 (2003)CrossRefGoogle Scholar
  26. 26.
    Wileman, R.: Visual communicating. Englewood Cliffs, New Jersey (1993)Google Scholar
  27. 27.
    Wolfe, J., Horowitz, T.: What attributes guide the deployment of visual attention and how do they do it? Nature Rev.Neuroscience 5, June 2004Google Scholar
  28. 28.
    Wong, A., Marcus, N., Ayres, P., Smith, L., Cooper, G.A., Paas, F., Sweller, J.: Instructional animations can be superior to statics when learning human motor skills. Comput. Hum. Behav. 25(2), 339–347 (2009)CrossRefGoogle Scholar
  29. 29.
    Yamazaki, A.K., Goto, K., Taki, H., Hori, S.: An effectiveness study of pictogram elements for steps in manufacturing procedures. In: Lovrek, I., Howlett, R.J., Jain, L.C. (eds.) KES 2008, Part III. LNCS (LNAI), vol. 5179, pp. 680–686. Springer, Heidelberg (2008) CrossRefGoogle Scholar
  30. 30.
    Yuan, M.L., Ong, S.K., Nee, A.Y.C.: Augmented reality for assembly guidance using a virtual interactive tool. Int. J. Prod. Res. 46(7), 1745–1767 (2008)CrossRefMATHGoogle Scholar
  31. 31.
    Zauner, J., Haller, M., Brandl, A., Hartmann, W.: Authoring of a mixed reality assembly instructor for hierarchical structures. In: The Second International Symposium on Mixed and Augmented Reality, ISMAR 2003, Tokyo, Japan, October 7–10 2003Google Scholar

Copyright information

© Springer International Publishing Switzerland 2015

Authors and Affiliations

  1. 1.Virtual Reality Applications CenterIowa State UniversityAmesUSA

Personalised recommendations