Semi-automatic Initial Registration for the iRay System: A User Study
Simultaneous localization and mapping based augmented reality (AR) is trending in mobile AR applications. With the help of depth sensors, both accuracy and speed have improved. However, the method that performs the initial registration to align virtual objects with real scenery is not well developed, especially for some applications requiring very accurate registration (e.g., systems used in medical applications). For the iRay system, which is a mobile AR system using the Structure Sensor, we propose to use an iterative closest point algorithm to initially register the scanned mesh with the torso surface obtained pre-operatively, and then use SLAM to track pose. In this paper, a semi-automatic initial registration strategy is evaluated by a user study. This strategy is designed to help the user modify the selection of the 3D scanning area, so that the errors introduced by subjective differences can be reduced. The results indicate that the proposed strategy helps the users improve initial registration quality and reduces the average needed time.
KeywordsMedical AR Mobile AR 3D registration User study
This work was funded in part by the Methodist Research Institute and the UH Hugh Roy and Lillie Cranz Cullen Endowment Fund. All statements of fact, opinion or conclusions contained herein are those of the authors and should not be construed as representing the official views or policies of the sponsors.
- 2.van den Hengel, A., Hill, R., Ward, B., Dick, A.: In situ image-based modeling. In: Proceedings 8th IEEE International Symposium on Mixed and Augmented Reality, Orlando, FL, USA, pp. 107–110 (2009). doi: 10.1109/ISMAR.2009.5336482
- 6.Kakadiaris, I.A., Islam, M.M., Xie, T., Nikou, C., Lumsden, A.B.: iRay: mobile AR using structure sensor. In: Proceedings 15th IEEE International Symposium on Mixed and Augmented Reality, Merida, Mexico (2016)Google Scholar
- 7.Structure sensor. https://structure.io
- 8.Newcombe, R.A., Izadi, S., Hilliges, O., Molyneaux, D., Kim, D., Davison, A.J., Kohi, P., Shotton, J., Hodges, S., Fitzgibbon, A.: KinectFusion: real-time dense surface mapping and tracking. In: Proceedings 10th IEEE International Symposium on Mixed and Augmented Reality, Basel, Switzerland, pp. 127–136. (2011). doi: 10.1109/ISMAR.2011.6092378
- 9.Newcombe, R.A., Fox, D., Seitz, S.M.: DynamicFusion: reconstruction and tracking of non-rigid scenes in real-time. In: Proceedings IEEE Conference on Computer Vision and Pattern Recognition, Boston, MA, USA, pp. 343–352 (2015)Google Scholar