Abstract
Augmented Reality (AR) is a technology that addition of virtual objects into the real-world environment. AR technology uses images recognition approaches to recognize objects. The objects can be easily recognized if rich in details, have good contrast, and have no repetitive patterns. A feature-based technique called Natural Feature Tracking (NFT) system can be used to recognize physical objects in markerless AR. The features such as blob, edge, and corner in the object are extracted by the feature detector and descriptor before recognizing process. The extraction feature is the most important thing in the recognition process because it can determine accurate results. ORB detector is a feature extractor were suitable for real-time tracking in AR because it has speed, efficiency, and a high quantity of features detected and extracted. However, before detecting and describing the features, ORB detector uses the Grayscale Image Generation (GIG) process to change color images into grayscale images. We found some features extracted using the GIG process not extracted perfectly. ORB detector is influenced by the intensity of the grayscale pixel to find the candidate corner. The proposed integration of the Colormap technique and ORB detector method can enhance feature extraction for improving features detection in AR.
Similar content being viewed by others
References
Adams M (2019) The fractional harris-laplace feature detector. vol. 11603, no. July 2017, Springer International Publishing, pp 3–12. https://doi.org/10.1007/978-3-030-22368-7_1
Anggara DW et al (2020) Grayscale image enhancement for enhancing features detection in marker-less augmented. J Theor Appl Inf Technol 98(13):2671–2683
Ar Y, Unal M, Sert SY, Bostanci E, Kanwal N, Guzel MS (2018) Evolutionary fuzzy adaptive motion models for user tracking in augmented reality applications. ISMSIT 2018 - 2nd Int. Symp. Multidiscip. Stud. Innov. Technol. Proc., pp 1–6. https://doi.org/10.1109/ISMSIT.2018.8566687
Arora B, Parkar N (2017) Augmented Reality: Tracking Methods. Int J Eng Res Technol 5(01):1–4 [Online]. Available: www.ijert.org
Bashardoost M, Rahim MSM, Saba T, Rehman A (2017) Replacement attack: a new zero text watermarking attack. 3D Res 8(1):8. https://doi.org/10.1007/s13319-017-0118-y
Beier D, Billert R, Bruderlin B, Stichling D, Kleinjohann B (2003) Marker-less vision based tracking for mobile augmented reality. Proc. - 2nd IEEE ACM Int. Symp. Mix. Augment. Reality, ISMAR 2003, pp 258–259. https://doi.org/10.1109/ISMAR.2003.1240709
Bekele D, Teutsch M, Schuchert T (2013) Evaluation of binary keypoint descriptors. In 2013 IEEE International Conference on Image Processing, Sep pp 3652–3656. https://doi.org/10.1109/ICIP.2013.6738753
Blanco-pons S, Carrión-ruiz B, Lerma JL (2019) Augmented reality application assessment for disseminating rock art. Multimed Tools Appl 78:10265–10286
Chen P, Peng Z, Li D, Yang L (2016) An improved augmented reality system based on AndAR. J Vis Commun Image Represent 37:63–69. https://doi.org/10.1016/j.jvcir.2015.06.016
Cirulis A, Brigmanis-Brigis K, Zvejnieks G (2020) Analysis of suitable natural feature computer vision algorithms for augmented reality services. Balt J Mod Comput 8(1):174–181. https://doi.org/10.22364/BJMC.2020.8.1.10
Ćuković S, Gattullo M, Pankratz F, Devedžić G (2015) Marker based vs. natural feature tracking augmented reality visualization of the 3D foot phantom. Proc Int Conf Electr Bio-medical Eng Clean Energy Green Comput, pp 24–31
Deng G (2016) A generalized gamma correction algorithm based on the SLIP model. EURASIP J Adv Signal Process 2016(1). https://doi.org/10.1186/s13634-016-0366-7
Fang W, Zhang Y, Yu B, Liu S (2018) FPGA-based ORB feature extraction for real-time visual SLAM. 2017 Int. Conf. Field-Programmable Technol. ICFPT 2017, vol. 2018-Janua, no. October 2017, pp 275–278. https://doi.org/10.1109/FPT.2017.8280159
George AP, Joseph F (2017) Object recognition algorithms for computer vision system: a survey. Int J Pure Appl Math 117(21):69–74
Gupta S, Sharma S (2016) A new method for improving contrast enhancement in remote sensing images by image fusion. Int J Comput Sci Inf Technol 7(3):1372–1377
Güzel MS (2016) Performance evaluation for feature extractors on street view images. Imaging Sci J 64(1):26–33. https://doi.org/10.1080/13682199.2015.1109783
Hamidia M, Zenati-henda N (2015) Object recognition based on ORB descriptor for markerless augmented reality. 9ème Conférence sur le Génie Electr, no
Hashim MM, Mohd Rahim MS (2017) Image steganography based on odd/even pixels distribution scheme and two parameters random function. J Theor Appl Inf Technol 95(22):5977–5986
Hashim MM, Rahim MSM, Johi FA, Taha MS, Hamad HS (2018) Performance evaluation measurement of image steganography techniques with analysis of LSB based on variation image formats. Int J Eng Technol 7(4):3505–3514. https://doi.org/10.14419/ijet.v7i4.17294
Hassaballah M, Alshazly HA, Ali AA (2019) Analysis and evaluation of keypoint descriptors for image matching. In ResearchGate, no. January, Springer International Publishing, pp 113–140. https://doi.org/10.1007/978-3-030-03000-1_5
Hedley M (2006) Fast corner detection. Elsevier Image Vis Comput 16(1998):75–87
Heinly J, Dunn E, Frahm JM (2012) Comparative evaluation of binary features. Lect. Notes Comput. Sci. (including Subser. Lect. Notes Artif. Intell. Lect. Notes Bioinformatics), vol. 7573 LNCS, no. PART 2, pp 759–773. https://doi.org/10.1007/978-3-642-33709-3_54
Jakubovic A, Velagic J (2018) Image feature matching and object detection using brute-force matchers. In 2018 International Symposium ELMAR, Sep. no. September, pp 83–86. https://doi.org/10.23919/ELMAR.2018.8534641
Jumarlis M, Mirfan M (2018) Implementation of Markerless augmented reality technology based on android to introduction Lontara in marine society. IOP Conf Ser Earth Environ Sci 156:012017. https://doi.org/10.1088/1755-1315/156/1/012017
Khan D, Ullah S, Rabbi I (2015) Factors affecting the design and tracking of ARToolKit markers. Comput Stand Int 41:56–66. https://doi.org/10.1016/j.csi.2015.02.006
Krig S (2014) Interest point detector and feature descriptor survey. In Computer Vision Metrics, no 1, Berkeley, CA: Apress, pp 217–282. https://doi.org/10.1007/978-1-4302-5930-5_6
Lanka S, Science C, Ehsan S, Ehsan A (2017) A review of research on emerging technologies of the internet of things and augmented reality. Int. Conf. I-SMAC (IoT Soc. Mobile, Anal. Cloud) (I-SMAC 2017), pp 770–774
Lee H, Jeon S, Yoon I, Paik J (2016) Recent advances in feature detectors and descriptors: a survey. IEIE Trans Smart Process Comput 5(3):153–163. https://doi.org/10.5573/IEIESPC.2016.5.3.153
Low DG (2004) Distinctive image features from scale-invariant keypoints. Int J Comput Vis pp 91–110, [Online]. Available: https://www.cs.ubc.ca/~lowe/papers/ijcv04.pdf
Mahdi MH, Abdulrazzaq AA, Mohd Rahim MS, Taha MS, Khalid HN, Lafta SA (2019) Improvement of image steganography scheme based on LSB value with two control random parameters and multi-level encryption. IOP Conf Ser Mater Sci Eng 518(5):0–14. https://doi.org/10.1088/1757-899X/518/5/052002
Marchand E, Uchiyama H, Spindler F (2016) Pose estimation for augmented reality: a hands-on survey. IEEE Trans Vis Comput Graph 22(12):2633–2651. https://doi.org/10.1109/TVCG.2015.2513408
Mcandrew A (2004) An introduction to digital image processing with Matlab notes for SCM2511 image processing 1. Sch Comput Sci Math Victoria Univ Technol
Mentzer N, Vayá GP, Blume H, von Egloffstein N, Krüger L (2017) Self-calibration of wide baseline stereo camera systems for automotive applications. In Towards a Common Software/Hardware Methodology for Future Advanced Driver Assistance Systems: The DESERVE Approach, pp 157–200
Mohamad MF, Rahim MSM, Othman NZS, Jupri Z (2009) A Comparative study on extraction and recognition method of CAD data from CAD drawings. Proc. - 2009 Int. Conf. Inf. Manag. Eng. ICIME 2009, pp 709–713. https://doi.org/10.1109/ICIME.2009.56
Parmar JK, Desai A (2019) Feature extraction in augmented reality. arXiv1911.09177v1 [cs.GR] 9 Nov 2019, Nov. [Online]. Available: http://arxiv.org/abs/1911.09177
Rad AE, Rahim MSM, Kolivand H, Bin Mat Amin I (2017) Morphological region-based initial contour algorithm for level set methods in image segmentation. Multimed Tools Appl 76(2):2185–2201. https://doi.org/10.1007/s11042-015-3196-y
Radkowski R, Oliver J (2013) Natural feature tracking augmented reality for on-site assembly assistance systems,” Lect Notes Comput Sci (including Subser Lect Notes Artif Intell Lect Notes Bioinformatics), vol. 8022 LNCS, no. PART 2, pp 281–290. https://doi.org/10.1007/978-3-642-39420-1-30
Rakhmadi A, Othman NZS, Bade A, Rahim MSM, Amin IM (2010) Connected component labeling using components neighbors-scan labeling approach. J Comput Sci 6(10):1099–1107. https://doi.org/10.3844/jcssp.2010.1099.1107
Ruzinoor CM, Shariff ARM, Pradhan B, Rodzi Ahmad M, Rahim MSM (2012) A review on 3D terrain visualization of GIS data: techniques and software. Geo-Spatial Inf Sci 15(2):105–115. https://doi.org/10.1080/10095020.2012.714101
Saipullah K, Ismail NA, Anuar A (2013) Comparison of feature extractors for real- time object detection on android smartphone. J Theor Appl Inf Technol 47(1):135–142
Salahat E, Qasaimeh M (2017) Recent advances in features extraction and description algorithms: a comprehensive survey. IEEE
Saleem Z (2018) A comparative analysis of SIFT, SURF, KAZE, AKAZE, ORB, and BRISK. 2018 Int Conf Comput Math Eng Technol pp 1–10. https://doi.org/10.1109/ICOMET.2018.8346440
Saravanan C (2010) Color Image to Grayscale Image Conversion. Second Int Conf Comput Eng Appl 2:196–199. https://doi.org/10.1109/ICCEA.2010.192
Selvapriya B, Raghu B (2018) A color map for pseudo color processing of medical images. Int J Eng Technol 7(3.34 Special Issue 34):954–958
Setyadi R, Ranggadara I (2020) Augmented reality using features accelerated segment test for property catalogue. Telkomnika Telecommunication Comput Electron Control 18(1):140–147. https://doi.org/10.12928/TELKOMNIKA.v18i1.13039
Sharifara A, Rahim MSM, Bashardoost M (2013) A novel approach to enhance robustness in digital image watermarking using multiple bit-planes of intermediate significant bits. Proc. - 2013 Int. Conf. Informatics Creat. Multimedia, ICICM 2013, pp 22–27. https://doi.org/10.1109/ICICM.2013.13
Sun R, Liu P, Wang J, Accetti C, Naqvi AA (2017) A 42fps full-HD ORB feature extraction accelerator with reduced memory overhead. In 2017 International Conference on Field Programmable Technology (ICFPT), Dec pp 183–190. https://doi.org/10.1109/FPT.2017.8280137
Taha MS, Rahim MSM, Lafta SA, Hashim MM, Alzuabidi HM (2019) Combination of Steganography and Cryptography: A short Survey. IOP Conf Ser Mater Sci Eng 518(5):052003. https://doi.org/10.1088/1757-899X/518/5/052003
Tan SY, Arshad H, Abdullah A (2018) An efficient and robust mobile augmented reality application. 8(4):1672–1678
Tan SY, Arshad H, Abdullah A (2019) Distinctive accuracy measurement of binary descriptors in mobile augmented reality. PLoS One 14(1):1–18. https://doi.org/10.1371/journal.pone.0207191
Tareen SAK, Saleem Z (2018) A comparative analysis of SIFT, SURF, KAZE, AKAZE, ORB, and BRISK. 2018 Int. Conf. Comput. Math. Eng. Technol. Inven. Innov. Integr. Socioecon. Dev. iCoMET 2018 - Proc., vol. 2018-Janua, pp 1–10. https://doi.org/10.1109/ICOMET.2018.8346440
Wang C (2015) Real time non-rigid surface detection based on binary robust independent elementary features. Rev Mex Trastor Aliment 13(2):297–304. https://doi.org/10.1016/j.jart.2015.06.005
Xiaokang R, Danling C, Jie R, Bianli D (2020) Research on augmented reality method based on improved ORB algorithm. J Phys Conf Ser 1453(1). https://doi.org/10.1088/1742-6596/1453/1/012024
Yang Z, Shen D, Yap PT (2017) Image mosaicking using SURF features of line segments. PLoS One 12(3):1–15. https://doi.org/10.1371/journal.pone.0173627
Acknowledgments
This work was supported by Universiti Teknologi Malaysia with grant numbers: R.J130000.7308.4B429,Q.J130000.3051.01 M37, Q.J130000.3008.01 M88, and Fundamental Research Grant (FRGS) by Ministery of Higher Education Malaysia, FRGS/1/2020/ICT10/UTM/01/1, R.J130000.7808.5F368.
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Conflict of interests
The authors declare that they have no known competing financial interests or personal relationships that could have appeared to influence the work reported in this paper.
Additional information
Publisher’s note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Springer Nature or its licensor holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.
About this article
Cite this article
Anggara, D.W., Rahim, M.S.M., Ismail, A.W. et al. Integrated Colormap and ORB detector method for feature extraction approach in augmented reality. Multimed Tools Appl 81, 35713–35729 (2022). https://doi.org/10.1007/s11042-022-13548-x
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11042-022-13548-x