Skip to main content

Preliminary Development of Virtual Try-On Platform for Batik Apparel Based on Mobile Augmented Intelligence Technology

  • 97 Accesses

Part of the Lecture Notes of the Institute for Computer Sciences, Social Informatics and Telecommunications Engineering book series (LNICST,volume 436)

Abstract

During the COVID-19 pandemic, the government decided to suspend all arts cultural events to prevent the spread of the virus. This situation is a challenge for batik artisans to survive. This research aims to develop a virtual try-on platform that is an alternative medium for artisans to solve their problems. Development platforms based on augmented reality technology can be an option for the problems. Platform designed based on mobile devices has advantages in the practicality of use that is not limited by space and time. Implementation of human motion capture and hand gesture recognition provides an immersive experience for users. Motion capture is used for a virtual try-on scheme for batik apparel that can make users try batik apparel virtually and can automatically fit the user’s body. In addition, the implementation of hand gesture recognition allows users to apply batik motifs to virtual apparel interactively combined with material fitting function, which can assist users in positioning batik motifs. Apart from technical matters, this platform also provides information about the history of batik motifs. Alpha testing is used in testing the platform and confusion matrix to validate the accuracy of implementing the functions that exist on the platform. The results of testing the accuracy of hand gesture recognition reached 97%, and human motion capture reached 93%, which means the system can run well. This paper describes the initial efforts made to develop a virtual try-on platform for batik apparel based on Augmented Intelligence Technology.

Keywords

  • Augmented reality
  • Batik
  • Body tracking
  • Cultural computing
  • Hand gesture
  • Virtual try-on

This is a preview of subscription content, access via your institution.

Buying options

Chapter
USD   29.95
Price excludes VAT (USA)
  • DOI: 10.1007/978-3-031-01984-5_4
  • Chapter length: 15 pages
  • Instant PDF download
  • Readable on all devices
  • Own it forever
  • Exclusive offer for individuals only
  • Tax calculation will be finalised during checkout
eBook
USD   64.99
Price excludes VAT (USA)
  • ISBN: 978-3-031-01984-5
  • Instant PDF download
  • Readable on all devices
  • Own it forever
  • Exclusive offer for individuals only
  • Tax calculation will be finalised during checkout
Softcover Book
USD   84.99
Price excludes VAT (USA)
Fig. 1.
Fig. 2.
Fig. 3.
Fig. 4.
Fig. 5.
Fig. 6.
Fig. 7.
Fig. 8.
Fig. 9.

References

  1. Nabi, S., Mishra, V.P.: Analysis and Impact of COVID-19 on economy and organization. In: International Conference on Computational Intelligence and Knowledge Economy (ICCIKE), pp. 219–224. IEEE, Dubai, United Arab Emirates (2021)

    Google Scholar 

  2. Miranto, C., Rante, H., Sukaridhoto, S., Pasila, F., Aliwarga, H.: Preliminary Development of virtual reality for batik exhibition. Psychol. Educ. J. 57(9), (2020)

    Google Scholar 

  3. Behzadan, A.H., Kamat, V.R.: Enabling discovery-based learning in construction using telepresent augmented reality. Autom. Constr. 33, 3–10 (2013)

    CrossRef  Google Scholar 

  4. Puyuelo, M., Higón, J.L., Merino, L., Contero, M.: Experiencing augmented reality as an accessibility resource in the UNESCO heritage site called “La Lonja.” Procedia Comput. Sci. 25, 171–178 (2013)

    CrossRef  Google Scholar 

  5. Wojciechowski, R., Cellary, W.: Evaluation of learners’ attitude toward learning in ARIES augmented reality environments. Comput. Educ. 68, 570–585 (2013)

    CrossRef  Google Scholar 

  6. Kysela, J., ŠTorková, P.: Using augmented reality as a medium for teaching history and tourism. Procedia Soc. Behav. Sci. 174, 926–931 (2015)

    Google Scholar 

  7. Fajrianti, E.D., et al.: Design and development of human anatomy learning platform for medical students based on augmented intelligence technology. In: International Electronics Symposium (IES), pp. 195–202. IEEE, Surabaya, Indonesia (2021).

    Google Scholar 

  8. Hebbar, A.: Augmented intelligence: enhancing human capabilities. In: 2017 Third International Conference on Research in Computational Intelligence and Communication Networks (ICRCICN), pp. 251–254. IEEE, Kolkata, India (2017)

    Google Scholar 

  9. Wójcik, M.: Augmented intelligence technology. The ethical and practical problems of its implementation in libraries. Libr. Hi Tech. 39(2), 435–447 (2020)

    Google Scholar 

  10. He, Z., Wu, L., Li, X.R.: When art meets tech: the role of augmented reality in enhancing museum experiences and purchase intentions. Tour. Manage. 68, 127–139 (2018)

    CrossRef  Google Scholar 

  11. Hwangbo, H., Kim, E.H., Lee, S.H., Jang, Y.J.: Effects of 3D Virtual “try-on” on online sales and customers’ purchasing experiences. IEEE Access 8, 189479–189489 (2020)

    CrossRef  Google Scholar 

  12. Liu, T., Li, L., Zhang, X.: Real-time 3D virtual dressing based on users’ skeletons. In: 4th International Conference on Systems and Informatics (ICSAI), pp. 1378–1382. IEEE, Hangzhou, China (2017)

    Google Scholar 

  13. Yuan, M., Khan, I.R., Farbiz, F., Yao, S., Niswar, A., Foo, M.H.: A mixed reality virtual clothes try-on system. IEEE Trans. Multim. 15(8), 1958–1968 (2013)

    CrossRef  Google Scholar 

  14. Gunes, S., Sanli, O., Ergun, O.O.: Augmented reality tool for markerless virtual try-on around human arm. In: IEEE International Symposium on Mixed and Augmented Reality - Media, Art, Social Science, Humanities and Design, pp. 59–60. IEEE, Fukuoka, Japan (2015)

    Google Scholar 

  15. Chu, C.H., Cheng, C.H., Wu, H.S., Kuo, C.C.: A cloud service framework for virtual try-on of footwear in augmented reality. J. Comput. Inf. Sci. Eng. 19(2), (2019)

    Google Scholar 

  16. Yousefi, S., Kidane, M., Delgado, Y., Chana, J., Reski, N.: 3D gesture-based interaction for immersive experience in mobile VR. In: 2016 23rd International Conference on Pattern Recognition (ICPR), pp. 2121–2126. IEEE, Cancun, Mexico (2016)

    Google Scholar 

  17. Ekneling, S., Sonestedt, T., Georgiadis, A., Yousefi, S., Chana, J.: Magestro: Gamification of the data collection process for development of the hand gesture recognition technology. In: IEEE International Symposium on Mixed and Augmented Reality Adjunct (ISMAR-Adjunct), pp. 417–418. IEEE, Munich, Germany (2018)

    Google Scholar 

  18. Kusumaningsih, A., Kurniawati, A., Angkoso, C.V., Yuniarno, E.M., Hariadi, M.: User experience measurement on virtual dressing room of Madura batik clothes. In: 2017 International Conference on Sustainable Information Engineering and Technology (SIET), pp. 203–208. IEEE, Malang, Indonesia (2017)

    Google Scholar 

  19. ARKit. https://developer.apple.com/documentation/arkit. Accessed 8 Sept 2021

  20. Capturing Body Motion in 3D. https://developer.apple.com/documentation/arkit/content_anchors/capturing_body_motion_in_3d. Accessed 8 Sept 2021

  21. ARBodyAnchor. https://developer.apple.com/documentation/arkit/arbodyanchor. Accessed 8 Sept 2021

  22. RealityKit. https://developer.apple.com/documentation/realitykit/. Accessed 8 Sept 2021

  23. Validating a Model for Motion Capture. https://developer.apple.com/documentation/arkit/content_anchors/validating_a_model_for_motion_capture. Accessed 8 Sept 2021

  24. ManoMotion hand tracking SDK. https://www.manomotion.com/mobile-ar/. Accessed 8 Sept 2021

  25. ManoMotion Gesture Documentation. https://sdk.manomotion.com/SDK_Pro_v1.4.8/. Accessed 8 Sept 2021

  26. Caradonna, G., Lionetti, S., Tarantino, E., Verdoscia, C.: A Comparison of low-poly algorithms for sharing 3D models on the web. In: Cefalo, R., Zieliński, J., Barbarella, M. (eds.) New Advanced GNSS and 3D Spatial Techniques. Lecture Notes in Geoinformation and Cartography, pp. 237–244. Springer, Cham (2017). https://doi.org/10.1007/978-3-319-56218-6_19

  27. Bullinger, H.J., Behlau, L.: Technology Guide: Principles – Applications – Trends. Springer, Heidelberg (2009)

    CrossRef  Google Scholar 

  28. AssetBundle. https://docs.unity3d.com/AssetBundlesIntro.html. Accessed 8 Sept 2021

  29. Visa, S., Ramsay, B., Ralescu, A.L., Knaap, E.V.D.: Confusion matrix-based feature selection. In: Proceedings of the 22nd Midwest Artificial Intelligence and Cognitive Science Conference (MAICS), vol. 710, pp. 120–127 (2011)

    Google Scholar 

  30. Makhtar, M., Neagu, D.C., Ridley, M.J.: Comparing multi-class classifiers: on the similarity of confusion matrices for predictive toxicology applications. In: Yin, H., Wang, W., Rayward-Smith V. (eds.) Intelligent Data Engineering and Automated Learning - IDEAL 2011, LNCS, vol. 6936, pp. 252–261. Springer, Berlin (2011). https://doi.org/10.1007/978-3-642-23878-9_31

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Ardiman Firmanda .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and Permissions

Copyright information

© 2022 ICST Institute for Computer Sciences, Social Informatics and Telecommunications Engineering

About this paper

Verify currency and authenticity via CrossMark

Cite this paper

Firmanda, A., Sukaridhoto, S., Rante, H., Fajrianti, E.D. (2022). Preliminary Development of Virtual Try-On Platform for Batik Apparel Based on Mobile Augmented Intelligence Technology. In: Seyman, M.N. (eds) Electrical and Computer Engineering. ICECENG 2022. Lecture Notes of the Institute for Computer Sciences, Social Informatics and Telecommunications Engineering, vol 436. Springer, Cham. https://doi.org/10.1007/978-3-031-01984-5_4

Download citation

  • DOI: https://doi.org/10.1007/978-3-031-01984-5_4

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-031-01983-8

  • Online ISBN: 978-3-031-01984-5

  • eBook Packages: Computer ScienceComputer Science (R0)