Skip to main content
SpringerLink
Log in

Consideration of image processing system for high visibility of display using aerial imaging optics

  • Special Section: Regular Paper
  • Laser Display and Lighting Conference (LDC’ 23), Yokohama, Japan
  • Published:
Optical Review Aims and scope Submit manuscript

Abstract

We are researching a new display device that allows the public to experience augmented reality without wearable devices. In this paper, we implement an image processing system that improves the dynamically changing image quality deterioration, which is a problem unique to optical systems that project images on the real space, and specify the necessary system requirements from the results of verification of the effect. We quantify the characteristics of blur for each of the three primary colors defined as digital image data, and implement image processing that applies filter correction to the input image data during aerial imaging. Since the effect on image quality depends on what kind of imaging optical path is formed, we designed the device structure assuming that it will be applied to signage products, and built an experimental environment that can analyze the aerial image that the user actually sees. The image subjected to the correction process follows an optical path that forms an image in the air, and the user visually recognizes the image with emphasized edges. We compared the results of the actual aerial image and the simulation results, and clarified the system requirements for realizing an image processing system with higher correction accuracy.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13

Similar content being viewed by others

Data availability

Data underlying the results presented in this paper are not publicly available at this time but may be obtained from the authors upon reasonable request.

References

  1. Hong, J., Kim, Y., Choi, H.-J., Hahn, J., Park, J.-H., Kim, H., Min, S.-W., Chen, N., Lee, B.: Three-dimensional display technologies of recent interest: principles, status, and issues. Appl. Opt. 50(34), H87–H115 (2011)

    Article  PubMed  Google Scholar 

  2. Geng, J.: Three-dimensional display technologies. Adv. Opt. Photon. 5(4), 456–535 (2013)

    Article  CAS  Google Scholar 

  3. Yole Developpement: Report, next generation 3d display. http://www.yole.fr/iso_upload/News/2019/PR_NEXT_GENERATION_3D_DISPLAY_OverviewYOLE_October2019.pdf. Accessed 2 Sept 2021

  4. Mitsubishi Electric Corp: News release. http://www.mitsubishielectric.com/news/2016/0217-e.html. Accessed 2 Sept 2021

  5. Tokuda, Y., Hiyama, A., Hirose, M., Yamamoto, H.: R2D2 w/AIRR: real time & real space double-layered display with aerial imaging by retro-reflection. In: Proc. SIGGRAPH Asia’15, Emerging Technologies, pp. 20:1–20:3 (2015)

  6. Matsuura, Y., Koizumi, N.: A method of scooping mid-air images on water surface. In: Proceedings of the 2018 ACM International Conference on Interactive Surfaces and Spaces, pp. 227–235 (2018)

  7. Miyazaki, D., Maeda, Y., Maekawa, S.: Floating three-dimensional image display using micro-mirror array imaging element. Proc. SPIE 9495, 949508–949512 (2018)

    Google Scholar 

  8. Maekawa, S., Markon, S.: Airflow interaction with Floating images. In: SIGGRAPH ASIA 2009 Art Gallery & Emerging Technologies. SIGGRAPH ASIA’09 Art Gallery & Emerging Technologies, p. 61 (2009)

  9. Ueda, Y., Iwazaki, K., Shibasaki, M., Mizushina, Y., Furukawa, M., Nii, H., Minamizawa, K., Tachi, S.: Mid-air autostereoscopic display for seamless interaction with mixed reality environments. In: Proceedings of SIGGRAPH’14, Emerging Technologies, p. 10:1 (2014).

  10. Suginohara, H., Kikuta, H., Nakamura, Y., Minami, K., Yamamoto, H.: An aerial display: passing through a floating image formed by retro-reflective reimaging. SID Symp. Digest Tech. Pap. 48, 406–409 (2017)

    Article  Google Scholar 

  11. Miyazaki, D., Onoda, S., Maeda, Y., Mukai, T.: Blurring correction for aerial image formed by dihedral corner reflector array. In: CLEO Pacific Rim, paper 25B1_3 (2015)

  12. Kikuta, H., Yasugi, M., Yamamoto, H.: Examination of deblur processing according to optical parameters in aerial image. OSA Contin. 1(3), 462–474 (2022)

    Article  Google Scholar 

  13. Kikuta, H., Yasugi, M., Yamamoto, H.: Quantitative comparisons of deconvolution processing to deblur aerial image formed with aerial imaging by retro-reflection. In: The 11th Laser Display and Lighting Conference 2022, pp. LDC-8-04 (2022)

  14. Kikuta, H., Yasugi, M., Yamamoto, H.: Optimization of blur correction of color images formed with aerial imaging by retro-reflection. Opt. Rev. 30(1), 111–121 (2023)

    Article  Google Scholar 

  15. Kikuta, H., Yasugi, M., Yamamoto, H.: Image processing system for blur correction of aerial imaging by retro-reflection. In: The 12th Laser Display and Lighting Conference 2023, p. LDC-7-04 (2023)

  16. Burckhardt, C.B., Collier, R.J., Doherty, E.T.: Formation and inversion of pseudoscopic images. Appl. Opt. 7, 627–631 (1968)

    Article  CAS  PubMed  ADS  Google Scholar 

  17. Yamamoto, H., Suyama, S.: Aerial imaging by retro-reflection (AIRR). In: SID’13 DIGEST, 895 (2013)

  18. Yamamoto, H., Tomiyama, Y., Suyama, S.: Floating aerial LED signage based on aerial imaging by retro-reflection (AIRR). Opt. Express 22, 26919–26924 (2014)

    Article  PubMed  ADS  Google Scholar 

  19. Maekawa, S., Nitta, K., Matoba, O.: Advances in passive imaging elements with micromirror array. Proc. SPIE 6392, 63920E (2006)

    Article  ADS  Google Scholar 

  20. ASKA 3D: https://aska3d.com/en/technology.html. Accessed 2 Sept 2021

  21. Zhang, R., Hua, H.: Imaging quality of a retroreflective screen in head-mounted projection display. J. Opt. Soc. Am. A 26(5), 1240–1249 (2009)

    Article  CAS  ADS  Google Scholar 

  22. Fujii, K., Endo, N., Hagen, N., Yasugi, M., Suyama, S., Yamamoto, H.: Aerial video-calling system with eye-matching feature based on polarization-modulated aerial imaging by retro-refection (p-AIRR). Opt. Rev. 29(1), 429–439 (2022)

    Article  Google Scholar 

Download references

Funding

Funding was provided by Japan Society for the Promotion of Science (grant no. 20H05702).

Author information

Authors and Affiliations

  1. Utsunomiya University, Utsunomiya, Tochigi, Japan

    Hayato Kikuta, Masaki Yasugi & Hirotsugu Yamamoto

  2. Mitsubishi Electric Corp., Chiyoda-ku, Tokyo, Japan

    Hayato Kikuta

  3. Fukui Prefectural University, Obama, Fukui, Japan

    Masaki Yasugi

Authors
  1. Hayato Kikuta
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Masaki Yasugi
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Hirotsugu Yamamoto
    View author publications

    You can also search for this author in PubMed Google Scholar

Contributions

HK contributed for this paper as 1st author. He designed and conducted the experiments, analyzed the data and wrote the original draft. MY and HY designed and analyzed the experiments, and edited the manuscript.

Corresponding author

Correspondence to Hirotsugu Yamamoto.

Ethics declarations

Conflict of interest

The authors declare no conflicts of interest associated with this manuscript.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Kikuta, H., Yasugi, M. & Yamamoto, H. Consideration of image processing system for high visibility of display using aerial imaging optics. Opt Rev 31, 144–155 (2024). https://doi.org/10.1007/s10043-023-00855-3

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10043-023-00855-3

Keywords

Search

Navigation