Skip to main content

High-speed driving of multi-color LED panel for subjective super-resolution display

Abstract

We have developed a new high-speed driving circuit of a multi-color LED panel by the use of FPGA for subjective super-resolution display. In the subjective super-resolution display, the coded display image is switched and displayed at high speed. The viewer makes an unconscious correction by fixational eye movement and perceives the resolution higher than the physical number of pixels of the LED panel. Our developed LED display drive circuit shows multi-color images at a sufficiently high frame rate enough to perform the subjective super-resolution effect. The maximum frequency is 8.5 kHz for 8 multi-color representations. We have designed spatiotemporal coding to show nine adjacent subpixel information for 9 multi-color subframes. The coded 9 subframes are alternately shown on the LED panel by the use of our developed FPGA circuit. We have verified that the image was updated at high speed. The unconscious correction by the fixational eye movement allows the viewer to perceive a higher resolution than the actual number of LED lamps. Through an evaluation experiment, we have verified that the subjective super-resolution effect was induced in a multi-color image, that is, the displayed image in the proposed method looked smoother than that in the normal display method.

This is a preview of subscription content, access via your institution.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11

References

  1. 1.

    Tokimoto, T., Fujii, K., Morita, S., Yamamoto, H.: A novel super-resolution display technique by use of spatiotemporal coding., pp. 1471–1473 (2018)

  2. 2.

    Tokimoto, T., Tokimoto, S., Fujii, K., Morita, S., Yamamoto, H.: Subjective super-resolution model on coarse high-speed LED display in combination with pseudo fixation eye movements. IEICE Trans. Electron. E102-C(11), 780–788 (2019)

    ADS  Article  Google Scholar 

  3. 3.

    Tokimoto, T., Suyama, S., Yamamoto, H.: 4320-Hz LED display with pulse-width modulation by use of a nonlinear clock. J. Disp. Technol. 12, 1581–1587 (2016)

    ADS  Article  Google Scholar 

  4. 4.

    Farhan, S., Suyama, S., Yamamoto, H.: Message embedded obscure high-frame rate image decodable by waving hand. In: LDC’12, pp. 7–22 (2012)

  5. 5.

    Sato, K., Suyama, S., Yamamoto, H.: Hand-waving decodable steganography by use of 960 Hz LED panel. In: JSAP-OSA Joint Symposia 2013, 17a-D5-2 (2013)

  6. 6.

    Morita, S., Onose, S., Sasaki, M., Yamamoto, H.: Single-pixel imaging on aerial display with AIRR. In: Proceedings of the IDW’17, pp. 958–961 (2017)

  7. 7.

    Morita, S., Tsuji, A., Tokimoto, T., Yamamoto, H.: Single pixel imaging by use of high speed LED display. In: Proceedings of the Academic Conference of the Laser Society, vol. 38, H324pIX06 (2018) (in Japanese)

  8. 8.

    Matsushita, K., Tokimoto, T., Fujii, K., Yamamoto, H.: Variable frame rate LED display for subjective super-resolution. In: IMID2019, P02-102 (2019)

  9. 9.

    Matsushita, K., Tokimoto, T., Fujii, K., Yamamoto, H.: Spatio-temporal LED driving for subjective super-resolution of grayscale images. In: Proceedings of the IDW’19, pp. 1243–1245 (2019)

  10. 10.

    Inagaki, K., Hirata, Y., Usui, S.: A model-based theory on the signal transformation for microsaccade generation. Neural Netw. 24, 990–997 (2011)

    Article  Google Scholar 

  11. 11.

    Kaneko, H.: Fixational eye movement. J. Inst. Image Inf. Telev. Eng. 63, 1538–1539 (2010). (in Japanese)

    Google Scholar 

  12. 12.

    Martinez-Conde, S., Macknik, S.L., Hubel, D.H.: The role of fixational eye movements in visual perception. Nat. Rev. Neurosci. 5, 229–240 (2004)

    Article  Google Scholar 

  13. 13.

    Gu, E., Lee, S.P., Badler, J.B., Badler, N.I.: Eye Movements, Saccades, and Multiparty Conversations. In Data-Driven 3D Facial Animation, pp. 79–97. Springer, London (2007)

    Book  Google Scholar 

  14. 14.

    Tokudome, K., Kohama, T., Kikkawa, S., Yoshida, H.: A mathematical model for reproducing stochastic properties of fixation eye movements. J. Inst. Image Inf. Telev. Eng. 39, 21–24 (2015). (in Japanese)

    Google Scholar 

  15. 15.

    Rucci, M., Poletti, M.: Control and functions of fixational eye movements. Annu. Rev. Vis. Sci. 1, 499–518 (2015)

    Article  Google Scholar 

  16. 16.

    Costela, F.M., Otero-Millan, J., McCamy, M.B., Macknik, S.L., Troncoso, X.G., Jazi, A.N., Crook, S.M., Martinez-Conde, S.: Fixational eye movement correction of blink-induced gaze position errors. PLoS ONE 9(10), PMC4205003 (2014)

    Article  Google Scholar 

  17. 17.

    NTT Technical Journal Editorial Department: Q&A what is fixational eye movement? NTT Tech. J. 16, 60–61 (2004). (in Japanese)

    Google Scholar 

  18. 18.

    Ni, X., Yan, Z., Dan, L., Zhou, Y.: The realization of LED display system based on the embedded. Telkomnika 11(5), 2626–2633 (2013)

    Google Scholar 

  19. 19.

    Kobayashi, T., Tsuji, A., Mizushina, H., Suyama, S., Yamamoto, H.: Development of high-speed LED display system on FPGA. In: Proceedings of the IDW’15, pp. 1336–1337 (2015)

  20. 20.

    Morita, S., Tsuji, A., Tokimoto, T., Yamamoto, H.: Waving-hand steganography embedded in a backlight of an LCD. In: Proceedings of the IDW’18, pp. 1465–1467 (2018)

Download references

Funding

A part of this work was supported by JST, ACCEL (Grant number JPMJAC1601).

Author information

Affiliations

Authors

Corresponding author

Correspondence to Hirotsugu Yamamoto.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and Permissions

About this article

Verify currency and authenticity via CrossMark

Cite this article

Matsushita, K., Tokimoto, T., Tsuji, A. et al. High-speed driving of multi-color LED panel for subjective super-resolution display. Opt Rev 28, 508–515 (2021). https://doi.org/10.1007/s10043-021-00657-5

Download citation

Keywords

  • LED display
  • FPGA
  • Subjective super-resolution
  • Fixational eye movement