Advertisement

Springer Nature is making Coronavirus research free. View research | View latest news | Sign up for updates

Smartphone Image Receiver Architecture for Optical Camera Communication

  • 381 Accesses

  • 2 Citations

Abstract

As an extension of visible light communications (VLC), optical camera communications (OCC) are poised to play an important role in the success of VLC technology. Comparing with VLC systems based on photodiodes, OCC systems have a number of advantages in terms of hardware, communications channels, and business trends. However, these systems also have several disadvantages, such as limitations on the data rate, the need for synchronization between the transmitter and receiver, and inter-channel interference. These issues are a result of limitations in the camera sampling rates, frame rate variations, and motion stabilization. To address these limitations, we propose a new image sensor architecture for smartphone-based OCC that incorporates three primary functions: motion stabilization, frame rate control, and auto-exposure control. First, the motion stabilization function combines image sensor data and gyroscope motion information in order to select accurate pixel data. Second, the frame rate control function increases the frame rate using an over-scan scheme and contributes to the data throughput and motion compensation in the time domain. Finally, we control both the auto-exposure and focus functions in order to avoid blurring effects and variations in the frame rate. Experiments show that the proposed receiver architecture with adaptive frame rates and motion stabilization holds great promise for OCC.

This is a preview of subscription content, log in to check access.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14
Fig. 15
Fig. 16
Fig. 17
Fig. 18
Fig. 19
Fig. 20

References

  1. 1.

    IEEE (2011). 802.15.7 Standard for local and metropolitan area networks. Part 15.7: Short-range wireless optical communication using visible light.

  2. 2.

    Saha, N., Ifthekhar, M. S., Le, N. T., & Jang, Y. M. (2015). Survey on optical camera communications: Challenges and opportunities. IET Optoelectronics, 9(5), 172–183.

  3. 3.

    Le, N.-T., & Jang, Y. M. (2015). Resource allocation for multichannel broadcasting visible light communication. Optics Communications, 355, 451–461.

  4. 4.

    Le, N.-T., & Jang, Y. M. (2015). Smart color channel allocation for visible light communication cell ID. Optical Switching and Networking, 15, 75–86.

  5. 5.

    Pathak, P. H., Feng, X., Hu, P., & Mohapatra, P. (2015). Visible light communication, networking, and sensing: A survey, potential and challenges. IEEE Communications Surveys & Tutorials, 17(4), 2047–2077.

  6. 6.

    Lee, S. H., Jung, S.-Y., & Kwon, J. K. (2015). Modulation and coding for dimmable visible light communication. IEEE Communications Magazine, 53(2), 136–143.

  7. 7.

    Afgani, M., Haas, H., Elgala, H., & Knipp, D. (2006). Visible light communication using OFDM. In Proceedings of the 2nd international conference on TRIDENTCOM, pp 129–134.

  8. 8.

    Technical Considerations Document. (2015). IEEE.15.7r1.

  9. 9.

    Roberts, R. D. (2013). Undersampled frequency shift ON–OFF keying (UFSOOK) for camera communication (CamCom). In Proceedings of wireless and optical communications conference, pp. 645–648.

  10. 10.

    Danakis, C., Afganim, M., Povey, G., Underwood, I., & Haas, H. (2012). Using a CMOS camera sensor for visible light communication. In Proceedings of the 3rd IEEE workshop on optical wireless communications, pp. 1244–1248.

  11. 11.

    Rolling Shutter vs. Global Shutter. (2014). Technical note. www.qimaging.com.

  12. 12.

    Luo, P., Ghassemlooy, Z., Minh., H. L., Tang, X., & Tsai, H.-M. (2014). Undersampled phase shift ON–OFF keying for camera communication. In Proceedings of the 6th internationa’l conference on wireless communications and signal process, pp. 1–6.

  13. 13.

    Rajagopal, N., Lazik, P., & Rowe, A. (2014). Hybrid visible light communication for cameras and low-power embedded devices. In Proceedings of the 1st ACM MobiCom workshop on VLC syst, pp. 33–38.

  14. 14.

    Cha, J.-S., & Jung S.-H. (2015). Position information acquisition method based on LED lights and smart device camera using 3-axis moving distance measurement. Journal of Korean Institute of Communications and Information and Sciences, 40(1), 226–232.

  15. 15.

    Kim, Y. S. (2015). Analysis and understanding of smartphone key components. Textbook of Sungkyunkwan University, p. 2.

  16. 16.

    Joshi, N., Kang, S.-B., Zitnick C. L., & Szeliski, R. (2010). Image deblurring using inertial measurement sensors. ACM Transactions on Graphics, pp. 1–9.

  17. 17.

    Cho, S., & Lee, S. (2009). Fast motion deblurring. ACM Transactions on Graphics, 28(5), 1–8.

  18. 18.

    Moon Y. S., & Lee, S. H. (2013). A new fusion-based low light still-shot stabilization. In Proceedings of multimedia content and mobile devices.

  19. 19.

    Zhen, R., & Stevenson, R. L. (2014). Motion blue kernel estimation using noisy inertial data. In: Proceedings of IEEE international conference on image, pp. 4602–4606.

  20. 20.

    Raskar, R., Agrawal, A., & Tumblin, J. (2006). Coded exposure photography: Motion deblurring using fluttered shutter. ACM Transactions on Graphics, 25(3), 795–804.

  21. 21.

    Jia, C., & Evans, B. L. (2014). Online calibration and synchronization of cellphone camera and gyroscope. IEEE Transactions on Image Processing, 23(12), 5070–5081.

  22. 22.

    Nikolic, J., Rehder, J., Burri, M., Gohl, P., Leutenegger, S., Furgale P. T., & Siegwart, R. (2014). A synchronized visual-inertial sensor system with FPGA pre-processing for accurate real-time SLAM. In Proceedings of IEEE international conference on robotics and automation, pp. 431–437.

Download references

Author information

Correspondence to Jong Tae Kim.

Rights and permissions

Reprints and Permissions

About this article

Verify currency and authenticity via CrossMark

Cite this article

Bae, J., Le, N.T. & Kim, J.T. Smartphone Image Receiver Architecture for Optical Camera Communication. Wireless Pers Commun 93, 1043–1066 (2017). https://doi.org/10.1007/s11277-017-3971-3

Download citation

Keywords

  • Optical camera communication
  • Motion stabilization
  • Camera frame rate
  • Image sensor communication
  • Visible light communication