Abstract
The number of nearsighted young people grows rapidly because of over-use of eyes, and it becomes a wide health problem in the world. Efficient vision monitoring methods are required to determine whether people are getting nearsightedness problem in the early stages so as to take further treatment. Current technologies for vision examination are usually either expensive or time costly. This paper proposes a nearsightedness monitoring system, which exploits the widely used smartphones to detect the deterioration of nearsightedness by monitoring and analyzing the the distance between the eyes and the smartphone screen. The detection process is implicit since the system is implemented on the daily used phones and people do not have to be interrupted frequently. The proposed system consists of two key components: activity recognition component and the eye detecting component. The activity recognition component is used to determine whether a person is watching the phone. Once a person is watching the phone, the eye detecting component can be triggered to take a picture using the front camera and localize the two eyes. The distance between eyes and the screen is estimated by the ratio of the two-eye distance in the picture and the width of the picture. This paper uses the 3-axis acceleration sensor and the front camera which are equipped on most of the smartphones for activity recognition and eye detection respectively. A prototype has been developed in order to evaluate the effectiveness of the system under various environmental conditions. From more than half year monitoring period which consisted of about 20 volunteers, we were able to accurately detect the degradation of nearsightedness in two volunteers.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Baek, S.-J., Choi, K., Ma, C., Kim, Y.-H., Ko, S.-J.: Eyeball model-based iris center localization for visible image-based eye-gaze tracking systems. Consumer Electron. IEEE Trans. 59(2), 415–421 (2013)
Breunig, M.M., Kriegel, H.-P., Ng, R.T., and Sander, J. Lof: Identifying density-based local outliers. In: Proceedings of the 2000 ACM SIGMOD International Conference: on Management of Data, SIGMOD’00, pp. 93–104, New York, NY, USA. ACM (2000)
Cheng, S., Cai, Z., Li, J.: Curve query processing in wireless sensor networks. IEEE Trans. Vehicular Technol. 64(11), 5198–5209 (2015)
Cheng, S., Cai, Z., Li, J., Gao, H.: Extracting kernel dataset from big sensory data in wireless sensor networks. IEEE Trans. Knowl. Data Eng. 99, 1 (2017)
Coviltir, V., Burcel, M., Cherecheanu, A.P., Ionescu, C., Dascalescu, D., Potop, V., Burcea, M.: Update on myopia risk factors and microenvironmental changes. J. Ophthalmol. 2019, 4960852 (2019). https://doi.org/10.1155/2019/4960852
Duffy, W., Curran, K., Kelly, D., Lunney, T.: An investigation into smartphone based weakly supervised activity recognition systems. Pervasive Mob. Comput. 56, 45–56 (2019)
Elahi, H.M., Islam, D., Ahmed, I., Kobashi, S., and Ahad, M.A .R.: Webcam-based accurate eye-central localization. In: Robot, Vision and Signal Processing (RVSP), 2013 Second International Conference on, pp. 47–50 (2013)
Gani, M.O., Fayezeen, T., Povinelli, R.J., Smith, R.O., Arif, M., Kattan, A.J., Ahamed, S.I.: A light weight smartphone based human activity recognition system with high accuracy. J. Netw. Comput. Appl. 141, 59–72 (2019)
Jamal, N., Cooper, J., Schulman, E.: Current status on the development and treatment of myopia. Optom. Vis. Sci. 83(5), 179–199 (2012)
Kahn, J.H., Robinett, D.A.: The physical examination of the eye. Emerg. Med. Clin. N. Am. 26, 1–16 (2008)
Kumar, A., Zhou, Y.: Human identification using finger images. IEEE Trans. Image Process. 21(4), 2228–2244 (2012)
Kwapisz, J.R., Weiss, G.M., Moore, S.A.: Activity recognition using cell phone accelerometers. SIGKDD Explor. Newsl. 12(2), 74–82 (2011)
Leshno, A., Farzavandi, S.K., de Liaño, R.G., Sprunger, D.T., Wygnanski-Jaffe, T., Mezer, E.: Practice patterns to decrease myopia progression differ among paediatric ophthalmologists around the world. Br. J. Ophthalmol. 104(4), 535–540 (2020)
Li, H., Lin, Z., Brandt, J., Shen, X., and Hua, G.: Efficient boosted exemplar-based face detection. In: Computer Vision and Pattern Recognition (CVPR), 2014 IEEE Conference on (2014)
Lin, B., Liao, X., Department of Ophthalmology: Department of Ophthalmology: Study on the influencing factors and prevention measures of Juvenile Myopia in China. China Health Standard Manag. 8(20), 1–2 (2017)
Monger, L.J., Wilkins, A.J., Allen, P.M.: Identifying visual stress during a routine eye examination. J. Optometry 8(2), 140–145 (2015)
Nweke, H.F., Teh, Y.W., Mujtaba, G., Al-Garadi, M.A.: Data fusion and multiple classifier systems for human activity detection and health monitoring. Information fusion. Rev. Open Res. Directions 46, 147–170 (2019)
Saw, S.M., Katz, J., Schein, O.D., Chew, S.J., Chan, T.K.: Epidemiology of myopia. Epidemiol. Rev. 18(2), 175–187 (1996)
Shen, X., Lin, Z., Brandt, J., and Wu, Y.: Detecting and aligning faces by image retrieval. In: Computer Vision and Pattern Recognition (CVPR), 2013 IEEE Conference on, pp. 3460–3467 (2013)
Smith, M.J., Walline, J.J.: Controlling myopia progression in children and adolescents. Adolesc. Health Med. Therap. 6, 133–140 (2015)
Stainer, M.J., Anderson, A.J., Denniss, J.: Examination strategies of experienced and novice clinicians viewing the retina. Ophthalm. Physiol. Opt. 35(4), 424–432 (2015)
Tokoro, T.: Criteria for diagnosis of pathologic myopia. Atlas of Posterior Fundus Changes in Pathologic Myopia, pp. 1–23. Springer, Japan (1998). https://doi.org/10.1007/978-4-431-67951-6_1
Wan, S., Qi, L., Xiaolong, X., Tong, C., Zonghua, G.: Deep learning models for real-time human activity recognition with smartphones. Mob. Netw. Appl. 25, 743–755 (2020)
Zeng, M., Le Nguyen, T., Yu, B., Mengshoel, O.J., Zhu, J., Wu, P., and Zhang, J.: Convolutional neural networks for human activity recognition using mobile sensors. In: International Conference on Mobile Computing, Applications and Services, pp. 197–205 (2015)
Acknowledgements
This work was supported in part by National Natural Science Foundation of China under Grant nos. 62061146001, 61972083, 61632008, National Key Research & Development Program of China under Grant 2019YFB210220, 2018YFB2100300, Key Laboratory of Computer Network and Information Integration of Ministry of Education of China under Grant no. 93K-9, Jiangsu Provincial Key Laboratory of Network and Information Security under Grant no. BM2003201 and Collaborative Innovation Center of Novel Software Technology and Industrialization, Jiangsu Provincial Scientific and Technological Achievements Transfer Fund under Grant no. BA2016052.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Fang, X., Wu, W., Bi, R. et al. A system to monitor one’s nearsightedness implicitly. CCF Trans. Pervasive Comp. Interact. 3, 223–234 (2021). https://doi.org/10.1007/s42486-021-00065-3
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s42486-021-00065-3