Skip to main content

Advertisement

SpringerLink
Log in

Human-centered intelligent healthcare: explore how to apply AI to assess cognitive health

  • Regular Paper
  • Published:
CCF Transactions on Pervasive Computing and Interaction Aims and scope Submit manuscript

Abstract

Artificial Intelligence (AI) dramatically alters traditional healthcare and cognition assessment with its power in ubiquitous perception and smart computation. However, the existing research primarily concerns exploring the application areas and improving the recognition accuracy. How to apply AI with suitable and user-acceptable forms to realize cognitive health assessment is still a significant challenge. In this paper, we conduct a series of field studies to research this challenging problem. Specifically, inspired by clinically validated cognition assessment test—Trail Making Test (TMT), we design two variants of TMT for objective quantitative assessment, including camera-based TMT (cTMT) and touchscreen-based TMT (tTMT). Each form of variants provides three different analysis perspectives. We conduct user studies on 268 subjects to verify their effectiveness. Experimental results show that both variants can achieve satisfactory discrimination accuracy by optimizing the assessment model, but different application forms and analysis perspectives can adapt to different users.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9

Similar content being viewed by others

Notes

  1. OpenCV: https://opencv.org/, SmartCropper: https://github.com/pqpo/SmartCropper.

  2. http://www.gjkfyy.com/.

References

  • Abràmoff, M.D., Lavin, P.T., Birch, M., Shah, N., Folk, J.C.: Pivotal trial of an autonomous ai-based diagnostic system for detection of diabetic retinopathy in primary care offices. NPJ Digital Med. 1(1), 1–8 (2018)

    Article  Google Scholar 

  • Arnett, J.A., Labovitz, S.S.: Effect of physical layout in performance of the trail making test. Psychol. Assess. 7(2), 220–221 (1995)

    Article  Google Scholar 

  • Battery, A.I.T.: Manual of Directions and Scoring. War Department, Adjutant General’s Office, Washington, DC (1944)

    Google Scholar 

  • Banaschewski, T., Becker, K., Döpfner, M., Holtmann, M., Rösler, M., Romanos, M.: Attention-deficit/hyperactivity disorder. Deutsches Arzteblatt Int 114(9), 149–159 (2017)

    Google Scholar 

  • Bellec, P., Chu, C., Chouinard-Decorte, F., Benhajali, Y., Margulies, D.S., Craddock, R.C.: The neuro bureau adhd-200 preprocessed repository. Neuroimage 144, 275–286 (2017)

    Article  Google Scholar 

  • Cassidy, B., Stringer, G., Yap, M.H.: Mobile framework for cognitive assessment: Trail making test and reaction time test. In: International Conference on Computer and Information Technology (CIT), pp. 700–705 (2014). IEEE

  • Company, M..: Report: Transforming healthcare with AI. McKinsey & Company (2020)

  • Council, N.R., et al.: The aging mind: Opportunities in cognitive research (2000)

  • Cowen, P., Harrison, P., Burns, T.: Shorter oxford textbook of psychiatry (2012)

  • De Dombal, F., Leaper, D., Staniland, J.R., McCann, A., Horrocks, J.C.: Computer-aided diagnosis of acute abdominal pain. Br Med J 2(5804), 9–13 (1972)

    Article  Google Scholar 

  • Fang, C., Li, C., Cabrerizo, M., Barreto, A., Andrian, J., Loewenstein, D., Duara, R., Adjouadi, M.: A gaussian discriminant analysis-based generative learning algorithm for the early diagnosis of mild cognitive impairment in alzheimer’s disease. In: IEEE International Conference on Bioinformatics and Biomedicine (BIBM), pp. 538–542 (2017). IEEE

  • Filipovych, R., Davatzikos, C., Initiative, A.D.N., et al.: Semi-supervised pattern classification of medical images: application to mild cognitive impairment (mci). NeuroImage 55(3), 1109–1119 (2011)

    Article  Google Scholar 

  • Fouladvand, S., Mielke, M.M., Vassilaki, M., Sauver, J.S., Petersen, R.C., Sohn, S.: Deep learning prediction of mild cognitive impairment using electronic health records. In: IEEE International Conference on Bioinformatics and Biomedicine (BIBM), pp. 799–806 (2019). IEEE

  • Fridman, L., Reimer, B., Mehler, B., Freeman, W.T.: Cognitive load estimation in the wild. In: ACM Conference on Human Factors in Computing Systems (CHI), pp. 1–9 (2018)

  • Gillespie, A., Best, C., O’Neill, B.: Cognitive function and assistive technology for cognition: a review. J. Int. Neuropsychol. Soc. 18(1), 1–19 (2012)

    Article  Google Scholar 

  • Hagler, S., Jimison, H.B., Pavel, M.: Assessing executive function using a computer game: computational modeling of cognitive processes. IEEE J. Biomed. Health Inform. 18(4), 1442–1452 (2014)

    Article  Google Scholar 

  • Hendrie, H.C., Albert, M.S., Butters, M.A., Gao, S., Knopman, D.S., Launer, L.J., Yaffe, K., Cuthbert, B.N., Edwards, E., Wagster, M.V.: The nih cognitive and emotional health project: report of the critical evaluation study committee. Alzheimer’s Dementia 2(1), 12–32 (2006)

    Article  Google Scholar 

  • Kaboodvand, N., Iravani, B., Fransson, P.: Dynamic synergetic configurations of resting-state networks in adhd. NeuroImage 207, 116347 (2020)

    Article  Google Scholar 

  • Kim, K., Jang, J., Baek, M., Kim, S.: A comparison of three types of trail making test in the korean elderly: Higher completion rate of trail making test-black and white for mild cognitive impairment. J Alzheimers Dis Parkinsonism 6(239), 1–6 (2016)

    Google Scholar 

  • Lara-Garduno, R., Leslie, N., Hammond, T.: Smartstrokes: digitizing paper-based neuropsychological tests, 163–175 (2016)

  • Lara-Garduno, R., Igarashi, T., Hammond, T.: 3d-trail-making test: A touch-tablet cognitive test to support intelligent behavioral recognition. In: Graphics Interface, pp. 1–10 (2019)

  • Lunardini, F., Luperto, M., Daniele, K., Basilico, N., Damanti, S., Abbate, C., Mari, D., Cesari, M., Ferrante, S., Borghese, N.A.: Validity of digital trail making test and bells test in elderlies. In: International Conference on Biomedical & Health Informatics (BHI), pp. 1–4 (2019). IEEE

  • Marcano, J.L., Bell, M.A., Beex, A.L.: Classification of adhd and non-adhd subjects using a universal background model. Biomed. Signal Process. Control 39, 204–212 (2018)

    Article  Google Scholar 

  • Mentis, H.M., Madjaroff, G., Massey, A.K.: Upside and downside risk in online security for older adults with mild cognitive impairment. In: Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems, pp. 1–13 (2019)

  • Mesko, B.: A guide to artificial intelligence in health care. Budapest, Hungary: The Medical Futurist. leanpub. com (2017)

  • Mishra, S.R., Klasnja, P., MacDuffie Woodburn, J., Hekler, E.B., Omberg, L., Kellen, M., Mangravite, L.: Supporting coping with parkinson’s disease through self tracking. In: ACM Conference on Human Factors in Computing Systems (CHI), pp. 1–16 (2019)

  • Organization, W.H.: Dementia. https://www.who.int/en/news-room/fact-sheets/detail/dementia. Accessed September 19, 2019 (2019)

  • Organization, W.H., et al.: Global action plan on the public health response to dementia 2017–2025. World Health Organization (2017)

    Google Scholar 

  • Poo, M.-M., Du, J.-L., Ip, N.Y., Xiong, Z.-Q., Xu, B., Tan, T.: China brain project: basic neuroscience, brain diseases, and brain-inspired computing. Neuron 92(3), 591–596 (2016)

    Article  Google Scholar 

  • Park, S.Y., Kuo, P.-Y., Barbarin, A., Kaziunas, E., Chow, A., Singh, K., Wilcox, L., Lasecki, W.S.: Identifying challenges and opportunities in human-ai collaboration in healthcare. In: Conference on Computer Supported Cooperative Work (CSCW), pp. 506–510 (2019)

  • Prange, A., Barz, M., Heimann-Steinert, A., Sonntag, D.: Explainable automatic evaluation of the trail making test for dementia screening. In: ACM Conference on Human Factors in Computing Systems (CHI), pp. 1–9 (2021)

  • Riaz, A., Asad, M., Alonso, E., Slabaugh, G.: Fusion of fmri and non-imaging data for adhd classification. Comput. Med. Imaging Graphi. 65, 115–128 (2018)

    Article  Google Scholar 

  • Riedl, M.O.: Human-centered artificial intelligence and machine learning. Hum. Behav. Emerging Technol 1(1), 33–36 (2019)

    Article  Google Scholar 

  • Sokolova, E., von Rhein, D., Naaijen, J., Groot, P., Claassen, T., Buitelaar, J., Heskes, T.: Handling hybrid and missing data in constraint-based causal discovery to study the etiology of adhd. Int. J. Data Sci. Anal. 3(2), 105–119 (2017)

    Article  Google Scholar 

  • Tian, F., Fan, X., Fan, J., Zhu, Y., Gao, J., Wang, D., Bi, X., Wang, H.: What can gestures tell?: Detecting motor impairment in early parkinson’s from common touch gestural interactions. In: ACM Conference on Human Factors in Computing Systems (CHI), pp. 1–14 (2019)

  • Tonomura, R., Tadamitsu, T., Manji, A., Kubota, N., Obo, T.: Rehabilitation support system for attentional deficits based on trail-making test. In: International Conference on Soft Computing and Intelligent Systems (SCIS), pp. 1127–1132 (2018). IEEE

  • Tang, F., Lin, K., Uchendu, I., Dodge, H.H., Zhou, J.: Improving mild cognitive impairment prediction via reinforcement learning and dialogue simulation. arXiv preprint arXiv:1802.06428 (2018)

  • Tombaugh, T.N.: Trail making test a and b: normative data stratified by age and education. Arch Clin Neuropsychol 19(2), 203–214 (2004)

    Article  Google Scholar 

  • Wang, R.-Y., Zhou, J.-H., Huang, Y.-C., Yang, Y.-R.: Reliability of the chinese version of the trail making test and stroop color and word test among older adults. Int. J. Gerontol. 12(4), 336–339 (2018)

    Article  Google Scholar 

  • Xu, W.: Toward human-centered ai: a perspective from human-computer interaction. Interactions 26(4), 42–46 (2019)

    Article  Google Scholar 

  • Yu, K.-H., Beam, A.L., Kohane, I.S.: Artificial intelligence in healthcare. Nat. Biomed. Eng. 2(10), 719–731 (2018)

    Article  Google Scholar 

  • Yu, H., Yang, X., Chen, Y., Liu, J.: strdoctor: Indicate stroke for elderly through body sensing game. In: International Conference on Ubiquitous Intelligence and Computing (UIC), pp. 360–363 (2015). IEEE Computer Society

  • Yuen, H., Princen, J., Illingworth, J., Kittler, J.: Comparative study of hough transform methods for circle finding. Image Vis. Comput. 8(1), 71–77 (1990)

    Article  Google Scholar 

Download references

Acknowledgements

This work is supported by the National Key R&D Program of China (2018YFC2001700), by the Natural Science Foundation of China under Grant (No.61972383), by the Innovative Research Program of Shandong Academy of Intelligent Computing Technology under (SDAICT2191010).

Author information

Authors and Affiliations

  1. Beijing Key Laboratory of Mobile Computing and Pervasive Devices, Institute of Computing Technology, CAS, Beijing, 100190, China

    Yingwei Zhang, Yiqiang Chen & Weiwen Yang

  2. University of Chinese Academy of Sciences, Beijing, 100190, China

    Yingwei Zhang, Yiqiang Chen & Weiwen Yang

  3. Peng Cheng Laboratory, Shenzhen, 518055, China

    Yiqiang Chen

  4. Bureau of Frontier Sciences and Education, CAS, Beijing, 100045, China

    Hanchao Yu

  5. Beijing Key Laboratory of Rehabilitation Technical Aids for Old-Age Disability, National Research Center for Rehabilitation Technical Aids, Beijing, 100176, China

    Zeping Lv

Authors
  1. Yingwei Zhang
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Yiqiang Chen
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Weiwen Yang
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Hanchao Yu
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Zeping Lv
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Yiqiang Chen.

Ethics declarations

Conflict of interest

The authors declare they have no financial interests.

No-financial interests

Author Yiqiang Chen is one of the associate editors of “CCF Transactions on Pervasive Computing and Interaction”.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Zhang, Y., Chen, Y., Yang, W. et al. Human-centered intelligent healthcare: explore how to apply AI to assess cognitive health. CCF Trans. Pervasive Comp. Interact. 4, 189–206 (2022). https://doi.org/10.1007/s42486-022-00102-9

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s42486-022-00102-9

Keywords

Search

Navigation