Skip to main content

Advertisement

Log in

Using Patients Like My Patient for Clinical Decision Support: Institution-Specific Probability of Celiac Disease Diagnosis Using Simplified Near-Neighbor Classification

  • Original Research
  • Published:
Journal of General Internal Medicine Aims and scope Submit manuscript

ABSTRACT

BACKGROUND

Interpretation of a diagnostic test result requires knowing what proportion of patients with a “similar” result has the condition in question. This information is often not readily available from the medical literature, or may be based on different clinical populations that make it nonapplicable. In certain settings, where correlated screening parameters and diagnostic data are available in electronic medical records, a representation of diagnostic test performance on “patients like my patient” can be obtained.

OBJECTIVE

We sought to integrate patient demographic and physician practice information using a simplified nearest neighbor algorithm. We used this method to illustrate the relationship between tTG IgA test result and duodenal biopsy for celiac disease in a local diagnostic context.

PARTICIPANTS

We used a data set of 1,461 paired tissue transglutaminase (tTG) IgA and definitive duodenal biopsy results from Intermountain Healthcare with data on patient age and ordering physician specialty. This was split into a discovery set of 1,000 and a validation set of 461 paired results.

MAIN MEASURES

Accuracy of the local discovery data set in predicting probability of positive duodenal biopsy and confidence intervals around predicted probability in the test data compared to probabilities of positive biopsy implied from published logistic regression and from published sensitivity and specificity studies.

KEY RESULTS

The near-neighbor method could estimate probability of clinical outcomes with predictive performance equivalent to other methods while adjusting probability estimates and confidence intervals to fit specific clinical situations.

CONCLUSIONS

Data from clinical encounters obtained from electronic medical records can yield prediction estimates that are tailored to the individual patient, local population, and healthcare delivery processes. Local analysis of diagnostic probability may be more clinically meaningful than probabilities inferred from published studies. This local utility may come at the expense of external validity and generalizability.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Figure 1.
Figure 2.
Figure 3.
Figure 4.
Figure 5.

Similar content being viewed by others

REFERENCES

  1. Leffler DA, Schuppan D. Update on serologic testing in celiac disease. Am J Gastroenterol. 2010;105:2520–4.

    Article  PubMed  Google Scholar 

  2. Giersiepen K, Lelgemann M, Stuhldreher N, Ronfani L, Husby S, Koletzko S, Korponay-Szabo IR. Accuracy of diagnostic antibody tests for coeliac disease in children: summary of an evidence report. J Pediatr Gastroenterol Nutr. 2012;54:229–41.

    Article  PubMed  CAS  Google Scholar 

  3. Parakkal D, Du H, Semer R, Ehrenpreis ED, Guandalini S. Do gastroenterologists adhere to diagnostic and treatment guidelines for celiac disease? J Clin Gastroenterol. 2012;46:e12–20.

    Article  PubMed  Google Scholar 

  4. Husby S, Koletzko S, Korponay-Szabo IR, Mearin ML, Phillips A, Shamir R, Troncone R, et al. European Society for Pediatric Gastroenterology, Hepatology, and Nutrition guidelines for the diagnosis of coeliac disease. J Pediatr Gastroenterol Nutr. 2012;54:136–60.

    Article  PubMed  CAS  Google Scholar 

  5. Rozenberg O, Lerner A, Pacht A, Grinberg M, Reginashvili D, Henig C, Barak M. A novel algorithm for the diagnosis of celiac disease and a comprehensive review of celiac disease diagnostics. Clin Rev Allergy Immunol. 2012;42:331–41.

    Article  PubMed  CAS  Google Scholar 

  6. Arguelles-Grande C, Tennyson CA, Lewis SK, Green PH, Bhagat G. Variability in small bowel histopathology reporting between different pathology practice settings: impact on the diagnosis of coeliac disease. J Clin Pathol. 2011;12:12.

    Google Scholar 

  7. Barker CC, Mitton C, Jevon G, Mock T. Can tissue transglutaminase antibody titers replace small-bowel biopsy to diagnose celiac disease in select pediatric populations? Pediatrics. 2005;115:1341–6.

    Article  PubMed  Google Scholar 

  8. Hopper AD, Hadjivassiliou M, Hurlstone DP, Lobo AJ, McAlindon ME, Egner W, Wild G, et al. What is the role of serologic testing in celiac disease? A prospective, biopsy-confirmed study with economic analysis. Clin Gastroenterol Hepatol. 2008;6:314–20.

    Article  PubMed  Google Scholar 

  9. Donaldson MR, Book LS, Leiferman KM, Zone JJ, Neuhausen SL. Strongly positive tissue transglutaminase antibodies are associated with Marsh 3 histopathology in adult and pediatric celiac disease. J Clin Gastroenterol. 2008;42:256–60.

    PubMed  CAS  Google Scholar 

  10. Vivas S, Ruiz de Morales JG, Riestra S, Arias L, Fuentes D, Alvarez N, Calleja S, et al. Duodenal biopsy may be avoided when high transglutaminase antibody titers are present. World J Gastroenterol. 2009;15:4775–80.

    Article  PubMed  CAS  Google Scholar 

  11. Elwyn G, Frosch D, Thomson R, Joseph-Williams N, Lloyd A, Kinnersley P, Cording E, et al. Shared decision making: a model for clinical practice. J Gen Intern Med. 2012;27:1361–7. Epub 2012 May 1323.

    Article  PubMed  Google Scholar 

  12. Legare F, Ratte S, Stacey D, Kryworuchko J, Gravel K, Graham ID, Turcotte S. Interventions for improving the adoption of shared decision making by healthcare professionals. Cochrane Database Syst Rev. 2010:CD006732.

  13. Darrell T, Indyk P, Shakhnarovich G, eds. Nearest-Neighbor Methods in Learning and Vision Theory and Practice. Cambridge: MIT Press; 2005.

    Google Scholar 

  14. Papadopoulos AN, Manolopoulos Y. Nearest Neighbor Search: A Database Perspective. 1st ed. New York: Springer; 2005.

    Google Scholar 

  15. Millard BL, Niepel M, Menden MP, Muhlich JL, Sorger PK. Adaptive informatics for multifactorial and high-content biological data. Nat Methods. 2011;8:487–93. Epub 2011 Apr 2024.

    Article  PubMed  CAS  Google Scholar 

  16. van der Windt DA, Jellema P, Mulder CJ, Kneepkens CM, van der Horst HE. Diagnostic testing for celiac disease among patients with abdominal symptoms: a systematic review. JAMA. 2010;303:1738–46.

    Article  PubMed  Google Scholar 

  17. Toftedal P, Nielsen C, Madsen JT, Titlestad K, Husby S, Lillevang ST. Positive predictive value of serological diagnostic measures in celiac disease. Clin Chem Lab Med. 2010;48:685–91.

    Article  PubMed  CAS  Google Scholar 

  18. Song Y, Skinner J, Bynum J, Sutherland J, Wennberg JE, Fisher ES. Regional variations in diagnostic practices. N Engl J Med. 2010;363:45–53. Epub 2010 May 2012.

    Article  PubMed  CAS  Google Scholar 

  19. Ravelli A, Villanacci V, Monfredini C, Martinazzi S, Grassi V, Manenti S. How patchy is patchy villous atrophy?: distribution pattern of histological lesions in the duodenum of children with celiac disease. Am J Gastroenterol. 2010;105:2103–10. Epub 2010 Apr 2106.

    Article  PubMed  Google Scholar 

  20. Hopper AD, Cross SS, Sanders DS. Patchy villous atrophy in adult patients with suspected gluten-sensitive enteropathy: is a multiple duodenal biopsy strategy appropriate? Endoscopy. 2008;40:219–24. Epub 2008 Dec 2005.

    Article  PubMed  CAS  Google Scholar 

  21. Osl M, Ohno-Machado L, Baumgartner C, Tilg B, Dreiseitl S. Improving calibration of logistic regression models by local estimates. AMIA Annu Symp Proc. 2008:535–39.

  22. Jiang X, Osl M, Kim J, Ohno-Machado L. Calibrating predictive model estimates to support personalized medicine. J Am Med Inform Assoc. 2012;19:263–74.

    Article  PubMed  Google Scholar 

  23. Safran C, Porter D, Lightfoot J, Rury CD, Underhill LH, Bleich HL, Slack WV. ClinQuery: a system for online searching of data in a teaching hospital. Ann Intern Med. 1989;111:751–6.

    Article  PubMed  CAS  Google Scholar 

  24. Safran C, Chute CG. Exploration and exploitation of clinical databases. Int J Biomed Comput. 1995;39:151–6.

    Article  PubMed  CAS  Google Scholar 

Download references

Acknowledgements

Funding for this study was provided by the ARUP Institute for Clinical and Experimental Pathology. An abstract based on preliminary data generated for this article was presented at the “Pathology Informatics 2011” meeting in Pittsburgh, PA.

Conflict of Interest

The authors declare that they do not have a conflict of interest.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Brian H. Shirts MD, PhD.

Electronic supplementary material

Below is the link to the electronic supplementary material.

ESM 1

(DOCX 137 kb)

Rights and permissions

Reprints and permissions

About this article

Cite this article

Shirts, B.H., Bennett, S.T. & Jackson, B.R. Using Patients Like My Patient for Clinical Decision Support: Institution-Specific Probability of Celiac Disease Diagnosis Using Simplified Near-Neighbor Classification. J GEN INTERN MED 28, 1565–1572 (2013). https://doi.org/10.1007/s11606-013-2443-z

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11606-013-2443-z

KEY WORDS

Navigation