ABSTRACT
BACKGROUND
Interpretation of a diagnostic test result requires knowing what proportion of patients with a “similar” result has the condition in question. This information is often not readily available from the medical literature, or may be based on different clinical populations that make it nonapplicable. In certain settings, where correlated screening parameters and diagnostic data are available in electronic medical records, a representation of diagnostic test performance on “patients like my patient” can be obtained.
OBJECTIVE
We sought to integrate patient demographic and physician practice information using a simplified nearest neighbor algorithm. We used this method to illustrate the relationship between tTG IgA test result and duodenal biopsy for celiac disease in a local diagnostic context.
PARTICIPANTS
We used a data set of 1,461 paired tissue transglutaminase (tTG) IgA and definitive duodenal biopsy results from Intermountain Healthcare with data on patient age and ordering physician specialty. This was split into a discovery set of 1,000 and a validation set of 461 paired results.
MAIN MEASURES
Accuracy of the local discovery data set in predicting probability of positive duodenal biopsy and confidence intervals around predicted probability in the test data compared to probabilities of positive biopsy implied from published logistic regression and from published sensitivity and specificity studies.
KEY RESULTS
The near-neighbor method could estimate probability of clinical outcomes with predictive performance equivalent to other methods while adjusting probability estimates and confidence intervals to fit specific clinical situations.
CONCLUSIONS
Data from clinical encounters obtained from electronic medical records can yield prediction estimates that are tailored to the individual patient, local population, and healthcare delivery processes. Local analysis of diagnostic probability may be more clinically meaningful than probabilities inferred from published studies. This local utility may come at the expense of external validity and generalizability.
Similar content being viewed by others
REFERENCES
Leffler DA, Schuppan D. Update on serologic testing in celiac disease. Am J Gastroenterol. 2010;105:2520–4.
Giersiepen K, Lelgemann M, Stuhldreher N, Ronfani L, Husby S, Koletzko S, Korponay-Szabo IR. Accuracy of diagnostic antibody tests for coeliac disease in children: summary of an evidence report. J Pediatr Gastroenterol Nutr. 2012;54:229–41.
Parakkal D, Du H, Semer R, Ehrenpreis ED, Guandalini S. Do gastroenterologists adhere to diagnostic and treatment guidelines for celiac disease? J Clin Gastroenterol. 2012;46:e12–20.
Husby S, Koletzko S, Korponay-Szabo IR, Mearin ML, Phillips A, Shamir R, Troncone R, et al. European Society for Pediatric Gastroenterology, Hepatology, and Nutrition guidelines for the diagnosis of coeliac disease. J Pediatr Gastroenterol Nutr. 2012;54:136–60.
Rozenberg O, Lerner A, Pacht A, Grinberg M, Reginashvili D, Henig C, Barak M. A novel algorithm for the diagnosis of celiac disease and a comprehensive review of celiac disease diagnostics. Clin Rev Allergy Immunol. 2012;42:331–41.
Arguelles-Grande C, Tennyson CA, Lewis SK, Green PH, Bhagat G. Variability in small bowel histopathology reporting between different pathology practice settings: impact on the diagnosis of coeliac disease. J Clin Pathol. 2011;12:12.
Barker CC, Mitton C, Jevon G, Mock T. Can tissue transglutaminase antibody titers replace small-bowel biopsy to diagnose celiac disease in select pediatric populations? Pediatrics. 2005;115:1341–6.
Hopper AD, Hadjivassiliou M, Hurlstone DP, Lobo AJ, McAlindon ME, Egner W, Wild G, et al. What is the role of serologic testing in celiac disease? A prospective, biopsy-confirmed study with economic analysis. Clin Gastroenterol Hepatol. 2008;6:314–20.
Donaldson MR, Book LS, Leiferman KM, Zone JJ, Neuhausen SL. Strongly positive tissue transglutaminase antibodies are associated with Marsh 3 histopathology in adult and pediatric celiac disease. J Clin Gastroenterol. 2008;42:256–60.
Vivas S, Ruiz de Morales JG, Riestra S, Arias L, Fuentes D, Alvarez N, Calleja S, et al. Duodenal biopsy may be avoided when high transglutaminase antibody titers are present. World J Gastroenterol. 2009;15:4775–80.
Elwyn G, Frosch D, Thomson R, Joseph-Williams N, Lloyd A, Kinnersley P, Cording E, et al. Shared decision making: a model for clinical practice. J Gen Intern Med. 2012;27:1361–7. Epub 2012 May 1323.
Legare F, Ratte S, Stacey D, Kryworuchko J, Gravel K, Graham ID, Turcotte S. Interventions for improving the adoption of shared decision making by healthcare professionals. Cochrane Database Syst Rev. 2010:CD006732.
Darrell T, Indyk P, Shakhnarovich G, eds. Nearest-Neighbor Methods in Learning and Vision Theory and Practice. Cambridge: MIT Press; 2005.
Papadopoulos AN, Manolopoulos Y. Nearest Neighbor Search: A Database Perspective. 1st ed. New York: Springer; 2005.
Millard BL, Niepel M, Menden MP, Muhlich JL, Sorger PK. Adaptive informatics for multifactorial and high-content biological data. Nat Methods. 2011;8:487–93. Epub 2011 Apr 2024.
van der Windt DA, Jellema P, Mulder CJ, Kneepkens CM, van der Horst HE. Diagnostic testing for celiac disease among patients with abdominal symptoms: a systematic review. JAMA. 2010;303:1738–46.
Toftedal P, Nielsen C, Madsen JT, Titlestad K, Husby S, Lillevang ST. Positive predictive value of serological diagnostic measures in celiac disease. Clin Chem Lab Med. 2010;48:685–91.
Song Y, Skinner J, Bynum J, Sutherland J, Wennberg JE, Fisher ES. Regional variations in diagnostic practices. N Engl J Med. 2010;363:45–53. Epub 2010 May 2012.
Ravelli A, Villanacci V, Monfredini C, Martinazzi S, Grassi V, Manenti S. How patchy is patchy villous atrophy?: distribution pattern of histological lesions in the duodenum of children with celiac disease. Am J Gastroenterol. 2010;105:2103–10. Epub 2010 Apr 2106.
Hopper AD, Cross SS, Sanders DS. Patchy villous atrophy in adult patients with suspected gluten-sensitive enteropathy: is a multiple duodenal biopsy strategy appropriate? Endoscopy. 2008;40:219–24. Epub 2008 Dec 2005.
Osl M, Ohno-Machado L, Baumgartner C, Tilg B, Dreiseitl S. Improving calibration of logistic regression models by local estimates. AMIA Annu Symp Proc. 2008:535–39.
Jiang X, Osl M, Kim J, Ohno-Machado L. Calibrating predictive model estimates to support personalized medicine. J Am Med Inform Assoc. 2012;19:263–74.
Safran C, Porter D, Lightfoot J, Rury CD, Underhill LH, Bleich HL, Slack WV. ClinQuery: a system for online searching of data in a teaching hospital. Ann Intern Med. 1989;111:751–6.
Safran C, Chute CG. Exploration and exploitation of clinical databases. Int J Biomed Comput. 1995;39:151–6.
Acknowledgements
Funding for this study was provided by the ARUP Institute for Clinical and Experimental Pathology. An abstract based on preliminary data generated for this article was presented at the “Pathology Informatics 2011” meeting in Pittsburgh, PA.
Conflict of Interest
The authors declare that they do not have a conflict of interest.
Author information
Authors and Affiliations
Corresponding author
Electronic supplementary material
Below is the link to the electronic supplementary material.
ESM 1
(DOCX 137 kb)
Rights and permissions
About this article
Cite this article
Shirts, B.H., Bennett, S.T. & Jackson, B.R. Using Patients Like My Patient for Clinical Decision Support: Institution-Specific Probability of Celiac Disease Diagnosis Using Simplified Near-Neighbor Classification. J GEN INTERN MED 28, 1565–1572 (2013). https://doi.org/10.1007/s11606-013-2443-z
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11606-013-2443-z