Advertisement

Endocrine

, Volume 53, Issue 3, pp 651–661 | Cite as

Diagnostic accuracy of ultrasound-guided fine needle aspiration biopsy for thyroid malignancy: systematic review and meta-analysis

  • Naykky Singh Ospina
  • Juan P. Brito
  • Spyridoula Maraka
  • Ana E. Espinosa de Ycaza
  • Rene Rodriguez-Gutierrez
  • Michael R. Gionfriddo
  • Ana Castaneda-Guarderas
  • Khalid Benkhadra
  • Alaa Al Nofal
  • Patricia Erwin
  • John C. Morris
  • M. Regina Castro
  • Victor M. Montori
Meta-Analysis

Abstract

Purpose

To systematically appraise and summarize the available evidence about the diagnostic accuracy of ultrasound-guided fine needle aspiration biopsy (USFNA) for thyroid malignancy, and to explore the integration of these estimates with the probability of thyroid malignancy before USFNA.

Methods

A comprehensive search of multiple databases from each database’s inception to August 2014 was performed. Eligible studies included those that evaluated patients with thyroid nodules who underwent USFNA and subsequent evaluation by histopathology or long-term follow-up.

Results

We identified 32 studies at moderate risk of bias evaluating the USFNA diagnostic characteristics for the diagnosis of thyroid malignancy. Results were imprecise and inconsistent across trials. The pooled likelihood ratio (LR) of thyroid malignancy for a benign USFNA result was 0.09 (95 % CI 0.06, 0.14; I 2 = 33 %), whereas the pooled LR for a malignant result was 197 (95 % CI, 68, 569; I 2 = 77 %). In the case of a suspicious for follicular neoplasm result, the pooled LR for malignancy was 0.6 (95 % CI, 0.4, 1.0; I 2 = 84 %) and 8.3 (95 % CI, 3.6, 19.2; I 2 = 89) for a result of suspicious for malignancy.

Conclusion

The available evidence regarding the diagnostic accuracy of USFNA warrants only limited confidence due to risk of bias, imprecision, and inconsistency. However, some USFNA results (benign, malignant) are likely very helpful, by significantly changing the pre-test probability of thyroid cancer.

Keywords

Thyroid nodule Thyroid cancer Ultrasound-guided fine needle aspiration biopsy Diagnosis 

Notes

Acknowledgments

We would like to thank Choon-Chern (Mike) Lim for the development of the online calculator.

Authors’ contributions

NSO, JPB, SM, and VMM designed the study, served as overall principal investigators, and wrote and reviewed the manuscript. AEY, RRG, MRG, ACG, KB, AAN, PE, JM, RMC helped design the study, wrote, and made a critical review of the manuscript, and assisted in data collection. All authors read and approved the final manuscript.

Compliance with ethical standards

Conflict of interests

The authors have no conflict of interests.

Financial support

MRG was supported by CTSA Grant Number TL1 TR000137 from the National Center for Advancing Translational Science (NCATS). The contents of this manuscript are solely the responsibility of the authors and do not necessarily represent the official views of the NIH.

This publication was made possible by CTSA Grant Number UL1 TR000135 from the National Center for Advancing Translational Sciences (NCATS), a component of the National Institutes of Health (NIH). Its contents are solely the responsibility of the authors and do not necessarily represent the official view of NIH.

Supplementary material

12020_2016_921_MOESM1_ESM.docx (20 kb)
Supplementary material 1 (DOCX 19 kb)
12020_2016_921_MOESM2_ESM.docx (13 kb)
Supplementary material 2 (DOCX 13 kb)

References

  1. 1.
    S. Ezzat, D.A. Sarti, D.R. Cain, G.D. Braunstein, Thyroid incidentalomas. Prevalence by palpation and ultrasonography. Arch. Intern. Med. 154(16), 1838–1840 (1994)CrossRefPubMedGoogle Scholar
  2. 2.
    J.J. Cronan, Thyroid nodules: is it time to turn off the US machines? Radiology 247(3), 602–604 (2008). doi: 10.1148/radiol.2473072233 CrossRefPubMedGoogle Scholar
  3. 3.
    J.P. Brito, J.C. Morris, V.M. Montori, Thyroid cancer: zealous imaging has increased detection and treatment of low risk tumours. BMJ 347, f4706 (2013). doi: 10.1136/bmj.f4706 CrossRefPubMedGoogle Scholar
  4. 4.
    J.A. Sosa, J.W. Hanna, K.A. Robinson, R.B. Lanman, Increases in thyroid nodule fine-needle aspirations, operations, and diagnoses of thyroid cancer in the United States. Surgery 154(6), 1420–1426 (2014). doi: 10.1016/j.surg.2013.07.006 CrossRefGoogle Scholar
  5. 5.
    J.P. Brito, I.D. Hay, J.C. Morris, Low risk papillary thyroid cancer. Bmj 348, g3045 (2014). doi: 10.1136/bmj.g3045 CrossRefPubMedGoogle Scholar
  6. 6.
    P. Campanella, F. Ianni, C.A. Rota, S.M. Corsello, A. Pontecorvi, Quantification of cancer risk of each clinical and ultrasonographic suspicious feature of thyroid nodules: a systematic review and meta-analysis. Eur. J. Endocrinol. 170(5), R203–211 (2014). doi: 10.1530/EJE-13-0995 CrossRefPubMedGoogle Scholar
  7. 7.
    R. Smith-Bindman, P. Lebda, V.A. Feldstein, D. Sellami, R.B. Goldstein, N. Brasic, C. Jin, J. Kornak, Risk of thyroid cancer based on thyroid ultrasound imaging characteristics: results of a population-based study. JAMA Intern. Med. 173(19), 1788–1796 (2013). doi: 10.1001/jamainternmed.2013.9245 CrossRefPubMedPubMedCentralGoogle Scholar
  8. 8.
    A. Al Nofal, M.R. Gionfriddo, A. Javed, Q. Haydour, J.P. Prokop, S.T. Pittock, M.H. Murad, Accuracy of thyroid nodule sonography for the detection of thyroid cancer in children: systematic review and meta-analysis. Clin. Endocrinol. (Oxf) (2015). doi: 10.1111/cen.12786 Google Scholar
  9. 9.
    J.P. Brito, A.J. Yarur, L.J. Prokop, B. McIver, M.H. Murad, V.M. Montori, Prevalence of thyroid cancer in multinodular goiter versus single nodule: a systematic review and meta-analysis. Thyroid 23(4), 449–455 (2013). doi: 10.1089/thy.2012.0156 CrossRefPubMedGoogle Scholar
  10. 10.
    B.R.M. Haugen, E.K. Alexander, K.C. Bible, G. Doherty, S.J. Mandel, Y.E. Nikiforov, F. Pacini, G. Randolph, A. Sawka, M. Schlumberger, K.G. Schuff, S.I. Sherman, J.A. Sosa, D. Steward, R.M.M. Tuttle, L. Wartofsky, 2015 American Thyroid Association Management guidelines for adult patients with thyroid nodules and differentiated thyroid cancer. Thyroid (2015). doi: 10.1089/thy.2015.0020 PubMedCentralGoogle Scholar
  11. 11.
    M. Bongiovanni, A. Spitale, W.C. Faquin, L. Mazzucchelli, Z.W. Baloch, The Bethesda system for reporting thyroid cytopathology: a meta-analysis. Acta. Cytol. 56(4), 333–339 (2012). doi: 10.1159/000339959 CrossRefPubMedGoogle Scholar
  12. 12.
    C.C. Wang, L. Friedman, G.C. Kennedy, H. Wang, E. Kebebew, D.L. Steward, M.A. Zeiger, W.H. Westra, Y. Wang, E. Khanafshar, G. Fellegara, J. Rosai, V. Livolsi, R.B. Lanman, A large multicenter correlation study of thyroid nodule cytopathology and histopathology. Thyroid 21(3), 243–251 (2011). doi: 10.1089/thy.2010.0243 CrossRefPubMedPubMedCentralGoogle Scholar
  13. 13.
    D. Moher, A. Liberati, J. Tetzlaff, D.G. Altman, Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. J. Clin. Epidemiol. 62(10), 1006–1012 (2009). doi: 10.1016/j.jclinepi.2009.06.005 CrossRefPubMedGoogle Scholar
  14. 14.
    E.S. Cibas, S.Z. Ali, The Bethesda system for reporting thyroid cytopathology. Thyroid 19(11), 1159–1165 (2009). doi: 10.1089/thy.2009.0274 CrossRefPubMedGoogle Scholar
  15. 15.
    P. Perros, K. Boelaert, S. Colley, C. Evans, R.M. Evans, G. Gerrard Ba, J. Gilbert, B. Harrison, S.J. Johnson, T.E. Giles, L. Moss, V. Lewington, K. Newbold, J. Taylor, R.V. Thakker, J. Watkinson, G.R. Williams, Guidelines for the management of thyroid cancer. Clin. Endocrinol. (Oxf) 81(Suppl 1), 1–122 (2014). doi: 10.1111/cen.12515 CrossRefGoogle Scholar
  16. 16.
    S. McGee, Simplifying likelihood ratios. J. Gen. Intern. Med. 17(8), 646–649 (2002)CrossRefPubMedGoogle Scholar
  17. 17.
    T.S. Furukawa, H. Bucher, T. Agoritsas, G. Guyatt, in Diagnostic Tests, ed. by G.D. Guyatt, M. Meade, D. Cook. User’s Guides to the Medical Literature: A munal for Evidence Based Clinical Practive, vol. 3 (McGraw hill, 2014), p. 345–357Google Scholar
  18. 18.
    M.B. Elamin, M.H. Murad, R. Mullan, D. Erickson, K. Harris, S. Nadeem, R. Ennis, P.J. Erwin, V.M. Montori, Accuracy of diagnostic tests for Cushing’s syndrome: a systematic review and metaanalyses. J. Clin. Endocrinol. Metab. 93(5), 1553–1562 (2008). doi: 10.1210/jc.2008-0139 CrossRefPubMedGoogle Scholar
  19. 19.
    S. Schueler, G.M. Schuetz, M. Dewey, The revised QUADAS-2 tool. Ann. Intern. Med. 156(4), 323–324 (2012). doi: 10.7326/0003-4819-156-4-201202210-00018 CrossRefPubMedGoogle Scholar
  20. 20.
    P.F. Whiting, A.W. Rutjes, M.E. Westwood, S. Mallett, J.J. Deeks, J.B. Reitsma, M.M. Leeflang, J.A. Sterne, P.M. Bossuyt, QUADAS-2: a revised tool for the quality assessment of diagnostic accuracy studies. Ann. Intern. Med. 155(8), 529–536 (2011). doi: 10.7326/0003-4819-155-8-201110180-00009 CrossRefPubMedGoogle Scholar
  21. 21.
    J. Zamora, V. Abraira, A. Muriel, K. Khan, A. Coomarasamy, Meta-DiSc: a software for meta-analysis of test accuracy data. BMC Med. Res. Methodol. 6, 31 (2006). doi: 10.1186/1471-2288-6-31 CrossRefPubMedPubMedCentralGoogle Scholar
  22. 22.
    Review Manager (RevMan) [Computer program]. in Copenhagen: the Nordic Cochrane Centre, The Cochrane Collaboration, (2014)Google Scholar
  23. 23.
    J.P. Higgins, S.G. Thompson, J.J. Deeks, D.G. Altman, Measuring inconsistency in meta-analyses. Bmj 327(7414), 557–560 (2003). doi: 10.1136/bmj.327.7414.557 CrossRefPubMedPubMedCentralGoogle Scholar
  24. 24.
    A.H. Zwinderman, P.M. Bossuyt, We should not pool diagnostic likelihood ratios in systematic reviews. Stat. Med. 27(5), 687–697 (2008). doi: 10.1002/sim.2992 CrossRefPubMedGoogle Scholar
  25. 25.
    L. Bohacek, M. Milas, J. Mitchell, A. Siperstein, E. Berber, Diagnostic accuracy of surgeon-performed ultrasound-guided fine-needle aspiration of thyroid nodules. Ann. Surg. Oncol. 19(1), 45–51 (2012). doi: 10.1245/s10434-011-1807-z CrossRefPubMedGoogle Scholar
  26. 26.
    M. Bongiovanni, S. Crippa, Z. Baloch, S. Piana, A. Spitale, F. Pagni, L. Mazzucchelli, C. Di Bella, W. Faquin, Comparison of 5-tiered and 6-tiered diagnostic systems for the reporting of thyroid cytopathology: a multi-institutional study. Cancer Cytopathol. 120(2), 117–125 (2012). doi: 10.1002/cncy.20195 CrossRefPubMedGoogle Scholar
  27. 27.
    M. Braga, T.C. Cavalcanti, L.M. Collaco, H. Graf, Efficacy of ultrasound-guided fine-needle aspiration biopsy in the diagnosis of complex thyroid nodules. J. Clin. Endocrinol. Metab. 86(9), 4089–4091 (2001). doi: 10.1210/jcem.86.9.7824 CrossRefPubMedGoogle Scholar
  28. 28.
    A.S. Can, K. Peker, Comparison of palpation-versus ultrasound-guided fine-needle aspiration biopsies in the evaluation of thyroid nodules. BMC Res. Notes. 1, 12 (2008). doi: 10.1186/1756-0500-1-12 CrossRefPubMedPubMedCentralGoogle Scholar
  29. 29.
    B. Cochand-Priollet, P.J. Guillausseau, S. Chagnon, C. Hoang, C. Guillausseau-Scholer, P. Chanson, H. Dahan, A. Warnet, P.T. Tran Ba Huy, P. Valleur, The diagnostic value of fine-needle aspiration biopsy under ultrasonography in nonfunctional thyroid nodules: a prospective study comparing cytologic and histologic findings. Am. J. Med. 97(2), 152–157 (1994)CrossRefPubMedGoogle Scholar
  30. 30.
    D. Danese, S. Sciacchitano, A. Farsetti, M. Andreoli, A. Pontecorvi, Diagnostic accuracy of conventional versus sonography-guided fine-needle aspiration biopsy of thyroid nodules. Thyroid 8(1), 15–21 (1998)CrossRefPubMedGoogle Scholar
  31. 31.
    D.K. Das, C.S. Pant, K.L. Chachra, A.K. Mandal, R. Kumar, S.K. Ganguly, S. Bhambhani, R.P. Tripathy, Solitary nodular goiter: role of ultrasonography in fine-needle aspiration cytology diagnosis. Med. Princ. Pract. 9, 205–213 (2009)CrossRefGoogle Scholar
  32. 32.
    M.R. Giovagnoli, T. Pisani, A. Drusco, L. Scardella, A. Antonaci, A. Vecchione, Fine needle aspiration biopsy in the preoperative management of patients with thyroid nodules. Anticancer Res. 18(5B), 3741–3745 (1998)PubMedGoogle Scholar
  33. 33.
    T. Kawai, E. Nishihara, T. Kudo, H. Ota, S. Morita, K. Kobayashi, M. Ito, S. Kubota, N. Amino, A. Miyauchi, Histopathological diagnoses of “accessory” thyroid nodules diagnosed as benign by fine-needle aspiration cytology and ultrasonography. Thyroid 22(3), 299–303 (2012). doi: 10.1089/thy.2011.0272 CrossRefPubMedGoogle Scholar
  34. 34.
    S.J. Kim, E.K. Kim, C.S. Park, W.Y. Chung, K.K. Oh, H.S. Yoo, Ultrasound-guided fine-needle aspiration biopsy in nonpalpable thyroid nodules: is it useful in infracentimetric nodules? Yonsei Med. J. 44(4), 635–640 (2003)CrossRefPubMedGoogle Scholar
  35. 35.
    S.K. Kim, T.S. Hwang, Y.B. Yoo, H.S. Han, D.L. Kim, K.H. Song, S.D. Lim, W.S. Kim, N.S. Paik, Surgical results of thyroid nodules according to a management guideline based on the BRAF(V600E) mutation status. J. Clin. Endocrinol. Metab. 96(3), 658–664 (2011). doi: 10.1210/jc.2010-1082 CrossRefPubMedGoogle Scholar
  36. 36.
    P. Mikosch, U. Wartner, E. Kresnik, H.J. Gallowitsch, M. Heinisch, H.P. Dinges, P. Lind, Results of preoperative ultrasound guided fine needle aspiration biopsy of solitary thyroid nodules as compared with the histology. A retrospective analysis of 538 patients. Nuklearmedizin 40(5), 148–154 (2001)PubMedGoogle Scholar
  37. 37.
    A. Mirshemirani, F. Roshanzamir, A.K. Tabari, J. Ghorobi, S. Salehpoor, F.A. Gorji, Thyroid nodules in childhood: a single institute experience. Iran J. Pediatr. 20(1), 91–96 (2010)PubMedPubMedCentralGoogle Scholar
  38. 38.
    D. Nacamulli, L. Nico, S. Barollo, L. Zambonin, G. Pennelli, M.E. Girelli, E. Casal Ide, M.R. Pelizzo, F. Vianello, I. Negro, S. Watutantrige-Fernando, F. Mantero, M. Rugge, C. Mian, Comparison of the diagnostic accuracy of combined elastosonography and BRAF analysis vs cytology and ultrasonography for thyroid nodule suspected of malignancy. Clin. Endocrinol. (Oxf) 77(4), 608–614 (2012). doi: 10.1111/j.1365-2265.2012.04427.x CrossRefGoogle Scholar
  39. 39.
    T. Pisani, M. Bononi, C. Nagar, M. Angelini, M. Bezzi, A. Vecchione, Fine needle aspiration and core needle biopsy techniques in the diagnosis of nodular thyroid pathologies. Anticancer Res. 20(5C), 3843–3847 (2000)PubMedGoogle Scholar
  40. 40.
    T. Rago, E. Fiore, M. Scutari, F. Santini, G. Di Coscio, R. Romani, P. Piaggi, C. Ugolini, F. Basolo, P. Miccoli, A. Pinchera, P. Vitti, Male sex, single nodularity, and young age are associated with the risk of finding a papillary thyroid cancer on fine-needle aspiration cytology in a large series of patients with nodular thyroid disease. Eur. J. Endocrinol. 162(4), 763–770 (2010). doi: 10.1530/EJE-09-0895 CrossRefPubMedGoogle Scholar
  41. 41.
    S. Rorive, N. D’Haene, C. Fossion, I. Delpierre, N. Abarguia, F. Avni, C. Decaestecker, I. Salmon, Ultrasound-guided fine-needle aspiration of thyroid nodules: stratification of malignancy risk using follicular proliferation grading, clinical and ultrasonographic features. Eur. J. Endocrinol. 162(6), 1107–1115 (2010). doi: 10.1530/EJE-09-1103 CrossRefPubMedGoogle Scholar
  42. 42.
    I.B. Rosen, A. Azadian, P.G. Walfish, S. Salem, E. Lansdown, Y.C. Bedard, Ultrasound-guided fine-needle aspiration biopsy in the management of thyroid disease. Am. J. Surg. 166(4), 346–349 (1993)CrossRefPubMedGoogle Scholar
  43. 43.
    L.M. Sarkis, O. Norlen, A. Aniss, N. Watson, L.W. Delbridge, S.B. Sidhu, M.S. Sywak, A.J. Gill, The Australian experience with the Bethesda classification system for thyroid fine needle aspiration biopsies. Pathology 46(7), 592–595 (2014). doi: 10.1097/PAT.0000000000000168 CrossRefPubMedGoogle Scholar
  44. 44.
    K.E. Schoedel, M.E. Tublin, K. Pealer, N.P. Ohori, Ultrasound-guided biopsy of the thyroid: a comparison of technique with respect to diagnostic accuracy. Diagn. Cytopathol. 36(11), 787–789 (2008). doi: 10.1002/dc.20896 CrossRefPubMedGoogle Scholar
  45. 45.
    C. Schueller-Weidekamm, G. Schueller, K. Kaserer, C. Scheuba, H. Ringl, M. Weber, C. Czerny, A.M. Herneth, Diagnostic value of sonography, ultrasound-guided fine-needle aspiration cytology, and diffusion-weighted MRI in the characterization of cold thyroid nodules. Eur. J. Radiol. 73(3), 538–544 (2010). doi: 10.1016/j.ejrad.2008.12.013 CrossRefPubMedGoogle Scholar
  46. 46.
    N. Sebastian-Ochoa, J.C. Fernandez-Garcia, I. Mancha Doblas, A. Sebastian-Ochoa, D. Fernandez Garcia, M.V. Ortega Jimenez, E. Gallego Dominguez, F. Tinahones Madueno, [Clinical experience in a high-resolution thyroid nodule clinic]. Endocrinol. Nutr. 58(8), 409–415 (2011). doi: 10.1016/j.endonu.2011.06.007 CrossRefPubMedGoogle Scholar
  47. 47.
    T. Solymosi, G. Lukacs Toth, D. Nagy, I. Gal, Twenty years of experience with the preoperative diagnosis of medullary cancer in a moderately iodine-deficient region. Int. J. Endocrinol. 2013, 571606 (2013). doi: 10.1155/2013/571606 Google Scholar
  48. 48.
    F. Tunca, Y. Giles, A. Salmaslioglu, A. Poyanli, D. Yilmazbayhan, T. Terzioglu, S. Tezelman, The preoperative exclusion of thyroid carcinoma in multinodular goiter: Dynamic contrast-enhanced magnetic resonance imaging versus ultrasonography-guided fine-needle aspiration biopsy. Surgery 142(6), 992–1002 (2007). doi: 10.1016/j.surg.2007.09.027 CrossRefPubMedGoogle Scholar
  49. 49.
    U. Unluturk, M.F. Erdogan, O. Demir, S. Gullu, N. Baskal, Ultrasound elastography is not superior to grayscale ultrasound in predicting malignancy in thyroid nodules. Thyroid 22(10), 1031–1038 (2012). doi: 10.1089/thy.2011.0502 CrossRefPubMedGoogle Scholar
  50. 50.
    L.I. Wharry, K.L. McCoy, M.T. Stang, M.J. Armstrong, S.O. LeBeau, M.E. Tublin, B. Sholosh, A. Silbermann, N.P. Ohori, Y.E. Nikiforov, S.P. Hodak, S.E. Carty, L. Yip, Thyroid nodules > 4 cm: can ultrasound and cytology reliably exclude cancer? World J. Surg. 38(3), 614–621 (2014)CrossRefPubMedGoogle Scholar
  51. 51.
    J.H. Yoon, E.K. Kim, E.J. Son, H.J. Moon, J.Y. Kwak, Diffuse microcalcifications only of the thyroid gland seen on ultrasound: clinical implication and diagnostic approach. Ann. Surg. Oncol. 18(10), 2899–2906 (2011). doi: 10.1245/s10434-011-1717-0 CrossRefPubMedGoogle Scholar
  52. 52.
    J.K. Young, C.G. Lumapas, R. Mirasol, Sonographically guided fine-needle aspiration biopsy of thyroid nodules: Correlation between cytologic and histopathologic findings. Phillippine J. Intern. Med. 49(1), 8–14 (2011)Google Scholar
  53. 53.
    Y.H. Lee, B.H. Kim, S.I. Suh, H.S. Seo, B.K. Seo, K.R. Cho, J.H. Lee, N.H. Kim, J.A. Seo, Comparison of cytological results obtained by repeated US-guided fine-needle aspiration biopsies of thyroid nodules: focus on the rate of malignancy and diagnostic concordance. Diagn. Cytopathol. 37(7), 492–497 (2009). doi: 10.1002/dc.21043 CrossRefPubMedGoogle Scholar
  54. 54.
    F.F. Maia, P.S. Matos, E.J. Pavin, D.E. Zantut-Wittmann, Thyroid imaging reporting and data system score combined with Bethesda system for malignancy risk stratification in thyroid nodules with indeterminate results on cytology. Clin. Endocrinol. (Oxf) 82(3), 439–444 (2015). doi: 10.1111/cen.12525 CrossRefGoogle Scholar
  55. 55.
    I. Tabain, N. Matesa, Z. Kusic, Accuracy of ultrasound guided fine needle aspiration in patients with nodular thyroid disease. Acta. Clinica. Croatica. 43(1), 21–26 (2004)Google Scholar
  56. 56.
    A.A. Smadi, K. Ajarmeh, F. Wreikat, Fine-needle aspiration of thyroid nodules has high sensitivity and specificity. Rawal. Med. J. 33(2), 221–224 (2008)Google Scholar
  57. 57.
    E.S. Cibas, Z.W. Baloch, G. Fellegara, V.A. LiVolsi, S.S. Raab, J. Rosai, J. Diggans, L. Friedman, G.C. Kennedy, R.T. Kloos, R.B. Lanman, S.J. Mandel, N. Sindy, D.L. Steward, M.A. Zeiger, B.R. Haugen, E.K. Alexander, A prospective assessment defining the limitations of thyroid nodule pathologic evaluation. Ann. Intern. Med. 159(5), 325–332 (2013). doi: 10.7326/0003-4819-159-5-201309030-00006 CrossRefPubMedGoogle Scholar
  58. 58.
    M. Rethlefsen, A. Farrell, L. Osterhaus Trzasko, T. Brigham, Librarian co-authors correlated with higher quality reported search strategies in general internal medicine systematic reviews. J. Clin. Epidemiol. 68(6), 617–626 (2015)CrossRefPubMedGoogle Scholar
  59. 59.
    M. Price, R. Cameron, P. Butow, Communicating risk information: the influence of graphical display format on quantitative information perception-Accuracy, comprehension and preferences. Patient Educ. Couns. 69(1–3), 121–128 (2007). doi: 10.1016/j.pec.2007.08.006 CrossRefPubMedGoogle Scholar
  60. 60.
    D.R. Gordon Guyatt, M.O. Meade, D.J. Cook (ed.,) Users’ Guides to the Medical Literature: A Manual for Evidence-Based Clinical Practice, 3rd edn. (2015)Google Scholar
  61. 61.
    National Academies of Sciences, in E.A.M.: Improving diagnosis in health care, (The national academies press, Washington, DC, 2015)Google Scholar
  62. 62.
    Y.Y. Tee, A.J. Lowe, C.A. Brand, R.T. Judson, Fine-needle aspiration may miss a third of all malignancy in palpable thyroid nodules: a comprehensive literature review. Ann. Surg. 246(5), 714–720 (2007). doi: 10.1097/SLA.0b013e3180f61adc CrossRefPubMedGoogle Scholar

Copyright information

© Springer Science+Business Media New York 2016

Authors and Affiliations

  • Naykky Singh Ospina
    • 1
    • 2
  • Juan P. Brito
    • 1
    • 2
  • Spyridoula Maraka
    • 1
    • 2
  • Ana E. Espinosa de Ycaza
    • 1
  • Rene Rodriguez-Gutierrez
    • 2
  • Michael R. Gionfriddo
    • 2
    • 3
  • Ana Castaneda-Guarderas
    • 2
    • 4
  • Khalid Benkhadra
    • 2
    • 5
    • 6
  • Alaa Al Nofal
    • 7
  • Patricia Erwin
    • 8
  • John C. Morris
    • 1
  • M. Regina Castro
    • 1
  • Victor M. Montori
    • 1
    • 2
  1. 1.Division of Endocrinology, Diabetes, Metabolism and Nutrition, Department of Internal MedicineMayo ClinicRochesterUSA
  2. 2.Knowledge and Evaluation Research Unit, Division of Diabetes, Metabolism and NutritionMayo ClinicRochesterUSA
  3. 3.Mayo Graduate SchoolMayo ClinicRochesterUSA
  4. 4.Department of Emergency MedicineMayo ClinicRochesterUSA
  5. 5.Evidence-Based Practice Research ProgramMayo ClinicRochesterUSA
  6. 6.Robert D. and Patricia E. Kern Center for the Science of Health Care DeliveryMayo ClinicRochesterUSA
  7. 7.Division of Pediatric EndocrinologyMayo ClinicRochesterUSA
  8. 8.Mayo Medical LibraryMayo ClinicRochesterUSA

Personalised recommendations