Calcified Tissue International

, Volume 91, Issue 3, pp 204–214 | Cite as

Developing Novel Prognostic Biomarkers for Multivariate Fracture Risk Prediction Algorithms

  • Ernest K. Poku
  • Mark R. Towler
  • Niamh M. Cummins
  • Jeff D. Newman
Original Research


Multivariate prediction algorithms such as FRAX® and QFractureScores provide an opportunity for new prognostic biomarkers to be developed and incorporated, potentially leading to better fracture prediction. As more research is conducted into these novel biomarkers, a number of factors need to be considered for their successful development for inclusion in these algorithms. In this review, we describe two well-known multivariate prediction algorithms for osteoporosis fracture risk applicable to the UK population, FRAX and QFractureScores, and comment on the current prognostic tools available for fracture risk; dual X-ray assessment, quantitative ultrasonography, and genomic/biochemical markers. We also highlight the factors that need to be considered in the development of new biomarkers. These factors include the requirement for prospective data, collected in new cohort studies or using archived samples; the need for adequate stability data to be provided; and the need for appropriate storage methods to be used when retrospective data are required. Area under the receiver operating characteristic curve measures have been found to have limited utility in assessing the impact of the addition of new risk factors on the predictive performance of multivariate algorithms. New performance evaluation measures, such as net reclassification index and integrated discrimination improvement, are increasingly important in the evaluation of the impact of the addition of new markers to multivariate algorithms, and these are also discussed.


Algorithms DXA Fracture FRAX Prognostic 


  1. 1.
    Kanis JA, Johnell O, Oden A, Johansson H, McCloskey E (2008) FRAX and the assessment of fracture probability in men and women from the UK. Osteoporos Int 19:385–397PubMedCrossRefGoogle Scholar
  2. 2.
    Bouxsein ML (2003) Bone quality: Where do we go from here? Osteoporos Int 14(suppl 5):S118–S127PubMedCrossRefGoogle Scholar
  3. 3.
    McCloskey EV, Johansson H, Oden A, Kanis JA (2009) From relative risk to absolute fracture risk calculation: the FRAX algorithm. Curr Osteoporos Rep 7:77–83PubMedCrossRefGoogle Scholar
  4. 4.
    Cook NR (2007) Use and misuse of the receiver operating characteristic curve in risk prediction. Circulation 115:928–935PubMedCrossRefGoogle Scholar
  5. 5.
    Burge R, Dawson-Hughes B, Solomon DH, Wong JB, King A, Tosteson A (2007) Incidence and economic burden of osteoporosis-related fractures in the United States, 2005–2025. J Bone Miner Res 22:465–475PubMedCrossRefGoogle Scholar
  6. 6.
    Abrahamsen B, van Staa T, Ariely R, Olson M, Cooper C (2009) Excess mortality following hip fracture: a systematic epidemiological review. Osteoporos Int 20:1633–1650PubMedCrossRefGoogle Scholar
  7. 7.
    Kanis J (2007) Assessment of osteoporosis at the primary health care level. World Health Organization, LyonGoogle Scholar
  8. 8.
    Kanis JA, Oden A, Johansson H, Borgström F, Ström O, McCloskey E (2009) FRAX® and its applications to clinical practice. Bone 44:734–743PubMedCrossRefGoogle Scholar
  9. 9.
    Kanis JA, Johnell O (2005) Requirements for DXA for the management of osteoporosis in Europe. Osteoporos Int 16:229–238PubMedCrossRefGoogle Scholar
  10. 10.
    Black DM, Steinbuch M, Palermo L, Dargent-Molina P, Lindsay R, Hoseyni MS, Johnell O (2001) An assessment tool for predicting fracture risk in postmenopausal women. Osteoporos Int 12:519–528PubMedCrossRefGoogle Scholar
  11. 11.
    Johansson H, Kanis JA, Oden A, Johnell O, McCloskey E (2009) BMD, clinical risk factors and their combination for hip fracture prevention. Osteoporos Int 20:1675–1682PubMedCrossRefGoogle Scholar
  12. 12.
    Johnell O, Kanis JA, Oden A, Johansson H, De Laet C, Delmas P, Eisman JA, Fujiwara S, Kroger H, Mellstrom D, Meunier PJ, Melton LJ 3rd, O’Neill T, Pols H, Reeve J, Silman A, Tenenhouse A (2005) Predictive value of BMD for hip and other fractures. J Bone Miner Res 20:1185–1194PubMedCrossRefGoogle Scholar
  13. 13.
    Garton MJ, Cooper C, Reid D (1997) Perimenopausal bone density screening—Will it help prevent osteoporosis? Maturitas 26:35–43PubMedCrossRefGoogle Scholar
  14. 14.
    Barr RJ, Stewart A, Torgerson DJ, Reid DM (2010) Population screening for osteoporosis risk: a randomised control trial of medication use and fracture risk. Osteoporos Int 21:561–568PubMedCrossRefGoogle Scholar
  15. 15.
    Hippisley-Cox J, Coupland C (2009) Predicting risk of osteoporotic fracture in men and women in England and Wales: prospective derivation and validation of QFractureScores. BMJ 339:1291–1295CrossRefGoogle Scholar
  16. 16.
    Collins GS, Mallett S, Altman DG (2011) Predicting risk of osteoporotic and hip fracture in the United Kingdom: prospective independent and external validation of QFractureScores. BMJ (in press)Google Scholar
  17. 17.
    Hippisley-Cox J, Coupland C (2012) Derivation and validation of updated QFracture algorithm to predict risk of osteoporotic fracture in primary care in the United Kingdom: prospective open cohort study. BMJ (in press)Google Scholar
  18. 18.
    Kanis JA, Oden A, Johansson H, McCloskey E (2012) Pitfalls in the external validation of FRAX. Osteoporos Int 23:423–431PubMedCrossRefGoogle Scholar
  19. 19.
    Cummins NM, Poku EK, Towler MR, O’Driscoll OM, Ralston SH (2011) Clinical risk factors for osteoporosis in Ireland and the UK: a comparison of FRAX and QFractureScores. Calcif Tissue Int 89:172–177PubMedCrossRefGoogle Scholar
  20. 20.
    Kanis JA, Oden A, Johnell O, Johansson H, De Laet C, Brown J, Burckhardt P, Cooper C, Christiansen C, Cummings S, Eisman JA, Fujiwara S, Gluer C, Goltzman D, Hans D, Krieg MA, La Croix A, McCloskey E, Mellstrom D, Melton LJ 3rd, Pols H, Reeve J, Sanders K, Schott AM, Silman A, Torgerson D, van Staa T, Watts NB, Yoshimura N (2007) The use of clinical risk factors enhances the performance of BMD in the prediction of hip and osteoporotic fractures in men and women. Osteoporos Int 18:1033–1046PubMedCrossRefGoogle Scholar
  21. 21.
    Schousboe JT (2008) Cost effectiveness of screen-and-treat strategies for low bone mineral density: How do we screen, who do we screen and who do we treat? Appl Health Econ Health Policy 6:1–18PubMedCrossRefGoogle Scholar
  22. 22.
    Stewart A, Kumar V, Reid DM (2006) Long-term fracture prediction by DXA and QUS: a 10-year prospective study. J Bone Miner Res 21:413–418PubMedCrossRefGoogle Scholar
  23. 23.
    Hans D, Krieg MA (2009) Quantitative ultrasound for the detection and management of osteoporosis. Salud Publica Mex 51(suppl 1):S25–S37PubMedCrossRefGoogle Scholar
  24. 24.
    Bauer DC, Gluer CC, Cauley JA, Vogt TM, Ensrud KE, Genant HK, Black DM (1997) Broadband ultrasound attenuation predicts fractures strongly and independently of densitometry in older women: a prospective study. Arch Intern Med 157:629–634PubMedCrossRefGoogle Scholar
  25. 25.
    Langton CM, Langton DK (2000) Comparison of bone mineral density and quantitative ultrasound of the calcaneus: site-matched correlation and discrimination of axial BMD status. Br J Radiol 73:31–35PubMedGoogle Scholar
  26. 26.
    Zhu K, Devine A, Prince RL (2009) Quantitative ultrasound measurements predict fracture in older women: a 10-year longitudinal study. Bone 44:S118CrossRefGoogle Scholar
  27. 27.
    Moayyeri A, Kaptoge S, Dalzell N, Bingham S, Luben RN, Wareham NJ, Reeve J, Khaw KT (2009) Is QUS or DXA better for predicting the 10-year absolute risk of fracture? J Bone Miner Res 24:1319–1325PubMedCrossRefGoogle Scholar
  28. 28.
    Garnero P, Hausherr E, Chapuy M-, Marcelli C, Grandjean H, Muller C, Cormier C, Bréart G, Meunier PJ, Delmas PD (1996) Markers of bone resorption predict hip fracture in elderly women: the EPIDOS prospective study. J Bone Miner Res 11:1531–1538PubMedCrossRefGoogle Scholar
  29. 29.
    Vasikaran S, Eastell R, Bruyère O, Foldes AJ, Garnero P, Griesmacher A, McClung M, Morris HA, Silverman S, Trenti T, Wahl DA, Cooper C, Kanis JA (2011) Markers of bone turnover for the prediction of fracture risk and monitoring of osteoporosis treatment: a need for international reference standards. Osteoporos Int 22:391–420PubMedCrossRefGoogle Scholar
  30. 30.
    Garnero P, Sornay-Rendu E, Chapuy MC, Delmas PD (1996) Increased bone turnover in late postmenopausal women is a major determinant of osteoporosis. J Bone Miner Res 11:337–349PubMedCrossRefGoogle Scholar
  31. 31.
    Ralston SH (2005) Genetic determinants of osteoporosis. Curr Opin Rheumatol 17:475–479PubMedCrossRefGoogle Scholar
  32. 32.
    Arden NK, Baker J, Hogg C, Baan K, Spector TD (1996) The heritability of bone mineral density, ultrasound of the calcaneus and hip axis length: a study of postmenopausal twins. J Bone Miner Res 11:530–534PubMedCrossRefGoogle Scholar
  33. 33.
    Mann V, Ralston SH (2003) Meta-analysis of COL1A1 Sp1 polymorphism in relation to bone mineral density and osteoporotic fracture. Bone 32:711–717PubMedCrossRefGoogle Scholar
  34. 34.
    Navarro MC, Sosa M, Del Pino-Montes J, Torres A, Salido E, Saavedra P, Corral-Gudino L, Montilla CA (2007) Collagen type 1 (COL1A1) Sp1 binding site polymorphisms is associated with osteoporotic fractures but not with bone density in post-menopausal women from the Canary Islands: a preliminary study. Aging Clin Exp Res 19:4–9PubMedGoogle Scholar
  35. 35.
    Klee EW, Hoppman-Chaney NL, Ferber MJ (2011) Expanding DNA diagnostic panel testing: Is more better? Exp Rev Mol Diagn 11:703–709CrossRefGoogle Scholar
  36. 36.
    Brown MA (2005) Genetic studies of osteoporosis—a rethink required. Calcif Tissue Int 76:319–325PubMedCrossRefGoogle Scholar
  37. 37.
    Barr R, Macdonald H, Stewart A, McGuigan F, Rogers A, Eastell R, Felsenberg D, Glüer C, Roux C, Reid DM (2010) Association between vitamin D receptor gene polymorphisms, falls, balance and muscle power: results from two independent studies (APOSS and OPUS). Osteoporos Int 21:457–466PubMedCrossRefGoogle Scholar
  38. 38.
    Robbins JA, Schott AM, Garnero P, Delmas PD, Hans D, Meunier PJ (2005) Risk factors for hip fracture in women with high BMD: EPIDOS study. Osteoporos Int 16:149–154PubMedCrossRefGoogle Scholar
  39. 39.
    Shepstone L, Fordham R, Lenaghan E, Harvey I, Cooper C, Gittoes N, Heawood A, Peters TJ, O’Neill T, Torgerson D, Holland R, Howe A, Marshall T, Kanis JA, McCloskey E (2012) A pragmatic randomised controlled trial of the effectiveness and cost-effectiveness of screening older women for the prevention of fractures: rationale, design and methods for the SCOOP study. Osteoporos Int (in press)Google Scholar
  40. 40.
    Elliott P, Peakman TC (2008) The UK Biobank sample handling and storage protocol for the collection, processing and archiving of human blood and urine. Int J Epidemiol 37:234–244PubMedCrossRefGoogle Scholar
  41. 41.
    Patel R, Blake GM, Fogelman I (2007) Evaluation of osteoporosis using skin thickness measurements. Calcif Tissue Int 81:442–449PubMedCrossRefGoogle Scholar
  42. 42.
    Saito M, Marumo K (2010) Collagen cross-links as a determinant of bone quality: a possible explanation for bone fragility in aging, osteoporosis, and diabetes mellitus. Osteoporos Int 21:195–214PubMedCrossRefGoogle Scholar
  43. 43.
    Langholz B, Thomas DC (1990) Nested case-control and case-cohort methods of sampling from a cohort: a critical comparison. Am J Epidemiol 131:169–176PubMedGoogle Scholar
  44. 44.
    Kenis G, Teunissen C, De Jongh R, Bosmans E, Steinbusch H, Maes M (2002) Stability of interleukin 6, soluble interleukin 6 receptor, interleukin 10 and CC16 in human serum. Cytokine 19:228–235PubMedGoogle Scholar
  45. 45.
    McClish DK (1989) Analyzing a portion of the ROC curve. Med Decis Making 9:190–195PubMedCrossRefGoogle Scholar
  46. 46.
    Cook NR (2008) Statistical evaluation of prognostic versus diagnostic models: beyond the ROC curve. Clin Chem 54:17–23PubMedCrossRefGoogle Scholar
  47. 47.
    Rapsomaniki E, White IR, Wood AM, Thompson SG, Emerging Risk Factors Collaboration (2012) A framework for quantifying net benefits of alternative prognostic models. Stat Med 31:114–130PubMedCrossRefGoogle Scholar
  48. 48.
    Vickers AJ, Elkin EB (2006) Decision curve analysis: a novel method for evaluating prediction models. Med Decis Making 26:565–574PubMedCrossRefGoogle Scholar
  49. 49.
    Pepe MS, Feng Z, Gu JW (2008) Comments on “Evaluating the added predictive ability of a new marker: from area under the ROC curve to reclassification and beyond,” by M. J. Pencina et al. Stat Med. 27:173–181. doi:10.1002/sim.2929
  50. 50.
    Pencina MJ, D’Agostino RB Sr, D’Agostino RB Jr, Vasan RS (2008) Evaluating the added predictive ability of a new marker: from area under the ROC curve to reclassification and beyond. Stat Med 27:157–172PubMedCrossRefGoogle Scholar
  51. 51.
    Schwenkglenks M, Lippuner K (2007) Simulation-based cost-utility analysis of population screening-based alendronate use in Switzerland. Osteoporos Int 18:1481–1491PubMedCrossRefGoogle Scholar
  52. 52.
    Pencina MJ, D’Agostino RB, Steyerberg EW (2011) Extensions of net reclassification improvement calculations to measure usefulness of new biomarkers. Stat Med 30:11–21PubMedCrossRefGoogle Scholar
  53. 53.
    Donaldson MG, Cawthon PM, Schousboe JT, Ensrud KE, Lui LY, Cauley JA, Hillier TA, Taylor BC, Hochberg MC, Bauer DC, Cummings SR, Study of Osteoporotic Fractures (SOF) (2011) Novel methods to evaluate fracture risk models. J Bone Miner Res 26:1767–1773PubMedCrossRefGoogle Scholar

Copyright information

© Springer Science+Business Media, LLC 2012

Authors and Affiliations

  • Ernest K. Poku
    • 1
  • Mark R. Towler
    • 2
    • 3
  • Niamh M. Cummins
    • 4
  • Jeff D. Newman
    • 1
  1. 1.Cranfield HealthCranfield UniversityCranfieldUK
  2. 2.Inamori School of EngineeringAlfred UniversityAlfredUSA
  3. 3.Department of Biomedical Engineering, Faculty of EngineeringUniversity of MalayaKuala LumpurMalaysia
  4. 4.Centre for Interventions in Infection, Inflammation and Immunity, Graduate Entry Medical SchoolUniversity of LimerickLimerickIreland

Personalised recommendations