Avoid common mistakes on your manuscript.
The management of osteoporosis has been revolutionized by the shift, in part or in whole, from treatment of individuals with low bone mineral density (BMD) T-scores to those with elevated absolute fracture risk based upon clinical prediction tools. Among the available validated tools, FRAXR is unique in several respects including its ability to customize predictions to a specific target population [1]. This process, known as calibration, ensures that the output from FRAX—10-year probability of major osteoporotic fracture (MOF, a composite of hip, clinical vertebral, proximal humerus, distal forearm) and 10-year probability of hip fracture alone—agrees with the expected fracture risk. This has allowed for the creation of more than 80 FRAX tools covering over 80% percent of the world population. [2] The flexibility of this approach, which recognizes diversity in fracture risk between populations rather than making the flawed assumption that “one size fits all”, comes at a price. That price is the need to acquire high quality fracture incidence rates. (Mortality data are also required to incorporate competing mortality into the calculation but are usually easier to obtain.).
Accurate calibration of the FRAX tool is of critical importance. Treatment qualification based upon a fixed 10-year MOF probability threshold of 20% shows a very steep gradient: for every 1% change in calibration, there is a 2.5% change in treatment rates for women and a 4.1% change in treatment rates for men [3]. Therefore, miscalibration of greater than 10–20% can lead to profound over- or under-treatment. Of note, similar levels of miscalibration would be expected to have little if any effect on treatment rates using an age-dependent intervention threshold since the cutoff scales in relation to the tool's predictions [4].
It is self-evident that better quality fracture data will provide more accurate predictions from the derived FRAX tool. Therefore, calibration should ideally be based upon nationwide fracture data. For hip fractures, which almost invariably lead to hospitalization and surgery, many countries are able to provide accurate statistics. Non-hip fractures, which frequently do not require hospitalization or surgery, are more difficult to measure. Clinical vertebral fractures, which may present insidiously rather than acutely, are the most difficult to accurately count. A majority of countries that have a FRAX model do not have robust information on the risk of other major osteoporotic fractures [5]. In the absence of such information, FRAX models often assume that the age- and sex-specific pattern of these fractures is similar to that observed in Malmo, Sweden [6, 7]. This is supported by the observation that in those regions where hip fracture rates are high, so too is the risk of non-hip fractures including forearm fracture and spine fractures (requiring hospital admission) [8,9,10]. This assumption has also been tested prospectively in Iceland and Moldova [11, 12]. An exception to this generalisation has been reported in two regional fracture surveys in Russia where the incidences of both forearm and humeral fractures were substantially higher than would be predicted from the incidence of hip fracture when comparing with Malmo [13]. Intermediate results have been reported in a population-based study of 21,850 MOF from Canada, where forearm/hip ratios were 35–46% higher and humerus/hip ratios 15–19% higher than in Malmo, although there was excellent agreement in clinical vertebral/hip ratios [14].
Therefore, there is evidence that fracture ratios from Sweden reflect patterns observed in many but not all countries [13,14,15,16,17,18], despite marked geographic differences in fracture incidence [10]. An illustration of these principles is provided in Fig. 1, which shows ratios of MOF to hip fracture probability obtained from the FRAX website for selected countries based upon whether MOF calibration included data on non-hip fractures or relied on rates estimated from the Swedish databases. For some countries with non-hip major fracture data, these ratios are higher than in Sweden while for Mexico the ratio is quite similar to Sweden. Had the Swedish fracture ratios been used, rather than national data, treatment rates (assuming a fixed 10-year MOF probability threshold of 20%) would be projected to decrease by tenfold in Russia and by almost threefold in Switzerland [3]. This highlights the importance of identifying and accommodating regional differences.
In this context, the recent report from Mugisha et al. [19] provides information on calibration of the FRAX tool for Belgium which used Swedish data for estimating non-hip fractures. The population-based FRISBEE cohort registered 1336 fractures in 3560 women over mean 9.1 years of follow-up. Importantly, fractures were validated by radiological/surgical reports and included a credible number of clinical vertebral fractures. The authors found that the ratio of MOF to hip fractures in their population was substantially greater than those reported from the Swedish databases for each of the reported age groups (60–69, 70–79, 80–89 years). Of course, caution needs to be exercised before applying these data clinically since they arise from a single, relatively small cohort, and therefore the generalisability are uncertain and the confidence intervals are very wide. Nonetheless, if these data are confirmed to accurately reflect patterns in the Belgian population then it might justify recalibration of the FRAX tool for Belgium.
In summary, FRAX is a flexible platform for fracture risk prediction that can accommodate between and within country differences in fracture epidemiology. A strength of FRAX is the ability to update predictions and ensure that these remain aligned with the target population despite demographic and temporal changes [20]. The corollary of these findings is that the job is not over after the creation of a FRAX tool. Where adequately powered, high quality data confirm a mismatch between FRAX predicted and observed fracture risk, this may call for updating the FRAX tool. There is precedent for such updates in the lifetime of FRAX (e.g., United States, Turkey, Italy). Periodically evaluating performance of a FRAX tool and making modifications, where justified, will continue to ensure that FRAX advances the management of osteoporosis in patients worldwide.
Disclosures
William Leslie has no conflicts of interest. John A Kanis reports grants from Amgen, Eli Lilly and Radius Health and consulting fees from Theramex. JAK is the architect of FRAX® but has no financial interest.
References
Kanis JA, on behalf of the World Health Organization Scientific Group (2008) Assessment of osteoporosis at the primary health-care level, Technical Report. WHO Collaborating Centre, University of Sheffield, UK
Kanis JA, Harvey NC, Johansson H, Liu E, Vandenput L, Lorentzon M et al (2020) A decade of FRAX: how has it changed the management of osteoporosis? Aging Clin Exp Res 32(2):187–196
Leslie WD, Lix LM, Manitoba Bone Density Program (2011) Effects of FRAX® model calibration on intervention rates: a simulation study. J Clin Densitom 14(3):272–278
Kanis JA, McCloskey EV, Johansson H, Strom O, Borgstrom F, Oden A et al (2008) Case finding for the management of osteoporosis with FRAX–assessment and intervention thresholds for the UK. Osteoporos Int 19(10):1395–1408
Kanis JA, Oden A, Johansson H, McCloskey E (2012) Pitfalls in the external validation of FRAX. Osteoporos Int 23(2):423–431
Kanis JA, Johnell O, Oden A, Sembo I, Redlund-Johnell I, Dawson A et al (2000) Long-term risk of osteoporotic fracture in Malmo. Osteoporos Int 11(8):669–674
Kanis JA, Oden A, Johnell O, Jonsson B, de Laet C, Dawson A (2001) The burden of osteoporotic fractures: a method for setting intervention thresholds. Osteoporos Int 12(5):417–427
Johnell O, Gullberg B, Kanis JA (1997) The hospital burden of vertebral fracture in Europe: a study of national register sources. Osteoporos Int 7(2):138–144
Melton L III (1995) Epidemiology of fractures. In: Riggs BL, Melton LJ III (eds.) Osteoporosis: etiology, diagnosis and management, 2nd edn. Lippincott-Raven, New York p 225–227
Kanis JA, Oden A, McCloskey EV, Johansson H, Wahl DA, Cooper C et al (2012) A systematic review of hip fracture incidence and probability of fracture worldwide. Osteoporos Int 23(9):2239–2256
Siggeirsdottir K, Aspelund T, Johansson H, Gudmundsson EF, Mogensen B, Jonsson BY et al (2014) The incidence of a first major osteoporotic fracture in Iceland and implications for FRAX. Osteoporos Int 25(10):2445–2451 (Epub 2014/07/02)
Zakroyeva A, Lesnyak O, Cazac V, Groppa L, Russu E, Chislari L et al (2020) Epidemiology of osteoporotic fracture in Moldova and development of a country-specific FRAX model. Arch Osteoporos 15(1):13
Lesnyak O, Ershova O, Belova K, Gladkova E, Sinitsina O, Ganert O et al (2012) Epidemiology of fracture in the Russian Federation and the development of a FRAX model. Arch Osteoporos 7:67–73
Lam A, Leslie WD, Lix LM, Yogendran M, Morin SN, Majumdar SR (2014) Major osteoporotic to hip fracture ratios in canadian men and women with Swedish comparisons: a population-based analysis. J Bone Miner Res 29(5):1067–1073
Melton LJ III, Crowson CS, O’Fallon WM (1999) Fracture incidence in Olmsted County, Minnesota: comparison of urban with rural rates and changes in urban rates over time. Osteoporos Int 9(1):29–37
Singer BR, McLauchlan GJ, Robinson CM, Christie J (1998) Epidemiology of fractures in 15,000 adults: the influence of age and gender. J Bone Joint Surg Br 80(2):243–248
Sanders KM, Seeman E, Ugoni AM, Pasco JA, Martin TJ, Skoric B et al (1999) Age- and gender-specific rate of fractures in Australia: a population-based study. Osteoporos Int 10(3):240–247
Leslie WD, Brennan SL, Lix LM, Johansson H, Oden A, McCloskey E et al (2013) Direct comparison of eight national FRAX(R) tools for fracture prediction and treatment qualification in Canadian women. Arch Osteoporos 8:145
Mugisha A, Bergmann P, Kinnard V, Iconaru L, Baleanu F, Surquin M (2021) MOF/Hip fracture ratio in a Belgian cohort of post-menopausal women (FRISBEE): potential impact on the FRAX® score. Calcif Tissue Int. https://doi.org/10.1007/s00223-021-00875-8
Cooper C, Cole ZA, Holroyd CR, Earl SC, Harvey NC, Dennison EM et al (2011) Secular trends in the incidence of hip and other osteoporotic fractures. Osteoporos Int 22(5):1277–1288
Author information
Authors and Affiliations
Corresponding author
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Leslie, W.D., Kanis, J.A. Calibration of FRAX: A Journey, not a Destination. Calcif Tissue Int 109, 597–599 (2021). https://doi.org/10.1007/s00223-021-00891-8
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00223-021-00891-8