Abstract
Background
Type II error, or not meeting sample-size requirement, has been identified as an issue in the surgical literature. The root of this problem is the low frequency of events in the majority of surgical clinical research. This exponentially increases the sample size needed to achieve statistical significance.
Methods
The methodology and mechanics of sample-size calculations are presented to demonstrate how sample-size requirements change based on baseline event rate and relative reduction in event rate. These concepts are then illustrated using real-life clinical scenarios.
Results
If a hypothetical baseline event rate is 1 % and the event rate in the experimental group is 0.5 % (therefore representing a 50 % reduction), then the total number of study patients required is 10,130. If the baseline event rate is 1 %, and the event rate in the experimental group is 0.9 % (a 10 % reduction), then the total number of study patients required is 299,410.
Conclusions
Sample-size calculations are affected by the frequency of the event or events of interest. Given advances in clinical medicine, many clinical outcomes of interest occur at very low frequencies. These low frequencies exponentially increase the sample size required to find statistically significant differences, making randomized clinical trials difficult to conduct properly. Surgical clinical researchers should advocate for the establishment of robust, prospective, large, multi-institutional clinical databases along with the establishment of proper outcomes research methodology as a way to augment randomized trials.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Dimick JB, Diener-West M, Lipsett PA (2001) Negative results of randomized clinical trials published in the surgical literature: equivalency or error? Arch Surg 136(7):796–800
Maggard MA, O’Connell JB, Liu JH, Etzioni DA, Ko CY (2003) Sample size calculations in surgery: are they done correctly? Surgery 134(2):275–279
Belmont PJ Jr, Davey S, Orr JD, Ochoa LM, Bader JO, Schoenfeld AJ (2011) Risk factors for 30-day postoperative complications and mortality after below-knee amputation: a study of 2,911 patients from the national surgical quality improvement program. J Am Coll Surg 213(3):370–378
Royle CA (1995) Colonic trauma: modern civilian management and military surgical doctrine. J R Soc Med 88(10):585P–589P
Bounovas A, Perente S, Laftsidis P, Polychronidis A, Simopoulos C (2007) Perforation of the colon from the primary blast effect of an extraperitoneal shotgun injury: case report. Mil Med 172(3):327–328
Mathis RD, Levine SH, Phifer S (1993) An analysis of accidental free falls from a height: the ‘spring break’ syndrome. J Trauma 34(1):123–126
Ali MR, Tichansky DS, Kothari SN, McBride CL, Fernandez AZ Jr, Sugerman HJ, Kellum JM, Wolfe LG, Demaria EJ (2010) Validation that a 1-year fellowship in minimally invasive and bariatric surgery can eliminate the learning curve for laparoscopic gastric bypass. Surg Endosc 24(1):138–144
Rattner D, Kalloo A (2005) ASGE/SAGES Working Group (2006) ASGE/SAGES Working Group on natural orifice translumenal endoscopic surgery. Surg Endosc 20(2):329–333
Disclosures
Drs. Chang, Yu, Talamini, and Molly Easterlin have no conflicts of interest or financial ties to disclose.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Chang, D.C., Yu, P.T., Easterlin, M.C. et al. Demystifying sample-size calculation for clinical trials and comparative effectiveness research: the impact of low-event frequency in surgical clinical research. Surg Endosc 27, 359–363 (2013). https://doi.org/10.1007/s00464-012-2497-8
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00464-012-2497-8