Skip to main content
SpringerLink
Log in

High-risk studies are influenced by indirect range restriction

  • Published:
Journal of Behavioral Medicine Aims and scope Submit manuscript

Abstract

High-risk studies select subjects who are at high risk for existing or future disease. Therefore, the range of disease is restricted in high-risk studies. This paper shows that high-risk studies are vulnerable to a particular type of range restriction referred to as indirect range restriction. A simulation study is used to illustrate the effects of indirect range restriction on high-risk studies. The results suggest that indirect range restriction can have a substantial impact on the results of high-risk studies. In addition, a review of several areas of behavioral medicine research suggests that high-risk studies have produced many misleading findings. The range restriction approach can be used to estimate statistical power in high-risk studies, interpret the results of high-risk studies, and design future high-risk studies.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  • Benson, G. (1985). Course and outcome of drug abuse and medical and social conditions in selected young drug abusers.Acta Psychiatica Scand. 71: 48–66.

    Google Scholar 

  • Berkson, J. (1946). Limitations of the application of fourfold table analysis to hospital data.Biometr. Bull. 2: 47–53.

    Google Scholar 

  • Booth-Kewley, S., and Friedman, H. S. (1987). Psychological predictors of heart disease: A quantitative review.Psychol. Bull. 101: 343–362.

    PubMed  Google Scholar 

  • Case, R. B., Heller, S. S., Case, N. B., and Moss, A. J. (1985). Type A behavior and survival after acute myocardial infarction.N. Engl. J. Med. 312: 737–741.

    PubMed  Google Scholar 

  • Cohen, J., and Cohen, P. (1983).Applied Multiple Regression/Correlation Analysis for the Behavioral Sciences (2nd ed.), Erlbaum, Hillsdale, NJ.

    Google Scholar 

  • Dembroski, T. M., MacDougall, J. M., Costa, P. T., and Grandits, G. A. (1989). Components of hostility as predictors of sudden death and myocardial infarction in the Multiple Risk Factor Intervention Trial.Psychosom. Med. 51: 514–522.

    PubMed  Google Scholar 

  • Dembo, R., Williams, L., Getreu, A., Genung, L., Schmeidler, J., Berry, E., Wish, E., and La Voie, L. (1991). A longitudinal study of the relationships among marijuana/hashish use, cocaine use and delinquency in a cohort of high risk youths.J. Drug Issues 21: 271–312.

    Google Scholar 

  • Detrano, R., Janosi, A., Lyons, K. P., Marcondes, G., Abbassi, N., and Froelicher, V. F. (1988). Factors affecting the sensitivity and specificity of a diagnostic test: The exercise thallium scintigram.Am. J. Med. 84: 699–710.

    PubMed  Google Scholar 

  • Dimsdale, J. E. (1988). A perspective on Type A behavior and coronary disease.N. Engl. J. Med. 318: 110–112.

    PubMed  Google Scholar 

  • Fletcher, R. H. (1986). Carcinoembroyonic antigen.Ann. Intern. Med. 1044: 66–73.

    Google Scholar 

  • Fried, L. P., and Pearson, T. A. (1987). The association of risk factors with arteriographically defined artery disease: What is the appropriate control group.Am. J. Epidemiol. 125: 844–853.

    PubMed  Google Scholar 

  • Friedman, M., and Ulmer, D. (1984).Treating Type A Behavior and Your Heart, Fawcett Crest, New York.

    Google Scholar 

  • Friedman, M., Thoresen, C. E., Gill, J. J., Ulmer, D., Powell, L. H., Price, V. A., Brown, B., Thompson, L., Rabin, D. D., Breall, W. S., Bourg, E., Levy, R., and Dixon, T. (1986). Alteration of Type A behavior and its effect on cardiac recurrences in post myocardial infarction patients: Summary results of the recurrent coronary prevention project.Am. Heart J. 1121: 653–665.

    Google Scholar 

  • Ghiselli, E. E., Campbell, J. P., and Zedeck, S. (1981).Measurement Theory for the Behavioral Sciences, Freeman, San Francisco.

    Google Scholar 

  • Greener, J. M., and Osburn, H. G. (1979). An empirical study of the accuracy of corrections for restriction of range due to explicit selection.Appl. Psych. Meas. 3: 31–41.

    Google Scholar 

  • Greener, J. M., and Osburn, H. G. (1980). Accuracy of corrections for restriction of range due to explicit selection in hetroscedastic and non-linear distributions.Educ. Psych. Meas. 40: 337–345.

    Google Scholar 

  • Heckman, J. (1979). Sample selection bias as a specification error.Econometica 47: 153–161.

    Google Scholar 

  • Hlatky, M. A., Pryor, D. B., Harrell, F. E., Jr., Califf, R. M., Mark, D. B., and Rosati, R. A. (1986). Factors affecting sensitivity and specificity of exercise electrocardiography.Am. J. Med. 104: 66–73.

    Google Scholar 

  • Lachs, M. S., Nachamkin, I., Edelstein, P. H., Goldman, J., Feinstein, A. R., and Schwartz, J. S. (1992). Spectrum bias in the evaluation of diagnostic tests: Lessons from the rapid dipstick test for urinary tract infection.Ann. Intern. Med. 117: 135–140.

    PubMed  Google Scholar 

  • Lee, R., and Foley, P. P. (1986). Is the validity of a test constant throughout the test score range?J. Appl. Psych. 71: 641–644.

    Google Scholar 

  • Levy, D., Labib, S. B., Anderson, K. M., Christiansen, J. C., Kannell, W. B., and Castelli, W. P. (1990). Determinants of sensitivity and specificity of electrocardiographic criteria for left ventricular hypertrophy.Circulation 81: 815–820.

    PubMed  Google Scholar 

  • Little, R. J. A., and Rubin, D. B. (1987).Statistical Analysis with Missing Data. Wiley, New York.

    Google Scholar 

  • Matthews, K. A. (1988). Coronary heart disease and Type A behaviors: Update on and alternative to the Booth-Kewley and Friedman (1987) quantitative review.Psychol. Bull. 104: 373–380.

    PubMed  Google Scholar 

  • Miller, T. Q., Turner, C. W., Tindale, R. S., and Posavac, E. J. (1988). Disease-based spectrum bias in referred samples and the relationship between Type A behavior and coronary artery disease.J. Clin. Epidemiol. 41: 1139–1149.

    PubMed  Google Scholar 

  • Miller, T. Q., Turner, C. W., Tindale, R. S., Posavac, E. J., and Dugoni, B. L. (1991). Reasons for the trend toward null findings in research on Type A behaviro.Psychol. Bull. 100: 469–485.

    Google Scholar 

  • The MRFIT Group (1977). Statistical design considerations in the NHLBI Multiple Risk Factor Intervention Trial (MRFIT).J. Chron. Dis. 30: 261–275.

    Google Scholar 

  • The MRFIT Group (1982). MRFIT: Risk factor changes and mortality results.JAMA 248: 1465–1477.

    Google Scholar 

  • The MRFIT Group (1990). Mortality rates after 10.5 years for participants in the Multiple Risk Factor Intervention Trial: Findings related toa priori hypotheses of the trial.JAMA 263: 1795–1801.

    Google Scholar 

  • Olson, C. A., and Becker, B. E. (1983). A proposed technique for the treatment of restriction of range in selection validation.Psychol. Bull. 93: 137–148.

    Google Scholar 

  • Pearson, K. (1903). Mathematical contributions to the theory of evolution-XI: On the influence of natural selection on the variability and correlation of organs.Phil. Trans. Roy. Soc. Ser. A 200: 1–66.

    Google Scholar 

  • Philbrick, J. T., Horwitz, R. I., Feinstein, A. R., Langou, R. A., and Chandler, J. P. (1982). The limited spectrum of patients studied in exercise test research.JAMA 248: 2467–2470.

    PubMed  Google Scholar 

  • Pickering, T. G. (1985). Should studies of patients undergoing angiography be used to evaluate the role of behavioral risk factors for coronary heart disease?J. Behav. Med. 8: 203–213.

    PubMed  Google Scholar 

  • Proceedings of a Workshop on Methods for Longitudinal Data Analysis in Epidemiological and Clinical Studies, 1986 (1988). Section on data with missing values.Stat. Med. 19: 305–360.

    Google Scholar 

  • Ragland, D. R., and Brand, R. J. (1988a). Type A behavior and mortality from coronary heart disease.N. Engl. J. Med. 318: 65–69.

    PubMed  Google Scholar 

  • Ragland, D. R., and Brand, R. J. (1988b). Coronary heart disease mortality in the Western Collaborative Group Study: Follow-up experience of 22 years.Am. J. Epidemiol. 127: 462–475.

    PubMed  Google Scholar 

  • Ragland, P. R., Helmer, P. C., and Seeman, T. E. (1991). Patient selection factors in angiographic studies: A conceptual formulation and empirical test.J. Behav. Med. 14: 541–553.

    PubMed  Google Scholar 

  • Ransohoff, D. F., and Feinstein, A. R. (1978). Problems of spectrum and bias in evaluating the efficacy of diagnostic tests.N. Engl. J. Med. 299: 926–930.

    PubMed  Google Scholar 

  • Ray, J. J. (1991). If “A-B” does not predict heart disease, why bother with it? A comment on Ivancevich and Matteson.B. J. Med. Psychol. 64: 85–90.

    Google Scholar 

  • Reed, D., and Yano, K. (1991). Predictors of arteriographically defined coronary stenosis in the Honolulu Heart Program: Comparisons of cohort and arteriography series analyses.Am. J. Epidemiol. 1334: 111–121.

    Google Scholar 

  • Rissanen, V. T. (1975). Coronary atherosclerosis in cases of coronary death as compared with that occurring in clinical populations.Ann. Clin. Res. 7: 412–425.

    PubMed  Google Scholar 

  • Rosenman, R. H., Friedman, M., Straus, R., Wurm, M., Jenkins, C. D., and Messinger, H. B. (1966). Coronary heart disease in the Western Collaborative Group Study: A follow-up experience of two years.JAMA 195: 130–135.

    Google Scholar 

  • Rosenman, R. H., Brand, R., Jenkins, D., Friedman, M., Staus, R., and Wurm, M. (1975). Coronary heart disease in the Western Collaborative Group Study: Final follow-up of 8.5 years.JAMA 233: 872–877.

    PubMed  Google Scholar 

  • Rosenman, R. M. (1978). The interview method of assessment of the coronary-prone behavior pattern. In Dembroski, T. M., Weiss, S. M., Shields, J. L., Haynes, S. G., and Feinleib, M. (eds.),Coronary-prone Behavior, Springer-Verlag, New York.

    Google Scholar 

  • Rubin, D. B. (1985).Multiple Imputation for Nonresponse, Wiley, New York.

    Google Scholar 

  • Sackett, P. R., and Wade, B. E. (1983). On the feasibility of criterion-related validity: The effects of range restriction assumptions on needed sample size.J. App. Psychol. 68: 374–381.

    Google Scholar 

  • Schmidt, F. L., Hunter, J. E., McKenzie, R. C., and Muldow, T. W. (1979). The impact of valid selection procedures of work-force productivity.J. Appl. Psychol. 64: 609–626.

    Google Scholar 

  • Schweritz, L., Graham, L., Grandits, G., Buchler, J., and Billings, J. (1986). Self-involvement and coronary heart disease incidence in the Multiple Risk Factor Intervention Trial.Psychosom. Med. 48: 187–199.

    PubMed  Google Scholar 

  • Shekelle, R. B., Hulley, S. B., Neaton, J. D., Billings, J. H., Borhani, N. D., Gerace, T. A., Jacobs, D. R., Lasser, N. L., Mittlemark, M. B., and Stambler, J. (1985). The MRFIT behavior pattern study II. Type A behavior and incidence of coronary heart disease.Am. J. Epidemiol. 122: 559–570.

    PubMed  Google Scholar 

  • Sontag, S., Schnell, T., Miller, T., O'Connell, S., Serlovsky, R., Nemchausky, B., Seidel, U. J., and Brand, L. (1991). The importance of hiatal hernia versus lower esophageal sphincter pressure or smoking in reflux esophagitis.J. Clin. Gastroenterol. 13: 628–643.

    PubMed  Google Scholar 

  • Staff. (1987). Is Type A passe?Berkeley Wellness Letter, University of California, p. 1.

  • Thorndike, R. L. (1949).Personnel Selection, Wiley, New York.

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Department of Preventive Medicine and Community Health, University of Texas Medical Branch at Galveston, 77555-1153, Galveston, Texas

    Todd Q. Miller

Authors
  1. Todd Q. Miller
    View author publications

    You can also search for this author in PubMed Google Scholar

Rights and permissions

Reprints and permissions

About this article

Cite this article

Miller, T.Q. High-risk studies are influenced by indirect range restriction. J Behav Med 17, 567–588 (1994). https://doi.org/10.1007/BF01857598

Download citation

  • Issue Date:

  • DOI: https://doi.org/10.1007/BF01857598

Key Words

Search

Navigation