Abstract
In general, social validity data reflect the social significance of target behaviors, the appropriateness of procedures, and the perceived importance of results. Intervention integrity data provide evidence that treatments are implemented in the intended fashion. The present paper discusses social validity and intervention integrity data and considers their possible importance. It also reports how often such data were reported in treatment articles published in theJournal of Developmental and Physical Disabilities from 1991 through 1995. Social validity data were presented in 5 of 39 treatment articles (13%). Intervention integrity data were presented in 9 of 39 articles (23%). When social validity data were presented, reliability and validity of the measures were never discussed. Although it is not necessary to assess social validity or intervention integrity to conduct a quality study, or to publish such a study in theJournal of Developmental and Physical Disabilities, doing so is in many cases relatively easy, and may help readers to evaluate the scientific and practical importance of reported findings.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
REFERENCES
Banzett, L. K., Barringer, D. M., Jr., Bowen, L., Glynn, S. M., and Mosk, M. M. (1991). Weight loss in the Prader-Willi Syndrome: Treatment and long term follow-up. J. Develop. Phys. Dis. 3: 47–58.
Baer, D. M., Wolf, M. M., and Risley, T. D. (1968). Some current dimensions of applied behavior analysis. J. Appl. Behav. Anal. 1: 91–97.
Baer, D. M., Wolf, M. M., and Risley, T. D. (1987). Some still-current dimensions of applied behavior analysis. J. Appl. Behav. Anal. 20: 313–327.
Barber, T. X. (1976). Ten Pitfalls in Human Research, Pergamon Press, New York.
Barlow, D. M., Hayes, S. C., and Nelson, R. O. (1984). The Scientist Practitioner. New York, Pergamon Press.
Barrett, B. H. (1987). Drifting? Course? Destination?: A review of Res. Methods Appl. Behav. Anal. Issues Advan. Behav. Anal. 10: 253–276.
Cameron, M. J., Luiselli, J. K., McGrath, M., and Carlton, R. (1992). Stimulus control analysis and treatment of noncompliant behavior. J. Develop. Phys. Dis. 4: 141–150.
Cooper, J. O., Heron, T. E., and Heward, W. L. (1987). Applied Behavior Analysis, Macmillan, New York.
Elliott, S. N. (1988). Acceptability of behavioral treatments in educational settings. In Witt, J. C., Elliott, S. N., and Gresham, F. M. (eds.), Handbook of Behavior Therapy in Education, Plenum Press, New York, pp. 121–150.
Fuqua, R. W., and Schwade, J. (1986). Social validation of applied behavioral research: A selective review and critique. In Poling, A., and Fuqua, R. W. (eds.), Research Methods in Applied Behavior Analysis: Issues and Advances, Plenum Press, New York, pp. 265–292.
Green, C. W., and Reid, D. H. (1994), A comprehensive evaluation of a train-the-trainers model for training education staff to assemble adaptive switches. J. Develop. Phys. Dis. 6: 219–238.
Gresham, F. M. (1989). Assessment of treatment integrity in school consultation and prereferral intervention. School Psych. Rev. 18: 37–50.
Gresham, F. M., Gansle, K. A., Noell, G. H., Cohen, S., and Rosenblum, S. (1993). Treatment integrity of school-based behavioral intervention studies: 1980–1990. School Psych. Rev. 22: 254–272.
Hawkins, R. P. (1991). Is social validity what we are interested in? Argument for a functional approach. J. Appl. Behav. Anal. 14: 205–213.
Hughes, M. W., Schuster, J. W., and Nelson, C. M. (1993). The acquisition of independent dressing skills by students with multiple disabilities. J. Develop. Phys. Dis. 5: 233–252.
Johnston, J. M., and Pennypacker, H. S. (1993). Strategies and Tactics of Behavioral research, Erlbaum, Hillsdale, NJ.
Journal of Applied Behavior Analysis (1991). Social validity: Multiple perspectives. 24: 179–249.
Kazdin, A. E. (1977). Assessing the clinical or applied importance of behavior change through social validation. Behav. Mod. 1: 427–452.
Kazdin, A. E. (1992). Research Design in Clinical Psychology, Allyn and Bacon, Boston.
Kennedy, C. R. (1992). Trends in the measurement of social validity. Behav. Anal. 15: 147–156.
Lentz, F. E., Jr., Allen, S. J., and Ehrhardt, K. E. (1996). The conceptual elements of strong interventions in school settings. School Psych. Quart. 11: 137–148.
LeLaurin, K., and Wolery, M. (1992). Research standards in early intervention: Defining, describing, and measuring the independent variable. J. Early Inter. 16: 275–287.
McMahon, R. J., and Forehand, R. L. (1983). Consumer satisfaction in behavioral treatment of children: Types, issues, and recommendations. Behav. Ther. 14: 209–225.
Michael, J. (1974). Statistical inference for individual organism research: Mixed blessing or curse? J. Appl. Behav. Anal. 7: 47–65.
O'Neill, R. E., Horner, R. H., O'Brien, M., and Huckstep, S. (1991). Generalized reduction of difficult behaviors: Analysis and intervention in a competing behaviors framework. J. Develop. Phys. Dis. 3: 5–22.
Peterson, L., Homer, A. L., and Wonderlich, S. A. (1982). The integrity of independent variables in behavior analysis. J. Appl. Behav. Anal. 15: 477–492.
Poling, A., Methot, L., and LeSage, M. (1995). Fundamentals of Behavior Analytic Research, Plenum Press, New York.
Poling, A., and LeSage, M. (1995). Evaluating psychotropic drugs in people with mental retardation: Where are the social validity data? Am. J. Men. Retard. 100: 193–200.
Poling, A., Smith, J. B., and Braatz, D. (1993). Data sets in organizational behavior management: Do we measure enough? J. Org. Behav. Man. 14: 99–116.
Storey, K. (1992). Reliability and validity issues in social validation research involving persons with developmental disabilities. J. Develop. Phys. Dis. 4: 75–80.
Storey, K., and Horner, R. H. (1991). An evaluative review of social validation research involving persons with handicaps. J. Spec. Ed. 25: 352–401.
Yeaton, W. H., and Sechrest, L. (1981). Critical dimensions in the choice and maintenance of successful treatment: Strength, integrity, and effectiveness. J. Cons. Clin. Psych. 49: 156–167.
Witt, J. C., and Elliott, S. N. (1985). Acceptability of classroom intervention strategies. In Kratochwill, T. R. (ed.), Advances in School Psychology, Erlbaum, Hillsdale, NJ, pp. 251–288.
Wolf, M. M. (1978). The case for subjective measurement, or how behavior analysis is finding its heart. J. Appl. Behav. Anal. 11: 202–214.
Author information
Authors and Affiliations
Rights and permissions
About this article
Cite this article
Armstrong, K.J., Ehrhardt, K.E., Cool, R.T. et al. Social Validity and Treatment Integrity Data: Reporting in Articles Published in the Journal of Developmental and Physical Disabilities, 1991-1995. Journal of Developmental and Physical Disabilities 9, 359–367 (1997). https://doi.org/10.1023/A:1024982112859
Issue Date:
DOI: https://doi.org/10.1023/A:1024982112859