Abstract
This research examined the degree to which skill and anxiety ratings vary as a function of audio, video, or live rating conditions. The question was addressed through a generalizability analysis which indicated that ratings of skill may generalize across audio, video, or live rating modes and across judges within a mode. However, results for anxiety show that while one can generalize across modes, there is a lack of comparability across judges within modes. This finding indicates the need for more judges in order to obtain acceptable levels of reliability for anxiety. Additional validity analyses suggest that the use of videotapes for ratings of skill maximizes the information obtained from role-play techniques for the assessment of heterosexual social performance.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Arkowitz, H., Lichtenstein, E., McGovern, K., and Hines, P. The behavioral assessment of social competence in males.Behavior Therapy 1975,6 3–13.
Bander, K. W., Steinke, G. V., Allen, G. J., and Mosher, D. L. Evaluation of three dating specific approaches for treatment of dating anxiety.Journal of Consulting and Clinical Psychology 1975,43 259–265.
Barlow, D. H., Abel, G. G., Blanchard, E. B., Bristow, A. R., and Young, L. D. A heterosocial skills behavior checklist for males.Behavior Therapy 1977,8 229–239.
Bellack, A. S. A critical appraisal of strategies for assessing social skill.Behavioral Assessment 1979,1 157–176.
Borkovec, T. D., Stone, N., O'Brien, G., and Kaloupek, D. G. Evaluation of a clinically relevant target behavior for analog outcome research.Behavior Therapy 1974,5 503–513.
Clark, J. V., and Arkowitz, H. Social anxiety and self-evaluation of interpersonal performance.Psychological Reports 1975,36 211–221.
Cohen, J., and Cohen, P.Applied multiple regression/correlation analysis for the behavioral sciences. Hillsdale, N.J.: Lawrence Erlbaum Associates, 1975.
Cole, D. A., Howard, G. S., and Maxwell, S. E. The effects of mono-versus multiple-operationalization in construct validation efforts.Journal of Consulting and Clinical Psychology 1981,49 395–405.
Conger, A. J., Wallander, J. L., Ward, D. G., and Farrell, A. D.Ratings of heterosocial anxiety and skill: 1 + 1 = 1 Unpublished manuscript. West Lafayette, Ind.: Purdue University, 1980.
Conger, J. C., and Conger, A. J. Components of heterosocial competence. In J. P. Curran and P. M. Monti (Eds.),Social skills training: A practical handbook for assessment and treatment. New York: Guilford Press, 1982.
Conger, J. C., and Farrell, A. D. Behavioral components of heterosocial skills.Behavior Therapy 1981,12 41–55.
Cronbach, L. J., Gleser, G. C., Nanda, H., and Rajaratnam, N.The dependability of behavioral measurements: Theory of generalizability for scores and profiles. New York: John Wiley & Sons, 1972.
Curran, J. P. Social skills training and systematic desensitization in reducing dating anxiety.Behavior Research and Therapy 1975,13 65–68.
Curran, J. P. Skills training as an approach to the treatment of heterosexual-social anxiety: A review.Psychological Bulletin 1977,84 140–157.
Curran, J. P. Comments on Bellack, Hersen, and Turner's paper on the validity of roleplay test.Behavior Therapy 1978,9 462–468.
Curran, J. P. and Gilbert, F. S. A test of the relative effectiveness of a systematic desensitization program and an interpersonal skills training program with date anxious objects.Behavior Therapy 1975,6 510–521.
Curran, J. P., Gilbert, F. S., and Little, L. M. A comparison between behavioral training and sensitivity training approaches to dating anxiety.Journal of Counseling Psychology 1976,23 190–196.
Duncan, S., and Fiske, D. W.Face-to-face interaction. New York: Halstead Press, 1977.
Farrell, A. D.Self- and judges' ratings of heterosexual-social anxiety and skill: A generalizability study Unpublished master's thesis. West Lafayette, Ind.: Purdue University, 1977.
Glasgow, R., and Arkowitz, H. The behavioral assessment of male and female social competence in dyadic heterosexual interactions.Behavior Therapy 1975,6 488–498.
Kupke, T. E., Hobbs, S. A., and Cheny, T. H. Selection of heterosocial skills. I. Criterionrelated validity.Behavior Therapy 1979,10 327–335.
MacDonald, M. L., Lindquist, C. U., Kramer, J. A., McGrath, R. A., and Rhyne, L. D. Social skills training: Behavior rehearsal in groups and dating skills.Journal of Counseling Psychology 1975,22 224–230.
Martinez-Diaz, J. A., and Edelstein, B. A. Heterosocial competence: Predictive and construct validity.Behavior Modification 1980,4 115–129.
McFall, R. M. Analogue methods in behavioral assessment: Issues and prospects. In J. D. Cone and R. P. Hawkins (Eds.),Behavioral assessment: New directions in clinical psychology. New York: Brunner/Mazel, 1977.
Mitchell, S. K. Interobserver agreement, reliability, and generalizability of data collected in observational studies.Psychological Bulletin 1979,86 376–390.
Moisan-Thomas, P. C.Effects of confederate responsivity on subsequent ratings of heterosexual social skill and anxiety Unpublished master's thesis. West Lafayette, Ind.: Purdue University, 1980.
Moisan-Thomas, P. C., and Conger, J. C. Confederate responsivity in the assessment of social skill. Paper presented at AABT, New York, 1980.
Monroe, M. D.The comparability of modes of observation for global ratings of heterosexual social skill and anxiety: A generalizability study Unpublished master's thesis, West Lafayette, Ind.: Purdue University, 1980.
Twentyman, C. T., and McFall, R. M. Behavioral training of social skills in shy males.Journal of Consulting and Clinical Psychology 1975,43 384–395.
Wessberg, H., Mariotto, M. J., Conger, A. J., Farrell, A. D., and Conger, J. C. The ecological validity of role plays for assessing heterosocial anxiety and skill of male college students.Journal of Consulting and Clinical Psychology 1979,47 525–535.
Wieder, G. B., and Weiss, R. L. Generalizability theory and the coding of marital interactions.Journal of Consulting and Clinical Psychology 1980,48 469–477.
Author information
Authors and Affiliations
Additional information
Appreciation is expressed to Jan Wallander, Betsy Firth, Dave Ward, Susan Keane, and Judy Dygdon, without whom this project could not have been completed.
Rights and permissions
About this article
Cite this article
Monroe, M.D., Conger, J.C., Conger, A.J. et al. Comparability of methods of observation for global ratings of heterosexual social skill and anxiety: A generalizability study. Journal of Behavioral Assessment 4, 87–102 (1982). https://doi.org/10.1007/BF01321384
Accepted:
Issue Date:
DOI: https://doi.org/10.1007/BF01321384