Abstract
Stimulus overselectivity remains an ill-defined concept within behavior analysis, because it can be difficult to distinguish truly restrictive stimulus control from random variation. Quantitative models of bias are useful, though perhaps limited in application. Over the last 50 years, research on stimulus overselectivity has developed a pattern of assessment and intervention repeatedly marred by methodological flaws. Here we argue that a molecular view of overselectivity, under which restricted stimulus control has heretofore been examined, is fundamentally insufficient for analyzing this phenomenon. Instead, we propose the use of the term “overselectivity” to define temporally extended patterns of restrictive stimulus control that have resulted in disproportionate populations of responding that cannot be attributed to chance alone, and highlight examples of overselectivity within the verbal behavior of children with autism spectrum disorder. Viewed as such, stimulus overselectivity lends itself to direct observation and measurement through the statistical analysis of single-subject data. In particular, we demonstrate the use of the Cochran Q test as a means of precisely quantifying stimulus overselectivity. We provide a tutorial on calculation, a model for interpretation, and a discussion of the implications for the use of Cochran’s Q by clinicians and researchers.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
Change history
18 October 2021
A Correction to this paper has been published: https://doi.org/10.1007/s40614-021-00319-6
Notes
Hall and Sundberg (1987) assessed tact control over 10–11 items, but only assessed mand control over 4 of those items. Because only four responses (r) were assessed across both conditions (c), the sample size (r*c) of n = 8 is insufficient for statistical analysis.
References
American Psychiatric Association. (2013). Diagnostic and statistical manual of mental disorders (5th ed.). https://doi.org/10.1176/appi.books.9780890425596
Bakker, M., & Wicherts, J. M. (2011). The (mis)reporting of statistical results in psychology journals. Behavior Research Methods, 43(3), 666–678. https://doi.org/10.3758/s13428-011-0089-5
Baron-Cohen, S. (2005). Autism—"autos": Literally, a total focus on the self? In T. E. Feinberg & J. P. Keenan (Eds.), The lost self: Pathologies of the brain and identity (pp. 166–180). Oxford University Press. https://doi.org/10.1093/acprof:oso/9780195173413.003.0011
Berry, K. J., Johnston, J. E., & Mielke Jr., P. W. (2007). An alternative measure of effect size for Cochran's Q test for related proportions. Perceptual & Motor Skills, 104, 1236–1242. https://doi.org/10.2466/pms.104.4.1236-1242
Brown, S. M., & Bebko, J. M. (2012). Generalization, overselectivity, and discrimination in the autism phenotype: A review. Research in Autism Spectrum Disorders, 6(2), 733–740. https://doi.org/10.1016/j.rasd.2011.10.012
Cochran, W. G. (1950). The comparison of percentages in matched samples. Biometrika, 37(3–4), 256–266. https://doi.org/10.2307/2332378
Cohen, B. H. (2013). Explaining psychological statistics (4th ed.). John Wiley and Sons.
Davis, D. G. (2017). Novice behavior in a makerspace: Pragmatic pathways to shaping CS identity (Doctoral dissertation, University of Texas at San Antonio).
Davison, M. (1999). Statistical inference in behavior analysis: Having my cake and eating it? The Behavior Analyst, 22(2), 99–103. https://doi.org/10.1007/BF03391986
Dixon, M. R. (2014). The PEAK relational training system module 1: Direct training. Shawnee Scientific Press.
Dowdy, A., Peltier, C., Tincani, M., Schneider, W. J., Hantula, D. A., & Travers, J. C. (2021). Meta-analyses and effect sizes in applied behavior analysis: A review and discussion. Journal of Applied Behavior Analysis. https://doi.org/10.1002/jaba.862
Dube, W. V., Farber, R. S., Mueller, M. R., Grant, E., Lorin, L., & Deutsch, C. K. (2016). Stimulus overselectivity in autism, Down syndrome, and typical development. American Journal on Intellectual & Developmental Disabilities, 121(3), 219–235. https://doi.org/10.1352/1944-7558-121.3.219
Dunn, O. J. (1964). Multiple comparisons using rank sums. Technometrics, 6(3), 241–252. https://doi.org/10.1080/00401706.1964.10490181
Fairbanks, D. J., & Rytting, B. (2001). Mendelian controversies: A botanical and historical review. American Journal of Botany, 88(5), 737–752. https://doi.org/10.2307/2657027
Ferster, C. B., Culbertson, S., & Boren, M. C. (1975). Behavior principles (2nd ed.). Prentice Hall.
Gamba, J., Goyos, C., & Petursdottir, A. I. (2015). The functional independence of mands and tacts: Has it been demonstrated empirically? Analysis of Verbal Behavior, 31(1), 10–38. https://doi.org/10.1007/s40616-014-0026-7
Gersten, R. M. (1980). In search of the cognitive deficit in autism: Beyond the stimulus overselectivity model. Journal of Special Education, 14(1), 47–65. https://doi.org/10.1177/002246698001400106
Guttman, N., & Kalish, H. I. (1956). Discriminability and stimulus generalization. Journal of Experimental Psychology, 51(1), 79–88. https://doi.org/10.1037/h0046219
Hall, G., & Sundberg, M. L. (1987). Teaching mands by manipulating conditioned establishing operations. Analysis of Verbal Behavior, 5(1), 41–53. https://doi.org/10.1007/bf03392819
Hannula, C., Jimenez-Gomez, C., Wu, W., Brewer, A. T., Kodak, T., Gilroy, S. P., Hutsel, B. A., Alsop, B., & Podlesnik, C. A. (2020). Quantifying errors of bias and discriminability in conditional-discrimination performance in children diagnosed with autism spectrum disorder. Learning & Motivation, 71, Article 101659. https://doi.org/10.1016/j.lmot.2020.101659
Hoaglin, D. C. (2016). Misunderstandings about Q and “Cochran's Q test” in meta-analysis. Statistics in Medicine, 35(4), 485–495. https://doi.org/10.1002/sim.6632
Honig, W. K., & Urcuioli, P. J. (1981). The legacy of Guttman and Kalish (1956): Twenty-five years of stimulus generalization research. Journal of the Experimental Analysis of Behavior, 36, 405–445. https://doi.org/10.1901/jeab.1981.36-405
Ibrahim, K., & Sukhodolsky, D. G. (2018). RDoC and autism. In F. Volkmar (Ed.), Encyclopedia of autism spectrum disorders. Springer. https://doi.org/10.1007/978-1-4614-6435-8_102261-1
Kelley, M. E., Shillingsburg, M. A., Castro, M. J., Addison, L. R., LaRue Jr., R. H., & Martins, M. P. (2007). Assessment of the functions of vocal behavior in children with developmental disabilities: A replication. Journal of Applied Behavior Analysis, 40(3), 571–576. https://doi.org/10.1901/jaba.2007.40-571
Kelly, M. P., & Reed, P. (2020). Examination of stimulus over-selectivity in children with autism spectrum disorder and its relationship to stereotyped behaviors and cognitive flexibility. Focus on Autism & Other Developmental Disabilities, 36(1), 47–56. https://doi.org/10.1177/1088357620943504
Kyonka, E. G. (2019). Tutorial: Small-N power analysis. Perspectives on Behavior Science, 42(1), 133–152. https://doi.org/10.1007/s40614-018-0167-4
LaFrance, D., Wilder, D. A., Normand, M. P., & Squires, J. L. (2009). Extending the assessment of functions of vocalizations in children with limited verbal repertoires. Analysis of Verbal Behavior, 25, 19–32. https://doi.org/10.1007/BF03393067
Lerman, D. C., Parten, M., Addison, L. R., Vorndran, C. M., Volkert, V. M., & Kodak, T. (2005). A methodology for assessing the functions of emerging speech in children with developmental disabilities. Journal of Applied Behavior Analysis, 38(3), 303–316. https://doi.org/10.1901/jaba.2005.106-04
Lovaas, O. I., & Schreibman, L. (1971). Stimulus overselectivity of autistic children in a two stimulus situation. Behaviour Research & Therapy, 9, 305–310. https://doi.org/10.1016/0005-7967(71)90042-8
Lovaas, O. I., Koegel, R. L., & Schreibman, L. (1979). Stimulus overselectivity in autism: A review of research. Psychological Bulletin, 86, 1236–1254. https://doi.org/10.1037/0033-2909.86.6.1236
Mason, L. L., & Andrews, A. (2019). The verbal behavior stimulus control ratio equation: A quantification of language. Perspectives on Behavior Science, 42(2), 323–343. https://doi.org/10.1007/s40614-018-0141-1
McNemar, Q. (1962). Psychological statistics (3rd ed.). John Wiley & Sons.
Michael, J. (1974). Statistical inference for individual organism research: Mixed blessing or curse? Journal of Applied Behavior Analysis, 7(4), 647–653. https://doi.org/10.1901/jaba.1974.7-647
Moxley, R. (1987). Three conceptual units for behavior. The Behavior Analyst, 10(1), 17–26. https://doi.org/10.1007/bf03392403
Normand, M. P., Severtson, E. S., & Beavers, G. A. (2008). A functional analysis of nonvocal verbal behavior of a young child with autism. Analysis of Verbal Behavior, 24, 63–67. https://doi.org/10.1007/BF03393057
Partington, J. W. (2006). The assessment of basic language and learning skills—revised (ABLLS–R). Behavior Analysts.
Ploog, B. O. (2010). Stimulus overselectivity four decades later: A review of the literature and its implications for current research in autism spectrum disorder. Journal of Autism & Developmental Disorders, 40, 1332–1349. https://doi.org/10.1007/s10803-010-0990-2
Reed, S. R., Stahmer, A. C., Suhrheinrich, J., & Schreibman, L. (2013). Stimulus overselectivity in typical development: Implications for teaching children with autism. Journal of Autism & Developmental Disorders, 43, 1249–1257. https://doi.org/10.1007/s10803-012-1658-x
Rieth, S. R., Stahmer, A. C., Suhrheinrich, J., & Schreibman, L. (2015). Examination of the prevalence of stimulus overselectivity in children with ASD. Journal of Applied Behavior Analysis, 48(1), 71–84. https://doi.org/10.1002/jaba.165
Rincover, A., Feldman, M., & Eason, L. (1986). “Tunnel vision”: A possible keystone stimulus control deficit in autistic children. Analysis & Intervention in Developmental Disabilities, 6(4), 283–304. https://doi.org/10.1016/s0270-4684(86)80010-6
Shahan, T. A., & Podlesnik, C. A. (2008). Quantitative analyses of observing and attending. Behavioural Processes, 78(2), 145–157. https://doi.org/10.1016/j.beproc.2008.01.012
Sidman, M. (1979). Remarks. Behaviorism, 7, 123–126. https://doi.org/10.1080/15021149.2011.11434377
Skinner, B. F. (1957). Verbal behavior. Appleton-Century-Crofts.
Skinner, B. F. (1973). Answers for my critics. In H. Wheeler (Ed.), Beyond the punitive society (pp. 256–266). W. H. Freeman.
Stokes, T. (1992). Discrimination and generalization. Journal of Applied Behavior Analysis, 25(2), 429–432. https://doi.org/10.1901/jaba.1992.25-429
Stokes, T. F., & Baer, D. M. (1977). An implicit technology of generalization. Journal of Applied Behavior Analysis, 10(2), 349–367. https://doi.org/10.1901/jaba.1977.10-349
Sundberg, M. L. (2007). The Verbal Behavior Milestones Assessment and Placement Program (VB-MAPP): Field-test data from typical children and children with autism. Paper presented at the meeting of the Association for Behavior Analysis International, San Diego, CA.
Sundberg, M. L. (2008). Verbal Behavior Milestones Assessment and Placement Program: The VB–MAPP. AVB Press.
Tate, M. W., & Brown, S. M. (1970). Note on the Cochran Q test. Journal of the American Statistical Association, 65(329), 155–160. https://doi.org/10.1080/01621459.1970.10481069
Wing, L. (1988). The continuum of autistic disorders. In E. Schopler & G. M. Mesihov (Eds.), Diagnosis and assessment in autism (pp. 91–110). Plenum.
Young, M. E. (2018). A place for statistics in behavior analysis. Behavior Analysis: Research & Practice, 18(2), 193–202. https://doi.org/10.1037/bar0000099
Acknowledgments
The authors thank Jesse Anderson, Duy Le, and Chris Ninness for comments on a prior version of this article.
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Conflicts of interest
We have no explicit conflicts of interest to disclose.
Additional information
Publisher’s Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
This article was update to correct an error introduced in Eq. 5 during the production process after authors had reviewed the proofs.
Rights and permissions
About this article
Cite this article
Mason, L., Otero, M. & Andrews, A. Cochran’s Q Test of Stimulus Overselectivity within the Verbal Repertoire of Children with Autism. Perspect Behav Sci 45, 101–121 (2022). https://doi.org/10.1007/s40614-021-00315-w
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s40614-021-00315-w