Skip to main content

Advertisement

SpringerLink
Log in

A Meta-Analysis of Applied Behavior Analysis-Based Interventions for Individuals with Autism Spectrum Disorders (ASD) in Turkey

  • Review Paper
  • Published:
Review Journal of Autism and Developmental Disorders Aims and scope Submit manuscript

Abstract

Interventions based on the principles of applied behavior analysis (ABA) have been determined to be evidenced-based practices and are widely used with individuals with autism spectrum disorders (ASD) across the world. Originally developed in the USA, implementation of these interventions has become widespread in the last decade in Turkey. Given the significance of culture in guiding ABA practices, this meta-analysis investigated the prevalence and the magnitude effects of ABA-based interventions and whether specific participant and intervention characteristics moderated such effects in Turkey. Seventy-one ABA-based intervention studies were assessed based on What Works Clearinghouse (WWC, Kratochwill et al., Remedial and Special Education, 34(1), 26–38, 2013) design standards (DSs) including (a) systematic manipulation of independent variables, (b) interrater reliability, (c) three demonstrations of the intervention effect, and (d) adequate number of data points collected for each condition. Forty-three studies that met WWC (Kratochwill et al., Remedial and Special Education, 34(1), 26–38, 2013) DSs were analyzed and calculated with baseline-corrected tau (Tarlow, Behavior Modification, 41(4), 427–467, 2017). Furthermore, performance-criteria-based effect size values (PCES; Aydin and Tanious, Journal of Applied Behavior Analysis, 2021) were calculated for 27 studies that had mastery criteria. While the overall tau appeared to be large 0.71 (p = 0.072, se = 0.254), the overall effect size for PCES revealed a small effect of 0.73. The comparisons of all sub-categories’ effect sizes of moderator variables were not statistically significant based on Kruskal Wallis or Mann Whitney U tests. Additionally, findings revealed that studies were predominantly implemented by highly trained researchers in segregated one-on-one settings, and did not include adults with ASD nor challenging behavior. Overall, there has been significant growth in ABA-based interventions in Turkey that show promise in improving the lives of individuals with ASD. However, further research and cultural considerations are essential for a comprehensive understanding of their impact in the Turkish context. Findings from two different effect size analyses and recommendations for future studies are discussed.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1

Similar content being viewed by others

Data Availability

The corresponding author can provide all original documents upon request.

References

References marked with an asterisk “*” indicate studies included in this review

  • *Acar, C., Tekin-Iftar, E., & Yikmis, A. (2017). Effects of mother-delivered social stories and video modeling in teaching social skills to children with autism spectrum disorders. The Journal of Special Education, 50(4), 215–226. https://doi.org/10.1177/2F0022466916649164

  • *Akcin, F. (2013). Comparison of two instructional strategies for students with autism to read sight words. Eurasian Journal of Educational Research, 13(51). https://avesis.marmara.edu.tr/yayin/e5f02528-edb1-49fa-8041-10878da5c372/comparison-of-two-instructional-strategies-for-students-with-autism-to-read-sight-words

  • *Akmanoglu, N. (2015). Effectiveness of teaching naming facial expression to children with autism via video modeling. Kuram ve Uygulamada Egitim Bilimleri, 15(2), 519–537. https://doi.org/10.12738/estp.2015.2.2603

  • *Akmanoglu, N., & Batu, S. (2004). Teaching pointing to numerals to individuals with autism using simultaneous prompting. Education and Training in Developmental Disabilities, 39(4), 326–336. https://www.jstor.org/stable/23880212

  • *Akmanoglu N., & Batu, S. (2005). Teaching naming relatives to individuals with autism using simultaneous prompting. Education and Training in Developmental Disabilities, 40(4), 401–410. https://www.jstor.org/stable/23879957

  • *Akmanoglu, N., & Tekin-Iftar, E. (2011). Teaching children with autism how to respond to the lures of strangers. Autism, 15(2), 205–222. https://doi.org/10.1177/1362361309352180

  • *Akmanoğlu, N., & Pektas-Karabekir, E. (2020). The effectiveness of video prompting in teaching children with autism the skill of drawing a six-part person. Journal of Developmental and Physical Disabilities, 32(4), 617–631. https://doi.org/10.1007/s10882-019-09709-w

  • *Akmanoglu, N., Yanardag, M., & Batu, E. S. (2014). Comparing video modeling and graduated guidance together and video modeling alone for teaching role playing skills to children with autism. Education and Training in Autism and Developmental Disabilities, 17–31. https://www.jstor.org/stable/23880652

  • *Akmanoglu, N., Kurt, O., & Kapan, A. (2015). Comparison of simultaneous prompting and constant time delay procedures in teaching children with autism the responses to questions about personal information. Educational Sciences: Theory & Practice, 15(3). https://doi.org/10.12738/estp.2015.3.2654

  • *Alp, H., & Akin, S. (2019). The effect of adapted basketball exercises on the development of non-oral communication skills of autistic children. Journal of Education and Training Studies, 7(10), 123–130. https://doi.org/10.11114/jets.v7i10.4435

  • American Psychiatric Association. (2013). Diagnostic and statistical manual of mental disorders (5th ed.). American Psychiatric Association Press.

    Book  Google Scholar 

  • *Ardiç, A., & Cavkaytar, A. (2014). Effectiveness of the modified intensive toilet training method on teaching toilet skills to children with autism. Education and Training in Autism and Developmental Disabilities, 263–276. https://www.jstor.org/stable/23880609.

  • Arıcan, G., Fazlıoğlu, Y., & Tezcan, S. (2018). Otizmli öğrencilere kendini tanıtma becerisinin öğretiminde videoyla model olmanın etkililiği [The effectiveness of using video modelling in teaching the self-introduction skills to students with autism]. Trakya Üniversitesi Sosyal Bilimler, 20(2), 157–179. https://doi.org/10.26468/trakyasobed.502208

  • Aydin, O. (2023). Rise of single-case experimental designs: A historical overview of the necessity of single-case methodology. Neuropsychological Rehabilitation, 1–34. https://doi.org/10.1080/09602011.2023.2181191

  • *Aydin, O., & Cavkaytar, A. (2020). Otizm spektrum bozukluğu olan bir çocuğa temel matematik becerilerinin öğretiminde baba eğitim programının etkililiği. [The effectiveness of the father education program in teaching the basic mathematical skills to a child with autism spectrum disorder]. Ankara University Faculty of Educational Sciences Journal of Special Education, 21(1) https://doi.org/10.21565/ozelegitimdergisi.523342

  • Aydin, O., & Tanious, R. (2021). Performance criteria-based effect size (PCES) measurement of single-case experimental designs: A real-world data study. Journal of Applied Behavior Analysis. https://doi.org/10.1002/jaba.928

    Article  Google Scholar 

  • Aydin, O., & Yassikaya, M. Y. (2022). Validity and reliability analysis of the PlotDigitizer software program for data extraction from single-case graphs. Perspectives on Behavior Science, 45(1), 239–257. https://doi.org/10.1007/s40614-021-00284-0

    Article  PubMed  Google Scholar 

  • Baer, D. M., Wolf, M. M., & Risley, T. R. (1968). Some current dimensions of applied behavior analysis. Journal of Applied Behavior Analysis, 1, 91–97. https://doi.org/10.1901/jaba.1968.1-91

    Article  PubMed  PubMed Central  Google Scholar 

  • *Bahcalı, T., & Ozen, A. (2019). Effectiveness of video modeling presented by tablet PC on teaching job interview skills to individuals with developmental disabilities. Education and Training in Autism and Developmental Disabilities, 54(3), 249–262. https://www.jstor.org/stable/26780625.

  • Bakkaloglu, H., Yılmaz, B., Altun Könez, N., & Yalçın, G. (2018). Türkiye’de okul öncesi kaynaştırma konusunda yapılan araştırmalar bize neler söylüyor? [What do the research about preschool inclusion in Turkey tell us?] Inonu University Journal of the Faculty of Education, 19(1), 119–150. http://dergipark.gov.tr/download/article-file/458833

  • *Balcik, B., & Ciftci-Tekinarslan, I. (2012). An investigation of the effect of social stories in teaching of social skills to children with autism. Ankara University Journal of Faculty of Educational Sciences (JFES), 45(1), 165–190. https://doi.org/10.1501/Egifak_0000001240

  • *Batu, S. E., Bozkurt, F., & Öncül, N. (2014). Effectiveness of mother delivered simultaneous prompting taught by visual support on teaching chained skills to their children with autism. Egitim ve Bilim, 39(174). https://www.proquest.com/docview/1554961323?pq-origsite=gscholar&fromopenview=true

  • Bauminger, N., Shulman, C., & Agam, G. (2003). Peer interaction and loneliness in high-functioning children with autism. Journal of Autism and Developmental Disorders, 33, 489–507. https://doi.org/10.1023/A:1025827427901

    Article  PubMed  Google Scholar 

  • *Besler, F., & Kurt, O. (2016). Effectiveness of video modeling provided by mothers in teaching play skills to children with autism. Kuram ve Uygulamada Egitim Bilimleri, 16(1), 209–230. https://doi.org/10.12738/estp.2016.1.0273

  • *Birkan, B. (1999). Otistik bir çocuğa öğrenmeye hazırlık becerilerinin öğretimi. [Teaching learning readiness skills to a child with autism].Özel Eğitim Dergisi, 2, 51–57. https://doi.org/10.1501/Ozlegt_0000000041

  • *Birkan, B., Krantz, P. J., & McClannahan, L. E. (2011). Teaching children with autism spectrum disorders to cooperate with injections. Research in Autism Spectrum Disorders, 5(2), 941–948. https://doi.org/10.1016/j.rasd.2010.11.004

  • *Bozkus-Genc, G., & Yucesoy-Ozkan, S. (2021). The efficacy of pivotal response treatment in teaching question-asking ınitiations to young turkish children with autism spectrum disorder. Journal of Autism and Developmental Disorders, 51(11), 3868–3886. https://doi.org/10.1007/s10803-020-04848-y

  • Burke, R. V., Andersen, M. N., Bowen, S. L., Howard, M. R., & Allen, K. D. (2010). Evaluation of two instruction methods to increase employment options for young adults with autism spectrum disorders. Research in Developmental Disabilities, 31(6), 1223–1233. https://doi.org/10.1016/j.ridd.2010.07.023

    Article  PubMed  Google Scholar 

  • Cakiroglu, O., & Melekoglu, M. A. (2014). Statistical trends and developments within inclusive education in Turkey. International Journal of Inclusive Education, 18(8), 798–808. https://doi.org/10.1080/13603116.2013.836573

    Article  Google Scholar 

  • *Cattik, M., & Odluyurt, S. (2017). The Effectiveness of the smart board-based small-group graduated guidance ınstruction on digital gaming and observational learning skills of children with autism spectrum disorder. Turkish Online Journal of Educational Technology-TOJET, 16(4), 84–102. https://files.eric.ed.gov/fulltext/EJ1160646.pdf

  • *Ciftci-Tekinarslan, I. & Kanpolat, Y. E. (2012). Otizmli bireylere adı söylenen giysiyi gösterme becerisinin öğretiminde bilgisayar destekli eşzamanlı ipucuyla öğretimin etkililiği [Effectiveness of computer assisted simultaneous prompting procedure on teaching skill of showing clothes of which name told to ındividuals with autism]. Gaziantep University Journal of Social Sciences, 11(4), 1058–1081. http://jss.gantep.edu.tr

  • Cohen, H., Amerine-Dickens, M., & Smith, T. (2006). Early intensive behavioral treatment: Replication of the UCLA model in a community setting. Developmental and Behavioral Pediatrics, 27, 145–155. Retrived from https://journals.lww.com/jrnldbp/Fulltext/2006/04002/Early_Intensive_Behavioral_Treatment_Replication.13.aspx

  • *Cuhadar, S., & Diken, I. H. (2011). Effectiveness of instruction performed through activity schedules on leisure skills of children with autism. Education And Training İn Autism And Developmental Disabilities, 46(3), 386–398. https://www.jstor.org/stable/23880593

  • *Dalgin-Eyiip, O., & Ulke-Kurkcuoglu, B. (2021). Video enhanced activity schedules: Teaching schedule following and pretend play skills to children with ASD. Education and Training in Autism and Developmental Disabilities, 56(2), 205–224. https://www.proquest.com/docview/2599642414?pq-origsite=gscholar&fromopenview=true

  • *Dargut-Güler, T., & Erdem, M. (2022). Use of mobile social story maps in the development of cognitive and social skills of children with autism spectrum disorder. Journal of Special Education Technology, 37(4), 482–497. https://doi.org/10.1177/01626434211037547

  • David, M., Mason, R. A., Davis, J. L., Gregori, E., Lei, Q., Lory, C., & Wang, D. (2022). School-based ınterventions targeting challenging behavior of adolescents with developmental disabilities: A meta-analysis. Journal of Developmental and Physical Disabilities, 1–30. https://doi.org/10.1007/s10882-022-09841-0

  • *Demirtaş, Ş., & Aykut, Ç. (2021). Determining the effectiveness of pivotal response teaching on expressive language skills of children with autism spectrum disorders. Hacettepe University Journal of Education, 36(2), 430–449. https://doi.org/10.16986/HUJE.2020058879

  • Dennison, A., Lund, E. M., Brodhead, M. T., Mejia, L., Armenta, A., & Leal, J. (2019). Delivering home-supported applied behavior analysis therapies to culturally and linguistically diverse families. Behavior Analysis in Practice, 12(4), 887–898. https://doi.org/10.1007/s40617-019-00374-1

    Article  PubMed  PubMed Central  Google Scholar 

  • Dingfelder, H. E., & Mandell, D. S. (2011). Bridging the research-topractice gap in autism intervention: An application of diffusion of innovation theory. Journal of Autism and Developmental Disorders, 41, 597–609. https://doi.org/10.1007/s10803-010-1081-0

    Article  PubMed  PubMed Central  Google Scholar 

  • Dixon, M. R., Belisle, J., Stanley, C., Speelman, R., Rowsey, K. E., & Daar, J. H. (2016). Establishing derived categorical responding in children with disabilities using the PEAK-E curriculum. Journal of Applied Behavior Analysis, 50, 134–145. https://doi.org/10.1002/jaba.355

    Article  PubMed  Google Scholar 

  • Dixon, M. R., Paliliunas, D., Barron, B. F., Schmick, A. M., & Stanley, C. R. (2021). Randomized controlled trial evaluation of ABA content on IQ gains in children with autism. Journal of Behavioral Education, 30, 455–477. https://doi.org/10.1007/s10864-019-09344-7

    Article  Google Scholar 

  • *Dogru, S. S. Y., Onal, Ö. B. Y., & Bwk, H.. (2007). Teaching how to ride a balance wheeled bicycle to autistic children using the direct instruction method. Selçuk Üniversitesi Sosyal Bilimler Enstitüsü Dergisi, (18), 245–256. https://dergipark.org.tr/en/pub/susbed/issue/61794/924224

  • Dowdy, A., Peltier, C., Tincani, M., Schneider, W. J., Hantula, D. A., & Travers, J. C. (2021). Meta-analyses and effect sizes in applied behavior analysis: A review and discussion. Journal of Applied Behavior Analysis, 54(4), 1317–1340. https://doi.org/10.1002/jaba.862

    Article  PubMed  Google Scholar 

  • Dunn, O. J. (1964). Multiple comparisons using rank sums. Technometrics, 6(3), 241–252.

    Article  Google Scholar 

  • Edrisinha, C., O’Reilly, M. F., Choi, H. Y., Sigafoos, J., & Lancioni, G. E. (2011). “Say Cheese”: Teaching photography skills to adults with developmental disabilities. Research in Developmental Disabilities, 32(2), 636–642. https://doi.org/10.1016/j.ridd.2010.12.006

    Article  PubMed  Google Scholar 

  • Eldevik, S., Hastings, R. P., Hughes, C., Jahr, E., Eikeseth, S., & Cross, S. (2009). Meta-analysis of early intensive behavioral intervention for children with autism. Journal of Clinical Child and Adolescent Psychology, 38(3), 439–450. https://doi.org/10.1080/15374410902851739

    Article  PubMed  Google Scholar 

  • *Elicin, Ö., & Tunali, V. (2016). Otizmli Çocuklara aşamalı yardımla çizelge kullanım becerilerinin kazandırılmasında tablet bilgisayar çizelge programının etkililiği [Effectiveness of tablet computer use in achievement of schedule-following skills by children with autism using graduated guidance]. Egitim ve Bilim, 41(183), 29–46. https://doi.org/10.15390/EB.2016.5358

  • *Eren, B., Deniz, J., & Duzkantar, A. (2013). Orff yaklaşımına göre hazırlanan müzik etkinlikleri içinde ıpucunun giderek azaltılması yöntemi ıle yapılan gömülü öğretiminin Otistik çocuklara Kavram öğretmedeki etkililiği [The effectiveness of embedded teaching through the most-to-least prompting procedure in concept teaching to children with autism within orff-based music activities). Educational Sciences: Theory & Practice, 13 (3), 1863–1887. https://doi.org/10.12738/estp.2013.3.1499

  • *Ergenekon, Y., Tekin-Iftar, E., Kapan, A., & Akmanoglu, N. (2014). Comparison of video and live modeling in teaching response chains to children with autism. Education and Training in Autism and Developmental Disabilities, 49(2), 200–213. https://www.jstor.org/stable/23880605

  • Esteves, J., Perry, A., Spiegel, R., & Weiss, J. A. (2021). Occurrence and predictors of challenging behavior in youth with intellectual disability with or without autism. Journal of Mental Health Research in Intellectual Disabilities, 14, 189–201. https://doi.org/10.1080/19315864.2021.1874577

    Article  Google Scholar 

  • Farmer, C. A., & Aman, M. G. (2011). Aggressive behavior in a sample of children with autism spectrum disorders. Research Autism Spectrum Disorders, 5, 317–323. https://doi.org/10.1016/j.rasd.2010.04.014

    Article  Google Scholar 

  • Fein, D., Barton, M., Eigsti, I. M., Kelley, E., Naigles, L., Schultz, R. T., Stevens, M., Helt, M., Orinstein, A., Rosenthal, M., Troyb, E., & Tyson, K. (2013). Optimal outcome in individuals with a history of autism. Journal of Child Psychology and Psychiatry, 54(2), 195–205. https://doi.org/10.1111/jcpp.12037

    Article  PubMed  Google Scholar 

  • Fisher, W. W., Piazza, C. C., & Roane, H. S. (Eds.). (2013). Handbook of applied behavior analysis. Guilford Publications. https://www.bacb.com/wp-content/uploads/2022/01/BCBAHandbook_221202.pdf

  • Fitzpatrick, S. E., Srivorakiat, L., Wink, L. K., Pedapati, E. V., & Erickson, C. A. (2016). Aggression in autism spectrum disorder: Presentation and treatment options. Neuropsychiatric Disease and Treatment, 12, 1525–1538. https://doi.org/10.1037/t48217-000

    Article  PubMed  PubMed Central  Google Scholar 

  • *Genc-Tosun, D., & Kurt, O. (2017a). Teaching multi-step requesting to children with autism spectrum disorder using systematic instruction and a speech-generating device. AAC: Augmentative and Alternative Communication, 33(4), 213–223. https://doi.org/10.1080/07434618.2017.1378717

  • *Genc-Tosun, D., & Kurt, O. (2017b). Effects of video modeling on the instructional efficiency of simultaneous prompting among preschoolers with autism spectrum disorder. Education and Training in Autism and Developmental Disabilities, 52(3), 291–304. https://www.jstor.org/stable/26420401

  • Gregori, E., Wendt, O., Gerow, S., Peltier, C., Genc-Tosun, D., Lory, C., & Gold, Z. S. (2019). Functional communication training for adults with autism spectrum disorder: A systematic review and quality appraisal. Journal of Behavioral Education., 29(1), 42–63. https://doi.org/10.1007/s10864-019-09339-4

    Article  Google Scholar 

  • Güleç-Aslan, Y. (2020). Experiences of Turkish preschool teachers for including children with autism spectrum disorders: Challenges faced and methods used. International Journal of Psychology and Educational Studies, 7(2), 37–49. https://doi.org/10.17220/ijpes.2020.02.004

    Article  Google Scholar 

  • *Gülsöz, T., & Çikili, Y. (2018). Otizm spektrum bozukluğu olan öğrencilere soğuk içecek hazırlama ve sunma becerisinin video model ile öğretimin etkililiği. [The effectıveness of teachıng cold beverage preparatıon and presentatıon skılls through avıdeo model to the students wıth autısm spectrum disorder] Abant İzzet Baysal Üniversitesi Eğitim Fakültesi Dergisi, 18(1), 210–229. https://doi.org/10.17240/aibuefd.2018..-379998.

  • Hernandez, P., & Ikkanda, Z. (2011). Applied behavior analysis: Behavior management of children with autism spectrum disorders in dental environments. The Journal of the American Dental Association, 142(3), 281–287. https://doi.org/10.14219/jada.archive.2011.0167

  • Hong, E. R., Ganz, J. B., Neely, L., Gerow, S., & Ninci, J. (2016). A review of the quality of primary caregiver-implemented communication intervention research for children with ASD. Research in Autism Spectrum Disorders, 25, 122–136. https://doi.org/10.1016/j.rasd.2016.02.005

    Article  Google Scholar 

  • *Horasan, M. M., & Birkan, B. (2015). Fırsat öğretiminin otizm spektrum bozukluğu olan çocuklara kaybolan nesnelerini sözcük kullanarak isteme becerisinin öğretiminde etkililiği. [The effects of ıncidental teaching on teaching children with autism spectrum disorders to demand their lost objects verbally]. International Journal of Early Childhood Special Education, 7(2), 361–383. https://eds.p.ebscohost.com/eds/detail/detail?vid=0&sid=b496fdc0-a11c-4450-aff0-6fbf5267de85%40redis&bdata=JnNpdGU9ZWRzLWxpdmU%3d#AN=112266219&db=eue

  • Ivy, J. W., & Schreck, K. A. (2016). Efficacy of ABA for individuals with autism across the life span. Current Developmental Disorders Reports, 3, 57–66. https://doi.org/10.1007/s40474-016-0070-1

    Article  Google Scholar 

  • Jobe, L. E., & White, S. W. (2007). Loneliness, social relationships, and a broader autism phenotype in college students. Personality and Individual Differences, 42, 1479–1489. https://doi.org/10.1016/j.paid.2006.10.021

    Article  Google Scholar 

  • Kahveci, G., & Ataman, A. (2017). The effect of conjoint behavioral consultation program related teaching on problem behavior and communication/social skills with a blind and autistic child. Journal of Education and Learning, 6(4), 372–383. https://doi.org/10.5539/jel.v6n4p372

    Article  Google Scholar 

  • Karal, M. A. (2021). Contemporary ıssues of special education in Turkey. Journal of Special Education Preparation, 1(2), 56–64. https://doi.org/10.33043/JOSEP.1.2.56-64

    Article  Google Scholar 

  • *Kaya, F., & Yucesoy-Ozkan, S. (2022). Self-directed video prompting with and without voice-over narration in teaching daily living skills to students with autism spectrum disorder. Education and Treatment of Children, 45(1), 1-15. https://doi.org/10.1007/s43494-021-00060-4

  • *Kiyak, U. E., & Tekin‐Iftar, E. (2022). General education teacher preparation in core academic content teaching for students with developmental disabilities. Behavioral Interventions, 37(2), 363-382. https://doi.org/10.1002/bin.1847

  • Koegel, L. K., Koegel, R. L., Frea, W. D., & Freeden, R. M. (2001). Identifying early intervention targets for children with autism in inclusive school settings. Behavior Modification, 25(5), 745–761. https://doi.org/10.1177/2F0145445501255005

    Article  PubMed  Google Scholar 

  • Koegel, L. K., Vernon, T., Koegel, R. L., Koegel, B. L., & Paullin, A. W. (2012). Improving social engagement and initiations between children with autism spectrum disorder and their peers in inclusive settings. Journal of Positive Behavioral Interventions, 14(4), 220–227. https://doi.org/10.1177/2F1098300712437042

    Article  Google Scholar 

  • Koldas, M., Filiz, M., Storey, C., & Booth, N. (2023). Evaluating the efficacy of online verbal behaviour training to aba-practitioners working with autistic individuals. International Journal of Educational Research, 117, 102126. https://doi.org/10.1016/j.ijer.2022.102126

    Article  Google Scholar 

  • Koydemir-Özden, S., & Tosun, Ü. (2010). A qualitative approach to understanding Turkish mothers of children with autism: Implications for counselling. Journal of Psychologists and Counsellors in Schools, 20(1), 55–68. https://doi.org/10.1375/ajgc.20.1.55

    Article  Google Scholar 

  • Kratochwill, T. R., Hitchcock, J. H., Horner, R. H., Levin, J. R., Odom, S. L., Rindskopf, D. M., & Shadish, W. R. (2013). Single-case intervention research design standards. Remedial and Special Education, 34(1), 26–38. https://doi.org/10.1177/0741932512452794

    Article  Google Scholar 

  • Kruskal, W. H., & Wallis, W. A. (1952). Use of ranks in one-criterion variance analysis. Journal of the American Statistical Association, 47(260), 583–621. https://doi.org/10.1080/01621459.1952.10483441

    Article  Google Scholar 

  • Kuhn, D. E., Hardesty, S. L., & Sweeney, N. M. (2009). Assessment and treatment of excessive straightening and destructive behavior in an adolescent diagnosed with autism. Journal of Applied Behavior Analysis, 42(2), 355–360. https://doi.org/10.1901/jaba.2009.42-355

    Article  PubMed  PubMed Central  Google Scholar 

  • *Kurnaz, E., & Yanardag, M. (2018). The effectiveness of video self-modeling in teaching active video game skills to children with autism spectrum disorder. Journal of Developmental and Physical Disabilities, 30(4), 455–469. https://doi.org/10.1007/s10882-018-9596-y

  • *Kurt, O., & Tekin-Iftar, E. (2008). A comparison of constant time delay and simultaneous prompting within embedded instruction on teaching leisure skills to children with autism. Topics in Early Childhood Special Education, 28(1), 53–64. https://doi.org/10.1177/2F0271121408316046

  • *Kurt, O., & Kutlu, M. (2019). Effectiveness of social stories in teaching abduction-prevention skills to children with autism. Journal of Autism and Developmental Disorders, 49(9), 3807-3818. https://doi.org/10.1007/s10803-019-04096-9

  • Ledford, J. R., & Gast, D. L. (Eds.). (2018). Single case research methodology (p. 377). Routledge.

    Google Scholar 

  • Liao, Y., Dillenburger, K., He, W., Xu, Y., & Cai, H. (2020). A systematic review of applied behavior analytic interventions for children with autism in Mainland China. Review of Journal of Autism and Developmental Disorders, 7, 333–351. https://doi.org/10.1007/s40489-020-00196-w

    Article  Google Scholar 

  • Locke, J., Ishijima, E. H., Kasari, C., & London, N. (2010). Loneliness, friendship quality, and the social networks of adolescents with high-functioning autism in an inclusive school setting. Journal of Research in Special Educational Needs, 10(2), 74–81. https://doi.org/10.1111/j.1471-3802.2010.01148.x

    Article  Google Scholar 

  • Lory, C., Mason, R. A., Davis, J. L., Wang, D., Kim, S. Y., Gregori, E., & David, M. (2020). A meta-analysis of challenging behavior interventions for students with developmental disabilities in inclusive school settings. Journal of Autism and Developmental Disorders, 50(4), 1221–1237. https://doi.org/10.1007/s10803-019-04329-x

    Article  PubMed  Google Scholar 

  • Maggin, D. M., Briesch, A. M., & Chafouleas, S. M. (2013). An application of the What Works Clearinghouse standards for evaluating single-subject research: Synthesis of the self-management literature base. Remedial and Special Education, 34(1), 44–58. https://doi.org/10.1177/2F0741932511435176

    Article  Google Scholar 

  • Makrygianni, M. K., Gena, A., Katoudi, S., & Galanis, P. (2018). The effectiveness of applied behavior analytic interventions for children with autism spectrum disorder: A meta-analytic study. Research in Autism Spectrum Disorders, 51, 18–31. https://doi.org/10.1016/j.rasd.2018.03.006

    Article  Google Scholar 

  • Mann, H. B., & Whitney, D. R. (1947). On a test of whether one of two random variables is stochastically larger than the other. The Annals of Mathematical Statistics, 50–60. https://www.jstor.org/stable/2236101

  • Martella, R. C., Nelson, J. R., Morgan, R. L., & Marchand-Martella, N. E. (2013). Understanding and interpreting educational research. Guilford Press.

    Google Scholar 

  • Maskey, M., Warnell, F., Parr, J. R., Le Couteur, A., & McConachie, H. (2013). Emotional and behavioural problems in children with autism spectrum disorder. Journal of Autism and Developmental Disorders, 43, 851–859. https://doi.org/10.1007/s10803-012-1622-9

    Article  PubMed  Google Scholar 

  • Matson, J. L., & LoVullo, S. V. (2008). A review of behavioral treatments for self-injurious behaviors of persons with autism spectrum disorders. Behavior Modification, 32(1), 61–76. https://doi.org/10.1177/0145445507304581

    Article  PubMed  Google Scholar 

  • Mazurek, M. O., Kanne, S. M., & Wodka, E. L. (2013). Physical aggression in children and adolescents with autism spectrum disorders. Research in Autism Spectrum Disorders, 7(3), 455–465. https://doi.org/10.1016/j.rasd.2012.11.004

    Article  Google Scholar 

  • McConachie, H., & Diggle, T. (2007). Parent implemented early intervention for young children with autism spectrum disorder: A systematic review. Journal of Evaluation in Clinical Practice, 13(1), 120–129. https://doi.org/10.1111/j.1365-2753.2006.00674.x

    Article  PubMed  Google Scholar 

  • McDougale, C. B., Richling, S. M., Longino, E. B., & O’Rourke, S. A. (2020). Mastery criteria and maintenance: A descriptive analysis of applied research procedures. Behavior Analysis in Practice, 13(2), 402–410. https://doi.org/10.1007/s40617-019-00365-2

    Article  PubMed  Google Scholar 

  • Meadan, H., Ostrosky, M. M., Zaghlawan, H. Y., & Yu, S. (2009). Promoting the social and communicative behavior of young children with autism spectrum disorders: A review of parent-implemented intervention studies. Topics in Early Childhood Special Education, 29(2), 90–104. https://doi.org/10.1177/2F0271121409337950

    Article  Google Scholar 

  • Neil, N., Amicarelli, A., Anderson, B. M., & Liesemer, K. (2021). A meta-analysis of single-case research on applied behavior analytic ınterventions for people with down syndrome. American Journal on Intellectual and Developmental Disabilities, 126(2), 114–141. https://doi.org/10.1352/1944-7558-126.2.114

    Article  PubMed  Google Scholar 

  • *Odluyurt, S., Aldemir, O., & Kapan, A. (2016). An investigation on the effects of PECS and observational learning in initiating and maintenance of communication among children with autism. International Journal of Early Childhood Special Education, 8(2), 151–164. https://doi.org/10.20489/intjecse.284658

  • *Olcay-Gul, S., & Vuran, S. (2019). Effectiveness of teaching social skills to ındividuals with autism spectrum disorders using cool versus not cool. Education and Training in Autism and Developmental Disabilities, 54(2), 132–146. https://doi.org/10.2307/26663972

  • *Olcay gul, S., Vuran, S., Gönen, A., Uslucan, G., & Kayhan, H. C. (2019). Otizm spektrum bozukluğu olan öğrencilere toplumsal levhaları izleme becerisinin kazandırılmasında video modelle öğretimin etkililiği. [Effectiveness of video modeling in teaching following public direction signs for students with autism spectrum disorders]. Hacettepe Egitim Dergisi, 34(2), 487–504. https://doi.org/10.16986/HUJE.2018040666

  • *Ozen, A., Batu, S., & Birkan, B. (2012). Teaching play skills to children with autism through video modeling: Small group arrangement and observational learning. Education and Training in Autism and Developmental Disabilities, 47(1), 84–96. https://www.jstor.org/stable/23880564

  • Ozen, A., Ergenekon, Y., & Ulke-Kurkcuoglu, B. (2017). Effects of using simultaneous prompting and computer-assisted instruction during small group instruction. Journal of Early Intervention, 39(3), 236–252. https://doi.org/10.1177/2F1053815117708998

    Article  Google Scholar 

  • Ozen, A., Genc-Tosun, D., & Tekin-Iftar, E. (2022). Response prompting procedures delivered within embedded teaching trials for teaching chained skills. Behavioral Interventions, 37(4), 1096–1117. https://doi.org/10.1002/bin.1887

    Article  Google Scholar 

  • Patterson, S. Y., Smith, V., & Mirenda, P. (2012). A systematic review of training programs for parents of children with autism spectrum disorders: Single subject contributions. Autism, 16(5), 498–522. https://doi.org/10.1177/2F1362361311413398

    Article  PubMed  Google Scholar 

  • *Pektas-Karabekir, E., & Akmanoğlu, N. (2018). Effectiveness of video modeling presented via smartboard for teaching social response behavior to children with autism. Education and Training in Autism and Developmental Disabilities, 53(4), 363–377. https://www.jstor.org/stable/26563479

  • Plavnick, J. B., Marchand-Martella, N. E., Martella, R. C., Thompson, J. L., & Wood, A. L. (2015). A review of explicit and systematic scripted instructional programs for students with autism spectrum disorder. Review Journal of Autism and Developmental Disorders, 2(1), 55–66. https://doi.org/10.1007/s40489-014-0036-3

    Article  Google Scholar 

  • Polanin, J. R., Tanner-Smith, E. E., & Hennessy, E. A. (2016). Estimating the difference between published and unpublished effect sizes: A meta-review. Review of Educational Research, 86(1), 207–236. https://doi.org/10.3102/2F0034654315582067

    Article  Google Scholar 

  • Postorino, V., Sharp, W. G., McCracken, C. E., Bearss, K., Burrell, T. L., Evans, A. N., & Scahill, L. (2017). A systematic review and meta-analysis of parent training for disruptive behavior in children with autism spectrum disorder. Clinical Child and Family Psychology Review, 20(4), 391–402. https://doi.org/10.1007/s10567-017-0237-2

    Article  PubMed  Google Scholar 

  • *Rakap, S., & Balikci, S. (2017). Using embedded instruction to teach functional skills to a preschool child with autism. International Journal of Developmental Disabilities, 63(1), 17-26. https://doi.org/10.1080/20473869.2015.1109801

  • Roth, M. E., Gillis, J. M., & DiGennaro Reed, F. D. (2014). A meta-analysis of behavioral interventions for adolescents and adults with autism spectrum disorders. Journal of Behavioral Education, 23, 258–286. https://doi.org/10.1007/s10864-013-9189-x

    Article  Google Scholar 

  • *Safak, P., Demiryürek, P., & Yilmaz, H. C. (2018). Çok duyulu öykülerin ağır ve çoklu yetersizliği olan görmeyen öğrencilerin dinlediğini anlamalarına etkisi. [The effect of multisensory stories on listening comprehension of children who are blind with severe and multiple disabilities]. Ankara Üniversitesi Eğitim Bilimleri Fakültesi Özel Eğitim Dergisi, 19(1), 129–153. https://doi.org/10.21565/ozelegitimdergisi.322391

  • *Şahin, Ş., & Özen, A. (2021). Massed versus embedded trial arrangements: Teaching community signs to children with autism spectrum disorder. Ankara Üniversitesi Eğitim Bilimleri Fakültesi Özel Eğitim Dergisi, 22(1), 61–85. https://doi.org/10.21565/ozelegitimdergisi.624016

  • *Sani-Bozkurt, S., & Ozen, A. (2015). Effectiveness and efficiency of peer and adult models used in video modeling in teaching pretend play skills to children with autism spectrum disorder. Education and Training in Autism and Developmental Disabilities, 50(1), 71–83. https://www.jstor.org/stable/24827502

  • *Saral, D., & Ulke-Kurkcuoglu, B. (2022). Using least-to-most prompting to increase the frequency and diversity of pretend play in children with autism. Topics in Early Childhood Special Education, 42(1), 33–49. https://doi.org/10.1177/2F0271121420942850

  • Sarkis-Onofre, R., Catalá-López, F., Aromataris, E., & Lockwood, C. (2021). How to properly use the PRISMA Statement. Systematic Reviews, 10(1), 1–3. https://doi.org/10.1186/s13643-021-01671-z

    Article  Google Scholar 

  • Simó-Pinatella, D., Mumbardó-Adam, C., Alomar-Kurz, E., Sugai, G., & Simonsen, B. (2019). Prevalence of challenging behaviors exhibited by children with disabilities: Mapping the literature. Journal of Behavioral Education, 28(3), 323–343. https://doi.org/10.1007/s10864-019-09326-9

    Article  Google Scholar 

  • Smith, K. R. M., & Matson, J. L. (2010). Behavior problems: Differences among intellectually disabled adults with co-morbid autism spectrum disorders and epilepsy. Research in Developmental Disabilities, 31(5), 1062–1069. https://doi.org/10.1016/j.ridd.2010.04.003

    Article  PubMed  Google Scholar 

  • Stewart, M. E., Barnard, L., Pearson, J., Hasan, R., & O’Brien, G. (2006). Presentation of depression in autism and Asperger syndrome: A review. Autism, 10(1), 103–116. https://doi.org/10.1177/1362361306062013

    Article  PubMed  Google Scholar 

  • Storch, E. A., & Crisp, H. L. (2004). Taking it to the schools–transporting empirically supported treatments for childhood psychopathology to the school setting. Clinical Child and Family Psychology Review., 7, 191–193. https://doi.org/10.1007/s10567-004-6084-y

    Article  PubMed  Google Scholar 

  • Strain, P., & Schwartz, I. (2001). ABA and the development of meaningful social relations for young children with autism. Focus on Autism and Other Developmental Disabilities, 16(2), 120–128. https://doi.org/10.1177/108835760101600208

    Article  Google Scholar 

  • Sucuoglu, B., & Demir, Ş. (2012). Effect sizes of behavioral interventions for Turkish students with autism. Eurasian Journal of Educational Research, 12, 21–38. https://eric.ed.gov/?id=EJ1057528

  • Sugai, G., O’Keeffe, B. V., & Fallon, L. M. (2012). A contextual consideration of culture and school-wide positive behavior support. Journal of Positive Behavior Interventions, 14(4), 197–208. https://doi.org/10.1177/2F1098300711426334

    Article  Google Scholar 

  • Sulu, M. D., Martella, R. C., Toper, O., Marchand-Martella, N. E., & Kiyak, U. E. (2021). Explicit and systematic scripted ınstructional programs for students with autism spectrum disorder: An updated and extended review. Review Journal of Autism and Developmental Disorders, 1–17. https://doi.org/10.1007/s40489-021-00284-5

  • Sulu, M. D., Martella, R. C., Grimmet, K., Borosh, A. M., & Erden, E. (2022). Investigating the effects of self-monitoring interventions with students with disabilities on the maintenance and generalization of on-task behavior: A systematic literature Review. Review Journal of Autism and Developmental Disorders, 1–19. https://doi.org/10.1007/s40489-022-00304-y

  • Tarlow, K. R. (2017). An ımproved rank correlation effect size statistic for single-case designs: baseline corrected tau. Behavior Modification, 41(4), 427–467. https://doi.org/10.1177/0145445516676750

    Article  PubMed  Google Scholar 

  • Tate, R. L., Perdices, M., McDonald, S., Togher, L., & Rosenkoetter, U. (2014). The design, conduct and report of single-case research: Resources to improve the quality of the neurorehabilitation literature. Neuropsychological Rehabilitation, 24(3–4), 315–331. https://doi.org/10.1080/09602011.2013.875043

    Article  PubMed  Google Scholar 

  • *Tekin-Iftar, E. (2008). Parent-delivered community-based instruction with simultaneous prompting for teaching community skills to children with developmental disabilities. Education and Training in Developmental Disabilities, 43(2), 249–265. https://www.jstor.org/stable/23879933

  • *Tekin-Iftar, E., & Birkan, B. (2010). Small group instruction for students with autism: General case training and observational learning. The Journal of Special Education, 44(1), 50-63. https://doi.org/10.1177/2F0022466908325219

  • *Tekin-İftar, E., & Olcay-Gül, S. (2016). Increasing instructional efficiency when using simultaneous prompting procedure in teaching academic skills to students with autism spectrum disorders. International Electronic Journal of Elementary Education, 9(2), 451–472. https://www.iejee.com/index.php/IEJEE/article/view/169

  • *Toret, G., Aykut, Ç., Babacan, A., & Özkubat, U. (2015). Otizm spektrum bozukluğu olan çocuklarda akademik başarı düzeyleri üzerinde kendini izleme stratejisinin etkisinin incelenmesi. [Effects of self-monitoring on academic achievements of children with autism spectrum disorders] Ankara Üniversitesi Eğitim Bilimleri Fakültesi Özel Eğitim Dergisi, 16(02), 125–147. https://doi.org/10.1501/Ozlegt_0000000224

  • *Tunc-Paftali, A., & Tekin-Iftar, E. (2021). E-coaching preschool teachers to use simultaneous prompting to teach children with autism spectrum disorder. Teacher Education and Special Education, 44(3), 255–273. https://doi.org/10.1177/2F0888406420925014

  • *Turhan, C., & Vuran, S. (2015). The effectiveness and efficiency of social stories and video modelling on teaching social skills to children with autism spectrum disorder. International Journal of Early Childhood Special Education, 7(2), 294–315. https://dergipark.org.tr/en/pub/intjecse/issue/45228/566425

  • *Ulke-Kurkcuoglu, B. (2015). A comparison of least-to-most prompting and video modeling for teaching pretend play skills to children with autism spectrum disorder. Educational Sciences: Theory & Practice, 15(2). https://doi.org/10.12738/estp.2015.2.2541

  • *Ulke‐Kurkcuoglu, B., & Kircaali‐Iftar, G. (2010). A comparison of the effects of providing activity and material choice to children with autism spectrum disorders. Journal of Applied Behavior Analysis, 43(4), 717-721. https://doi.org/10.1901/jaba.2010.43-717

  • *Ulke-Kurkcuoglu, B., Bozkurt, F., & Cuhadar, S. (2015). Effectiveness of instruction performed through computerassisted activity schedules on on-schedule and role-play skills of children with autism spectrum disorder. Educational Sciences: Theory & Practice, 15(3). https://doi.org/10.12738/estp.2015.3.2432

  • Vannest, K. J., & Ninci, J. (2015). Evaluating intervention effects in single-case research designs. Journal of Counseling & Development, 93(4), 403–411. https://doi.org/10.1002/jcad.12038

    Article  Google Scholar 

  • Vietze & Lax. (2020). Early intervention ABA for toddlers with ASD: Effect of age and amount. Current Psychology, 39, 1234–1244. https://doi.org/10.1007/s12144-018-9812-z

    Article  Google Scholar 

  • Virues-Ortega, J. (2010). Applied behavior analytic intervention for autism in early childhood: Meta-analysis, meta-regression and dose-response meta-analysis of multiple outcomes. Clinical Psychological Review, 30(4), 387–399. https://doi.org/10.1016/j.cpr.2010.01.008

    Article  Google Scholar 

  • *Vuran, S. (2008). Empowering leisure skills in adults with autism: An experimental investigation through the most to least prompting procedure. International Journal of Special Education, 23(1), 174–181. https://files.eric.ed.gov/fulltext/EJ814387.pdf

  • Weisz, J. R., Sandler, I. N., Durlak, J. A., & Anton, B. S. (2005). Promoting and protecting youth mental health through evidence-based prevention and treatment. American psychologist, 60(6), 628. https://psycnet.apa.org/doi/10.1037/0003-066X.60.6.628

  • Wentzel, K. R., Barry, C. M., & Caldwell, K. A. (2004). Friendships in middle school: Influences on motivation and school adjustment. Journal of Educational Psychology, 96(2), 195–203. https://doi.org/10.1037/0022-0663.96.2.195

    Article  Google Scholar 

  • Wolf, M. M. (1978). Social validity: The case for subjective measurement or how applied behavior analysis is finding its heart 1. Journal of Applied Behavior Analysis, 11(2), 203–214. https://doi.org/10.1901/jaba.1978.11-203

    Article  PubMed  PubMed Central  Google Scholar 

  • *Yalcin I., & Akmanoglu, N. (2013). Effects of simultenous prompting procedure in teaching english words to a child with autism: Intrusive feedback. Journal of Academic Studies, 58, 117–140. https://hdl.handle.net/11421/15595

  • *Yanardağ, M., Birkan, B., Yılmaz, İ., Konukman, F., Agbuga, B., & Lieberman, L. (2011). The effects of least-to-most prompting procedure in teaching basic tennis skills to children with autism. Kinesiology, 43(2), 44–55 https://hdl.handle.net/11421/15517

  • *Yanardag, M., Akmanoglu, N. & Yilmaz, I. (2013) The effectiveness of video prompting on teaching aquatic play skills for children with autism. Disability and Rehabilitation, 35(1), 47-56. https://doi.org/10.3109/09638288.2012.687030

  • *Yanardag, M., Erkan, M., Yılmaz, İ., Arıcan, E., & Düzkantar, A. (2015). Teaching advance movement exploration skills in water to children with autism spectrum disorders. Research in Autism Spectrum Disorders, 9, 121-129. https://doi.org/10.1016/j.rasd.2014.10.016

  • *Yavuz, M. (2019). Effectiveness of video prompting method in teaching cloth folding skill to individuals with autism spectrum disorders. European Journal of Special Education Research. https://doi.org/10.5281/zenodo.3229861

  • *Yavuz, M., & Şafak, P. (2017). Otizm spektrum bozukluğu olan çocuklara ev içi becerilerin öğretiminde videoyla model olma ile videoyla ipucu yöntemlerinin etkililiğinin ve verimliliklerinin karşilaştirilmasi. [Comparıng effectiveness and efficiency of video modeling and video prompting methods in teaching children wıth autism spectrum disorder] Trakya Üniversitesi Sosyal Bilimler Dergisi, 19(2), 341–365. https://dergipark.org.tr/en/pub/trakyasobed/issue/33347/371373

  • *Yilmaz, I., Birkan, B., Konukman, F., & Erkan, M. (2005). Using a constant time delay procedure to teach aquatic play skills to children with autism. Education and Training in Developmental Disabilities, 40(2), 171–182. https://www.jstor.org/stable/23880089

  • *Yilmaz, I., Birkan, B., Konukman, F., Birkan, B., Özen, A., Yanardağ, M., & C̣amursoy, İ. (2010a). Effects of constant time delay procedure on the Halliwick’s method of swimming rotation skills for children with autism. Education and Training in Autism and Developmental Disabilities, 45(1), 124–135. https://www.jstor.org/stable/23880156

  • *Yilmaz, I., Konukman, F., Birkan, B., & Yanardağ, M. (2010b). Effects of most to least prompting on teaching simple progression swimming skill for children with autism. Education and Training in Autism and Developmental Disabilities, 45(3), 440–448. https://www.jstor.org/stable/23880116

  • Zachor, D. A., Ben-Itzchak, E., Rabinovich, A., & Lahata (2007). Change in autism core symptoms with intervention. Research in Autism Spectrum Disorders, 1(4), 304-317. https://doi.org/10.1016/j.rasd.2006.12.001

Download references

Author information

Authors and Affiliations

  1. Educational Leadership and Advanced Studies, Mathematics Education Psychology Center, Northern Kentucky University, Nunn Drive, Highland Heights, KY, USA

    Mehmet D. Sulu

  2. Faculty of Education, Erzincan Binali Yildirim University, Erzincan, Turkey

    Orhan Aydin

  3. College of Education, University of Colorado, Colorado Springs, CO, USA

    Ronald C. Martella

  4. Faculty of Education, Hasan Kalyoncu University, Şahinbey, Turkey

    Emine Erden

  5. College of Education, Purdue University, West Lafayette, IN, USA

    Zafer Ozen

Authors
  1. Mehmet D. Sulu
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Orhan Aydin
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Ronald C. Martella
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Emine Erden
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Zafer Ozen
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Mehmet D. Sulu.

Ethics declarations

Ethical Approval

No human participants were involved in any parts of this study.

Consent to Participate

No informed consent was needed to complete the study.

Conflict of Interest

The authors declare no competing interests.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Sulu, M.D., Aydin, O., Martella, R.C. et al. A Meta-Analysis of Applied Behavior Analysis-Based Interventions for Individuals with Autism Spectrum Disorders (ASD) in Turkey. Rev J Autism Dev Disord (2024). https://doi.org/10.1007/s40489-023-00421-2

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1007/s40489-023-00421-2

Keywords

Search

Navigation