Skip to main content
SpringerLink
Log in

Undertaking Experiments in Social Sciences: Sequential, Multiple Time Series Designs for Consideration

  • Essay
  • Published:
Educational Psychology Review Aims and scope Submit manuscript

Abstract

In social sciences, the use of stringent methodological approaches is gaining increasing emphasis. Researchers have recognized the limitations of cross-sectional, non-manipulative data in the study of causality. True experimental designs, in contrast, are preferred as they represent rigorous standards for achieving causal flows between variables. The Solomon four-group design, for example, is ideal for its positioning to account for, and factor out, confounded influences of predictors on outcomes. However, in daily life settings, it is often difficult to emulate true experimental conditions. Identified limitations include financial resources, logistic difficulties, time constraint, and small sample sizes in social science research settings. There are, of course, other experimental designs that are noteworthy for consideration. Time series and single-case designs, quasi in nature, are effective alternatives for educators and researchers to consider in their research foci. This article examines the different experimental designs that may be implemented in naturalistic classroom settings. In particular, one important inquiry of our theoretical discussion pertains closely to the conceptualization of two innovative designs that we have made, consequently as a result of our research development and examination of the literature: a sequential, multiple time series multi-group design and a multi time series, multi-group single-case design. These experimental designs are innovative and enable comparisons for within and between differences under different experimental conditions.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12

Similar content being viewed by others

Notes

  1. Note: this is also an issue that was raised by one of the reviewers in the first draft of this manuscript.

References

  • Bandura, A. (1986). Social foundations of thought and action: a social cognitive theory. Englewood Cliffs: Prentice-Hall.

    Google Scholar 

  • Bandura, A. (1997). Self-efficacy: the exercise of control. New York: W. H. Freeman & Co.

    Google Scholar 

  • Bollen, K. A., & Curran, P. J. (2006). Latent curve models: a structural equation perspective. Hoboken: Wiley.

    Google Scholar 

  • Bong, M., & Skaalvik, E. M. (2003). Academic self-concept and self-efficacy: how different are they really? Educational Psychology Review, 15(1), 1–40.

    Article  Google Scholar 

  • Creswell, J. W. (2003). Research design: qualitative, quantitative, and mixed methods approaches. Thousand Oaks: Sage Publications, Inc.

    Google Scholar 

  • Fast, L. A., Lewis, J. L., Bryant, M. J., Bocian, K. A., Cardullo, R. A., Rettig, M., & Hammond, K. A. (2010). Does math self-efficacy mediate the effect of perceived classroom environment on standardized math performance? Journal of Educational Psychology, 102(3), 729–740.

    Article  Google Scholar 

  • Fenollar, P., Román, S., & Cuestas, P. J. (2007). University students’ academic performance: an integrative conceptual framework and empirical analysis. British Journal of Educational Psychology, 77(Pt 4), 873–891. doi:10.1348/000709907X189118.

    Article  Google Scholar 

  • Fraenkel, J. R., & Wallen, N. E. (2006). How to design and evaluate research in education (6th ed.). New York: McGraw Hill.

    Google Scholar 

  • Gottman, J. M., McFall, R. M., & Barnett, J. T. (1969). Design and analysis of research using time series. Psychological Bulletin, 72(4), 299–306.

    Article  Google Scholar 

  • Gribbons, B., & Herman, J. (1997). True and quasi-experimental designs. Washington: ERIC Clearinghouse on Assessment and Evaluation.

    Google Scholar 

  • Hammond, D., & Gast, D. L. (2010). Descriptive analysis of single subject research designs: 1983–2007. Education and Training in Autism and Developmental Disabilities, 45(2), 187–202.

    Google Scholar 

  • Horner, R. H., Carr, E. G., Halle, J., McGee, G., Odom, S., & Wolery, M. (2005). The use of single-subject research to identify evidence-based practice in special education. Exceptional Children, 71, 165–179.

    Article  Google Scholar 

  • Kennedy, C. H. (2005). Single-case designs for educational research. Boston: Allyn & Bacon.

    Google Scholar 

  • Lane, J. D., & Gast, D. L. (2014). Visual analysis in single case experimental design studies: brief review and guidelines. Neuropsychological Rehabilitation, 24(3–4), 445–463.

    Article  Google Scholar 

  • Lent, R. W., Lopez, F. G., & Bieschke, K. J. (1991). Mathematics self-efficacy: sources and relation to science-based career choice. Journal of Counseling Psychology, 38(4), 424–430. doi:10.1037//0022-0167.38.4.424.

    Article  Google Scholar 

  • Liem, A. D., Lau, S., & Nie, Y. (2008). The role of self-efficacy, task value, and achievement goals in predicting learning strategies, task disengagement, peer relationship, and achievement outcome. Contemporary Educational Psychology, 33(4), 486–512. doi:10.1016/J.Cedpsych.2007.08.001.

    Article  Google Scholar 

  • Manolov, R., Gast, D. L., Perdices, M., & Evans, J. J. (2014). Single-case experimental designs: reflections on conduct and analyis. Neuropsychological Rehabilitation, 24(3–4), 634–660.

    Article  Google Scholar 

  • Marsh, H. W. (1990). A multidimensional, hierarchical model of self-concept: theoretical and empirical justification. Educational Psychology Review, 2, 77–172.

    Article  Google Scholar 

  • Marsh, H. W., & Yeung, A. S. (1997). Causal effects of academic self-concept on academic achievement: structural equation models of longitudinal data. Journal of Educational Psychology, 89(1), 41–54.

    Article  Google Scholar 

  • Marsh, H. W., & Yeung, A. S. (1998). Longitudinal structural equation models of academic self-concept and achievement: gender differences in the development of math and English constructs. American Educational Research Journal, 35(4), 705–738.

    Article  Google Scholar 

  • Martin, A. J., Colmar, S. H., Davey, L. A., & Marsh, H. W. (2010). Longitudinal modelling of academic buoyancy and motivation: do the 5Cs hold up over time? British Journal of Educational Psychology, 80(3), 473–496.

    Article  Google Scholar 

  • McArdle, J. J., & Nesselroade, J. R. (2003). Growth curve analysis in contemporary psychological research. In J. A. Schinka & W. F. Velicer (Eds.), Handbook of psychology: research methods in psychology (pp. 447–480). New York: Wiley.

    Google Scholar 

  • Morgan, G. A., Gliner, J. A., & Harmon, R. J. (2000). Quasi-experimental designs. Journal of the American Academy of Child and Adolescent Psychiatry, 39(6), 794–796.

    Article  Google Scholar 

  • Ngu, B. H., & Yeung, A. S. (2013). Algebra word problem solving approaches in a chemistry context: equation worked examples versus text editing. The Journal of Mathematical Behavior, 32(2), 197–208.

    Article  Google Scholar 

  • Ngu, B. H., Chung, S. F., & Yeung, A. S. (2015a). Cognitive load in algebra: element interactivity in solving equations. Educational Psychology, 35(3), 271–293.

    Article  Google Scholar 

  • Ngu, B. H., Yeung, A. S., & Phan, H. P. (2015b). Constructing a coherent problem model to facilitate algebra problem solving in a chemistry context. International Journal of Mathematical Education in Science and Technology, 46(3), 388–403.

    Article  Google Scholar 

  • Paas, F., Renkl, A., & Sweller, J. (2003). Cognitive load theory and instructional design: recent development. Educational Psychologist, 38, 1–3.

    Article  Google Scholar 

  • Pajares, F. (1996). Self-efficacy beliefs in academic settings. Review of Educational Research, 66(4), 543–578.

    Article  Google Scholar 

  • Pajares, F., & Kranzler, J. (1995). Self-efficacy beliefs and general mental ability in mathematical problem solving. Contemporary Educational Psychology, 20(4), 426–443.

    Article  Google Scholar 

  • Pajares, F., & Miller, D. (1994). Role of self-efficacy and self-concept beliefs in mathematical problem solving: a path analysis. Journal of Educational Psychology, 86(2), 193–203.

    Article  Google Scholar 

  • Pajares, F., Johnson, J., & Usher, E. L. (2007). Sources of writing self-efficacy beliefs of elementary, middle, and high school students. Research in the Teaching of English, 42(1), 104–120.

    Google Scholar 

  • Phan, H. P. (2008). Unifying different theories of learning: theoretical framework and empirical evidence. Educational Psychology, 28(3), 325–340. doi:10.1080/01443410701591392.

  • Phan, H. P. (2012a). Informational sources, self-efficacy, and achievement: a temporally displaced approach. Educational Psychology, 32(6), 699–726. doi:10.1080/01443410.2012.708320.

    Article  Google Scholar 

  • Phan, H. P. (2012b). Relations between informational sources and self-efficacy: a developmental approach. Educational Psychology, 32(1), 81–105. doi:10.1080/01443410.2011.625612.

    Article  Google Scholar 

  • Phan, H. P., & Ngu, B. H. (2015). Validating personal well-being experiences: a quantitative approach. Education, 136(1), 34–52.

    Google Scholar 

  • Phan, H. P., Ngu, B. H., & Williams, A. (2016). Introducing the concept of Optimal Best: theoretical and methodological contributions. Education, 136(3), 312–322.

  • Pietsch, J., Walker, R., & Chapman, E. (2003). The relationship among self-concept, self-efficacy, and performance in mathematics during secondary school. Journal of Educational Psychology, 95(3), 589–603. doi:10.1037/0022-0663.95.3.589.

    Article  Google Scholar 

  • Rogosa, D. (1979). Causal models in longitudinal research: rationale, formulation, and interpretation. In J. R. Nesselroade & P. B. Balles (Eds.), Longitudinal research in the study of behaviour and development (pp. 263–302). New York: Academic Press.

    Google Scholar 

  • Schunk, D. H. (1982). Effects of effort attributional feedback on children’s perceived self-efficacy and achievement. Journal of Educational Psychology, 74, 548–556.

    Article  Google Scholar 

  • Schunk, D. H. (1983). Ability versus effort attributional feedback: differential effects on self-efficacy and achievement. Journal of Educational Psychology, 75, 848–856.

    Article  Google Scholar 

  • Schunk, D. H., & Hanson, A. R. (1985). Peer models: influence on children’s self-efficacy and achievement. Journal of Educational Psychology, 77(3), 313–322.

    Article  Google Scholar 

  • Schunk, D. H., & Hanson, A. R. (1989). Influence of peer-model attributes on children’s beliefs and learning. Journal of Educational Psychology, 81(3), 431–434.

    Article  Google Scholar 

  • Schunk, D. H., Hanson, A. R., & Cox, P. D. (1987). Peer-model attributes and children’s achievement behaviors. Journal of Educational Psychology, 79(1), 54–61.

    Article  Google Scholar 

  • Senko, C., & Miles, K. M. (2008). Pursuing their own learning agenda: how mastery-oriented students jeopardize their class performance. Contemporary Educational Psychology, 33(4), 561–583. doi:10.1016/J.Cedpsych.2007.12.001.

    Article  Google Scholar 

  • Shavelson, R. J., & Marsh, H. W. (1986). On the structure of self-concept. In R. Schwarzer (Ed.), Anxiety and cognitions. Hillsdale: Lawrence Erlbaum.

    Google Scholar 

  • Skaalvik, E. M., & Rankin, R. J. (1998). Self-concept, self-efficacy and achievement in mathematics: a test of causal relations. San Diego: Paper presented at the Annual Meeting of the American Educational Research Association.

    Google Scholar 

  • Sweller, J. (2005). Implications of cognitive load theory for multimedia learning. In R. E. Mayer (Ed.), Cambridge handbook of multimedia learning (pp. 19–30). New York: Cambridge University Press.

    Chapter  Google Scholar 

  • Sweller, J., Ayres, P., & Kalyuga, S. (2011). Cognitive load theory. New York: Springer.

    Book  Google Scholar 

  • Van Damme, J., De Fraine, B., Van Landeghem, G., Opdenakker, M.-C., & Onghena, P. (2002). A new study on educational effectiveness in secondary schools in Flanders: an introduction. School Effectivenes and School Improvement, 13(4), 383–397.

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. School of Education, The University of New England, Armidale, NSW, 2351, Australia

    Huy P. Phan & Bing H. Ngu

Authors
  1. Huy P. Phan
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Bing H. Ngu
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Huy P. Phan.

Ethics declarations

Ethical Approval

This article does not contain any studies with human participants performed by any of the authors.

Conflict of Interest

The authors declare that they have no conflict of interest.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Phan, H.P., Ngu, B.H. Undertaking Experiments in Social Sciences: Sequential, Multiple Time Series Designs for Consideration. Educ Psychol Rev 29, 847–867 (2017). https://doi.org/10.1007/s10648-016-9368-0

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10648-016-9368-0

Keywords

Search

Navigation