Abstract
Fractional designs can be extremely useful in social science research, especially when a large number of factors is involved. Reluctance for the use of fractional designs seems to be warranted for two reasons: (1) In the social sciences, the amount of measurement error is often large, which may decrease the power, and (2) higher order interactions are assumed to be nonsignificant, which is difficult to guarantee without sufficient research. This simulation study shows the effects of measurement error and assumption violations under various conditions. It is concluded that fractional designs handle measurement error gracefully and that they are as powerful as a full design when equal degrees of freedom are available. Significant interaction effects can cause serious problems, especially in situations with low or intermediate measurement error, and can lead to erroneous conclusions. Only when estimated confounded effects are clearly not significant, the chance of a wrong decision is reasonably small. Therefore, fractional designs are especially warranted for the exclusion of irrelevant factors. However, we note pitfalls in the use of Version 1.0 of the program Trail Run from SPSS, Inc., to implement the procedures.
Article PDF
Similar content being viewed by others
Avoid common mistakes on your manuscript.
References
Berger, P. D., &Magliozzi, T. L. (1993). Experimental design in direct mail and the application of Taguchi methods.Journal of Direct Marketing,7, 44–55.
Box, G. E. P., Hunter, W. G., &Hunter, J. S. (1978).Statistics for experimenters. New York: Wiley.
Carroll, J. D., &Green, P. E. (1995). Psychometric methods in marketing research: I. Conjoint analysis.Journal of Marketing Research,32, 385–391.
Cestre, G., &Darmon, R. Y. (1998). Assessing consumer preferences in the context of new product diffusion.International Journal of Research in Marketing,13, 139–161.
Davies, O. L. (1956).The design and analysis of industrial experiments. Edinburgh: Oliver & Boyd.
Dodge, Y., Fedorov, V. V., &Wynn, H. P. (1988). Optimal design of experiments: An overview. In Y. Dodge, V. V. Fedorov, & H. P. Wynn (Eds.),Optimal design and analysis of experiments (pp. 1–11). Amsterdam: North-Holland.
Edwards, L. K. (Ed.) (1993).Applied analysis of variance in behavioral science. New York: Marcel Dekker.
Franklin, M. F. (1985). Selecting defining contrasts and confounded effects in pn − m factorial experiments.Technometrics,27, 165–172.
Hahn, G. J. (1977). Some things engineers should know about experimental design.Journal of Quality Control,8, 375–384.
Kaul, A., &Rao, C. (1995). Research for product positioning and design decisions: An integrative review.International Journal of Research in Marketing,12, 293–320.
Kempthorne, O. (1973).The design and analysis of experiments. Huntington, NY: Krieger. (Original work published 1952)
Kirk, R. E. (1968).Experimental design: Procedures for the behavioral sciences. Belmont, CA: Brooks/Cole.
Louviere, J. J. (1988).Analyzing decision making: Metric conjoint analysis. Newbury Park, CA: Sage.
McLean, R. A., &Anderson, V. L. (1984).Applied factorial and fractional designs. New York: Marcel Dekker.
Mesenbrink, P., &Lu, J. C. (1994). Characterization and optimization of a wave-soldering process.Journal of the American Statistical Association,89, 1209–1218.
Nachtheim, C. J. (1987). Tools for computer-aided design of experiments.Journal of Quality Control,19, 132–160.
Nair, V. N. (1992). Experimental strategy and planning techniques.Technometrics,34, 142–147.
SPSS (1997).Trial Run 1.0 user’s guide. Chicago: SPSS.
Turiel, T. P. (1988). A FORTRAN program to generate fractional factorial experiments.Journal of Quality Technology,20, 63–72.
Upperman, P. M. (1993).Designs with a small number of runs for factorial experiments. Unpublished doctoral dissertation, Technical University Eindhoven.
Vriens, M. (1995).Conjoint analysis in marketing: Developments in stimulus representation and segmentation methods. Unpublished doctoral dissertation, Groningen University.
Winer, B. J., Brown, D. R., &Michels, K. M. (1991).Statistical principles in experimental design (3rd ed.). New York: McGraw-Hill.
Author information
Authors and Affiliations
Corresponding author
Additional information
We thank Joop Hox for bringing us together.
Rights and permissions
About this article
Cite this article
Landsheer, J.A., Van Den Wittenboer, G. Fractional designs: A simulation study of usefulness in the social sciences. Behavior Research Methods, Instruments, & Computers 32, 528–536 (2000). https://doi.org/10.3758/BF03200825
Received:
Accepted:
Issue Date:
DOI: https://doi.org/10.3758/BF03200825