A Spectral Analysis Approach for Experimental Designs

  • R. A. Bailey
  • Persi Diaconis
  • Daniel N. RockmoreEmail author
  • Chris Rowley
Part of the Applied and Numerical Harmonic Analysis book series (ANHA)


In this paper we show how the approach of spectral analysis generalizes the standard ANOVA-based techniques for studying data from designed experiments. Several examples are worked out in detail, including a thorough analysis of Calvin’s famous ice cream data.

Key words:

analysis of variance block design designed experiment diallel experiment irreducible subspace orthogonal decomposition permutation representation 


  1. 1.
    R.A. Bailey, A unified approach to design of experiments. J. R. Stat. Soc. Ser. A 144, 214–223 (1981)CrossRefzbMATHGoogle Scholar
  2. 2.
    R.A. Bailey, Latin squares with highly transitive automorphism groups. J. Aust. Math. Soc. Ser. A 33, 18–22 (1982)CrossRefzbMATHGoogle Scholar
  3. 3.
    R.A. Bailey, Automorphism groups of block structures with and without treatments, in Coding Theory and Design Theory, Part II, Design Theory, ed. by D. Ray-Chaudhuri (Springer, New York, 1990), pp. 24–41CrossRefGoogle Scholar
  4. 4.
    R.A. Bailey, Strata for randomized experiments (with discussion). J. R. Stat. Soc. Ser. B 53, 27–78 (1991)zbMATHGoogle Scholar
  5. 5.
    R.A. Bailey, Design of Comparative Experiments (Cambridge University Press, Cambridge, 2008)CrossRefzbMATHGoogle Scholar
  6. 6.
    R.A. Bailey, Structures defined by factors, in Handbook on Design of Experiments, ed. by D. Bingham, A.M. Dean, M. Morris, J. Stufken (Chapman and Hall, Boca Raton, 2014)Google Scholar
  7. 7.
    R.A. Bailey, C.A. Rowley, General balance and treatment permutations. Linear Algebra Appl. 127, 183–225 (1990)MathSciNetCrossRefzbMATHGoogle Scholar
  8. 8.
    R.A. Bailey, C.E. Praeger, C.A. Rowley, T.P. Speed, Generalized wreath products of permutation groups. Proc. Lond. Math. Soc. 47, 69–82 (1983)MathSciNetCrossRefzbMATHGoogle Scholar
  9. 9.
    R.A. Bailey, H. Monod, J.P. Morgan, Construction and optimality of affine-resolvable designs. Biometrika 82, 187–200 (1995)MathSciNetCrossRefzbMATHGoogle Scholar
  10. 10.
    E. Bolker, The finite Radon transform. Contemp. Math. 63, 27–50 (1987)MathSciNetCrossRefGoogle Scholar
  11. 11.
    R.C. Bose, W.G. Bridges, M.S. Shrikhande, A characterization of partial geometric designs. Discret. Math. 16, 1–7 (1976)MathSciNetCrossRefzbMATHGoogle Scholar
  12. 12.
    R.C. Bose, S.S. Shrikande, N.M. Singhi, Edge regular multigraphs and partial geometric designs with an application to the embedding of quasi-residual designs, in Teorie Combinatoire (Rome, 1973) Atti dei Convegni Lincei, vol. 17 (Accademia Nazionale dei Lincei, Roma, 1976), pp. 49–81Google Scholar
  13. 13.
    C.J. Brien, B.D. Harch, R.L. Correll, R.A. Bailey, Multiphase experiments with at least one later laboratory phase. I. Orthogonal designs. J. Agric. Biol. Environ. Stat. 16, 422–450 (2011)MathSciNetCrossRefzbMATHGoogle Scholar
  14. 14.
    C.T. Burton, Automorphism groups of balanced incomplete block designs and their use in statistical model construction and analysis. PhD Thesis, University of North Carolina at Chapel Hill (1980)Google Scholar
  15. 15.
    C.T. Burton, I.M. Chakravarti, On the commutant algebras corresponding to the permutation representations of the full collineation groups of \(\mathrm{PG}(k,s)\) and EG(k, s), s = p r, k ≥ 2. J. Math. Anal. Appl. 89, 489–514 (1982)Google Scholar
  16. 16.
    T. Caliński, On some desirable patterns in block designs. Biometrics 27, 275–292 (1971)CrossRefGoogle Scholar
  17. 17.
    L.D. Calvin, Doubly balanced incomplete block designs for experiments in which the treatment effects are correlated. Biometrics 10, 61–88 (1954)CrossRefzbMATHGoogle Scholar
  18. 18.
    P.J. Cameron, Bounding the rank of certain permutation groups. Math. Z. 124, 243–352 (1972)CrossRefGoogle Scholar
  19. 19.
    T. Ceccherini–Silberstein, F. Scarabotti, F. Tolli, Representation Theory and Harmonic Analysis of Wreath Products of Finite Groups. London Mathematical Society Lecture Notes Series, vol. 410 (Cambridge University Press, Cambridge, 2014)Google Scholar
  20. 20.
    I.M. Chakravarti, C.T. Burton, On the algebras of symmetries (groups of collineations) of designs from finite Desarguesian planes with applications in statistics. J. Math. Anal. Appl. 89, 515–529 (1982)MathSciNetCrossRefzbMATHGoogle Scholar
  21. 21.
    I.M. Chakravarti, C.T. Burton, Symmetries (groups of automorphisms) of Desarguesian finite projective and affine planes and their role in statistical model construction, in Statistics and Probability: Essays in Honor of C. R. Rao, ed. by G. Kallianpur, P.R. Krishnaiah, J.K. Ghosh (North-Holland, Amsterdam, 1982), pp. 169–178Google Scholar
  22. 22.
    C.S. Cheng, R.A. Bailey, Optimality of some two-associate-class partially balanced incomplete-block designs. Ann. Stat. 19, 1667–1671 (1991)MathSciNetCrossRefzbMATHGoogle Scholar
  23. 23.
    P. Diaconis, Group Representations in Probability and Statistics. IMS Lecture Notes—Monograph Series, vol. 11 (Institute of Mathematical Statistics, Hayward, 1988)Google Scholar
  24. 24.
    P. Diaconis, Applications of group representations to statistical problems, in Proceedings of the ICM, Kyoto, Japan, 1990 (Springer, Tokyo, 1991), pp. 1037–1048Google Scholar
  25. 25.
    P. Diaconis, D. Rockmore, Efficient computation of isotypic projections for the symmetric group, in DIMACS Series in Discrete Mathematics and Theoretical Computer Science, vol. 11, ed. by L. Finkelstein, W. Kantor (American Mathematical Society, Providence, 1993), pp. 87–104Google Scholar
  26. 26.
    R.A. Fisher, The theory of confounding in factorial experiments in relation to the theory of groups. Ann. Eugen. 11, 341–353 (1942)CrossRefGoogle Scholar
  27. 27.
    P. Fortini, Representations of groups and the analysis of variance. PhD Thesis, Harvard University (1977)Google Scholar
  28. 28.
    B. Griffing, Concept of general and specific combining ability in relation to diallel crossing system. Aust. J. Biol. Sci. 9, 463–493 (1956)Google Scholar
  29. 29.
    E.J. Hannan, Group representations and applied probability. J. Appl. Probab. 2, 1–68 (1965)MathSciNetCrossRefzbMATHGoogle Scholar
  30. 30.
    A.M. Houtman, T.P. Speed, Balance in designed experiments with orthogonal block structure. Ann. Stat. 11, 1069–1085 (1983)MathSciNetzbMATHGoogle Scholar
  31. 31.
    A.T. James, The relationship algebra of an experimental design. Ann. Math. Stat. 28, 993–1002 (1957)CrossRefzbMATHGoogle Scholar
  32. 32.
    A.T. James, Analysis of variance determined by symmetry and combinatorial properties of zonal polynomials, in Statistics and Probability: Essays in Honor of C. R. Rao, ed. by G. Kallianpur, P.R. Krishnaiah, J.K. Ghosh (North-Holland, Amsterdam, 1982), pp. 329–341Google Scholar
  33. 33.
    A.T. James, Contribution to the discussion of ‘Strata for randomized experiments’ by R. A. Bailey. J. R. Stat. Soc. Ser. B 53, 71 (1991)zbMATHGoogle Scholar
  34. 34.
    A.T. James, G.N. Wilkinson, Factorization of the residual operator and canonical decomposition of nonorthogonal factors in the analysis of variance. Biometrika 58, 279–294 (1971)MathSciNetCrossRefzbMATHGoogle Scholar
  35. 35.
    G. James, A. Kerber, The Representation Theory of the Symmetric Group. Encyclopedia of Mathematics and Its Applications, vol. 16 (Addison–Wesley, Reading, 1981)Google Scholar
  36. 36.
    P.M.W. John, Statistical Design and Analysis of Experiments (Macmillan, New York, 1971)zbMATHGoogle Scholar
  37. 37.
    J. Kung, The Radon transform of a combinatorial geometry. J. Comb. Theory Ser. A 26, 97–102 (1979)MathSciNetCrossRefzbMATHGoogle Scholar
  38. 38.
    W. Ledermann, Representation theory and statistics, in Séminaire Dubreil-Pisot (Algèbre et Théorie des Nombres), vol. 15, University of Paris (1967), pp. 15.01–15.08Google Scholar
  39. 39.
    H.B. Mann, The algebra of a linear hypothesis. Ann. Math. Stat. 31, 1–15 (1960)CrossRefzbMATHGoogle Scholar
  40. 40.
    D.K. Maslen, D.N. Rockmore, Separation of variables and the computation of Fourier transforms on finite groups, I. J. Am. Math. Soc. 10(1), 169–214 (1997)MathSciNetCrossRefzbMATHGoogle Scholar
  41. 41.
    D.K. Maslen, M.E. Orrison, D.N. Rockmore, Computing isotypic projections with the Lanczos iteration. SIAM J. Matrix Anal. Appl. 25, 784–803 (2003)MathSciNetCrossRefGoogle Scholar
  42. 42.
    A.D. McLaren, On group representations and invariant stochastic processes. Proc. Camb. Philos. Soc. 59, 431–450 (1963)MathSciNetCrossRefzbMATHGoogle Scholar
  43. 43.
    J.A. Nelder, The analysis of randomized experiments with orthogonal block structure. I. Block structure and the null analysis of variance. Proc. R. Soc. Ser. A 283, 147–162 (1965)MathSciNetzbMATHGoogle Scholar
  44. 44.
    J.A. Nelder, The analysis of randomized experiments with orthogonal block structure. II. Treatment structure and the general analysis of variance. Proc. R. Soc. Ser. A 283, 163–178 (1965)MathSciNetGoogle Scholar
  45. 45.
    A. Neumaier, \(t\frac{1} {2}\)-Designs. J. Comb. Theory Ser. A 28, 226–248 (1980)Google Scholar
  46. 46.
    J. Neyman, Statistical problems in agricultural experimentation. J. R. Stat. Soc. Suppl. 2, 107–154 (1935)CrossRefzbMATHGoogle Scholar
  47. 47.
    S.C. Pearce, The Agricultural Field Experiment (Wiley, Chichester, 1983)Google Scholar
  48. 48.
    D.N. Rockmore, Some applications of generalized FFTs, in DIMACS Series in Discrete Mathematics and Theoretical Computer Science, vol. 28, ed. by L. Finkelstein, W. Kantor (American Mathematical Society, Providence, 1997), pp. 329–370Google Scholar
  49. 49.
    G.M. Saha, On Caliński’s patterns in block designs. Sankhyā Ser. B 38, 383–392 (1976)zbMATHGoogle Scholar
  50. 50.
    H. Scheffé, The Analysis of Variance (Wiley, New York, 1959)zbMATHGoogle Scholar
  51. 51.
    J.-P. Serre, Linear Representations of Finite Groups (Springer, New York, 1977)CrossRefzbMATHGoogle Scholar
  52. 52.
    T.P. Speed, anova models with random effects: an approach via symmetry, in Essays in Time Series and Allied Processes: Papers in Honour of E. J. Hannan, ed. by J. Gani, M.B. Priestly (Applied Probability Trust, Sheffield, 1986), pp. 355–368Google Scholar
  53. 53.
    T.P. Speed, What is an analysis of variance? (with discussion). Ann. Stat. 15, 885–910 (1987)MathSciNetCrossRefzbMATHGoogle Scholar
  54. 54.
    T. Tjur, Analysis of variance models in orthogonal designs (with discussion). Int. Stat. Rev. 52, 33–81 (1984)MathSciNetCrossRefzbMATHGoogle Scholar
  55. 55.
    H. Wielandt, Finite Permutation Groups (Academic Press, New York, 1964)zbMATHGoogle Scholar
  56. 56.
    F. Yates, A new method of arranging variety trials involving a large number of varieties. J. Agric. Sci. 26, 424–455 (1936)CrossRefGoogle Scholar
  57. 57.
    F. Yates, Analysis of data from all possible reciprocal crosses between a set of parental lines. Heredity 1, 287–301 (1947)CrossRefGoogle Scholar

Copyright information

© Springer International Publishing Switzerland 2015

Authors and Affiliations

  • R. A. Bailey
    • 1
    • 2
  • Persi Diaconis
    • 3
  • Daniel N. Rockmore
    • 4
    Email author
  • Chris Rowley
    • 5
  1. 1.School of Mathematics and StatisticsUniversity of St AndrewsSt AndrewsUK
  2. 2.School of Mathematical SciencesQueen Mary University of London (Emerita)LondonUK
  3. 3.Department of StatisticsSequoia Hall, 390 Serra Mall, Stanford UniversityStanfordUSA
  4. 4.Department of Mathematics and Neukom Institute for Computational ScienceDartmouth CollegeHanoverUSA
  5. 5.Faculty of Mathematics, Computing and Technology, Department of Mathematics and StatisticsThe Open UniversityBuckinghamshireUK

Personalised recommendations