Skip to main content

Abstract

This chapter chronicles the development of permutation statistical methods from 1940 to 1959. This period may be considered a bridge between the early years of 1920–1939 where permutation tests were first conceptualized and the next period, 1960–1979, in which gains in computer technology provided the necessary tools to successfully employ permutation tests. The recognition of permutation methods as the gold standard against which conventional statistical methods were to be evaluated, while often implicit in the 1920s and 1930s, is manifest in many of the publications on permutation methods that appeared between 1940 and 1959. Also, a number of researchers turned their attention during this time period to rank tests, which simplified the calculation of exact probability values; other researchers continued work on calculating exact probability values, creating tables for small samples; and still others continued the theoretical work begun in the 1920s.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 84.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 109.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Notes

  1. 1.

    A comprehensive overview of statistics in the 1950s is provided by Tertius de Wet in his presidential address to the South African Statistical Association in 2003 [335].

  2. 2.

    Unfortunately, these two important articles by Samuel Silvey went largely unnoticed, published as they were in Proceedings of the Glasgow Mathematical Association, a journal that was not widely distributed at the time.

  3. 3.

    Atanasoff’s proposal for construction of the computer was funded by Iowa State College, (now, Iowa State University) which granted Atanasoff $5,000 to complete his computing machine.

  4. 4.

    Technically, the computer was originally called the Aiken–IBM Automatic Sequence Controlled Calculator (ASCC) and was renamed the Mark I by Harvard University when it was acquired from IBM on 7 August 1944.

  5. 5.

    For an interesting biography of John von Neumann , as related to computers and computing science, see Chap. 4 in the 2012 book Turing’s Cathedral by George Dyson [370, Chap. 4].

  6. 6.

    This statement paints a rosy picture of the relationship between Shockley , on the one hand, and Brattain and Bardeen , on the other hand, that was nothing but congenial. For a more detailed account, see a 2010 book by Sam Kean titled The Disappearing Spoon [712, pp. 41–43].

  7. 7.

    In fact, it took 70 years for the Government Communications Headquarters (GCHQ) to release two papers written by Alan Turing between April 1941 and April 1942 while he was head of wartime code-breaking at Bletchley Park. The two papers on “Paper on the statistics of repetitions” and “Other applications of probability to cryptography” were finally released in April of 2012 [25].

  8. 8.

    For a history of the development of fortran, see the recollection by John Backus in the special issue of ACM SIGPLAN Notices on the history of programming [44].

  9. 9.

    This statement is from Kurt Beyer , Grace Hopper and the Invention of the Information Age. Actually, the first woman to earn a Ph.D. in mathematics from Yale University was Charlotte Cynthia Barnum (1860–1934) who received her Ph.D. in mathematics in 1895 [1018].

  10. 10.

    The maximum number of inversions required to reverse the order of ranks follows an irregular series. For n = 2, the maximum number of inversions, I, is 1; for n = 3, I = 3; for n = 4, I = 6; and so on. Thus, the sequence is 1, 3, 6, 10, 15, 21, and so on. The sequence is a component of Pascal’s triangle; see Column 3 in Table 3.11 of this chapter, page 186. Any successive number can be obtained by n(n + 1)∕2. Thus, for n = 9 objects the maximum number of inversions is 9(9 + 1)∕2 = 45. It stretches the imagination that a subject made more than 70 paired comparisons to rank order only nine objects.

  11. 11.

    This is the reason that the Academy of Motion Picture Arts and Sciences places a maximum limit of 10 nominations for the Academy Awards (Oscars), as it is too difficult for the judges to rank order a larger number of nominations.

  12. 12.

    These results were later proved by Patrick Moran in a brief article on “The method of paired comparisons” in Biometrika in 1947 [1003].

  13. 13.

    This was a typical approach for the time. Because a permutation test generally did not generate a value of the statistic that coincided exactly with α (e.g., 0.05 or 0.01) of the permutation distribution, a value of the permuted statistic, \(C_{\alpha }^{2}\), was defined as the smallest value of statistic C 2 for which \(P({C}^{2} \geq C_{\alpha }^{2}) \leq \alpha\).

  14. 14.

    The National Bureau of Standards was founded in 1901 as a non-regulatory agency of the United States Department of Commerce in Gaithersburg, Maryland. The NBS was renamed The National Institute of Standards and Technology (NIST) in 1988.

  15. 15.

    In a 1943 article in The Annals of Mathematical Statistics, Wolfowitz commented that the choice of U as a test statistic was somewhat arbitrary and that other reasonable tests could certainly be devised [1465, p. 284], such as that proposed by Wilfrid Dixon in 1940, also in The Annals of Mathematical Statistics [353].

  16. 16.

    A clear exposition of the Wald–Wolfowitz runs test was given in an article by Lincoln Moses on “Non-parametric statistics for psychological research” published in Psychological Bulletin in 1952 [1010].

  17. 17.

    Tests based on permutations of observations require that, under the null hypothesis, the probability distribution is symmetric under all permutations of the observations. This symmetry can be assured by randomly assigning treatments to the experimental units. As a result, these tests are often referred to as “randomization tests” in the literature [254, p. 729].

  18. 18.

    A summary in English of the Rodrigues 1839 article is available in Mathematics and Social Utopias in France: Olinde Rodrigues and His Times [39, pp. 110–112].

  19. 19.

    This paper was cited by Moran in [1005, p. 162] as “Rank correlation and a paper by H.G. Haden, ” but apparently the title was changed at some point to “Rank correlation and permutation distributions” when it was published in Proceedings of the Cambridge Philosophical Society in 1948.

  20. 20.

    Technically, Fig. 3.1 is a permutation graph of a family of line segments that connect two parallel lines in the Euclidean plane. Given a permutation {4, 2, 3, 1, 5} of the positive integers {1, 2, 3, 4, 5}, there exists a vertex for each number {1, 2, 3, 4, 5} and an edge between two numbers where the segments cross in the permutation diagram.

  21. 21.

    See also a discussion about the relationship between Turing and Church by George Dyson in a 2012 book titled Turing’s Cathedral [370, pp. 249–250].

  22. 22.

    This was actually Barnard’s first, of many, published papers. It was published in Nature while Barnard was employed at the Ministry of Supply and is only one-half page in length.

  23. 23.

    In 1984 Barnard revealed the meaning behind labeling the statistic CSM, recalling “there was a private pun in my labelling the suggested procedure CSM—it referred …to the Company Sergeant Major in my Home Guard unit at the time, my relations with whom were not altogether cordial. I still feel that the test, like the man, is best forgotten” [70, p. 450].

  24. 24.

    The Barnard test will not die and from time to time the test is resurrected and advocated; see for example, articles by McDonald, Davis, and Milliken [913] in 1977; Barnard [72], Hill [621], and Rice [1167, 1168] in 1988; Dupont [365] and Martín Andrés and Luna del Castillo [900] in 1989; and Campbell [239] in 2007.

  25. 25.

    The Gordon Research Conferences on Statistics in Chemistry and Chemical Engineering began in 1951 and continued through the summer of 2005.

  26. 26.

    The Wilcoxon two-sample rank-sum test statistic is conventionally expressed as W in textbooks, but Wilcoxon actually designated his test statistic as T. Also, many textbooks describe the Wilcoxon test as a “difference between group medians” test, when it is clearly a test for the difference between mean ranks; see for example, an article by Bergmann , Ludbrook , and Spooren in 2000 [100] and an article by Conroy in 2012 [274].

  27. 27.

    A clear and concise exposition of the Wilcoxon unpaired and paired sample rank tests is given in an article by Lincoln Moses on “Non-parametric statistics for psychological research” published in Psychological Bulletin in 1952 [1010].

  28. 28.

    For a brief history of the factorial symbol, see a 1921 article in Isis by Florian Cajori on the “History of symbols for \(\underline{\text{n}} =\mathrm{ factorial}\)” [237].

  29. 29.

    Wilcoxon’s use of the term “partitions” here is a little misleading. These are actually sums of T = 20, each sum consisting of five integer values between 1 and 2q = 10 with no integer value repeated e.g., {1, 2, 3, 4, 10} = 20 which consists of five non-repeating integer values, but not {5, 7, 8} = 20 which consists of only three integer values, nor {1, 3, 3, 5, 8} = 20 which contains multiple values of 3.

  30. 30.

    MacMahon’s monumental two-volume work on Combinatory Analysis, published in 1916, contained a section in Volume II, Chap. III, on “Ramanujan’s Identities” in which MacMahon demonstrated the relationship between the number of q-part unequal partitions without repetitions with no part greater than 2q and the number of partitions with repetitions with no part greater than q [865, pp. 33–48].

  31. 31.

    Several sources list Festinger earning his Ph.D. in 1942 from Iowa State University, not the University of Iowa. Since his dissertation advisor was Kurt Lewin, who was at the University of Iowa from 1935 to 1944, the University of Iowa appears correct.

  32. 32.

    The decomposition \(\binom{n}{r} = \binom{n - 1}{r} + \binom{n - 1}{r - 1}\) has been well known since the publication of Blaise Pascal’s Traité du triangle arithmétique in 1665, 3 years after his death [1088]. Thus, considering any one of n objects, \(\binom{n - 1}{r}\) gives the number of combinations that exclude it and \(\binom{n - 1}{r - 1}\) the number of combinations that include it.

  33. 33.

    A particularly clear exposition of the Mann–Whitney U test is given in a 1952 paper by Lincoln Moses on “Non-parametric statistics for psychological research” published in Psychological Bulletin [1010].

  34. 34.

    Here, the decomposition is identical to Festinger’s , as given in [427].

  35. 35.

    Whitfield’s article was followed immediately in the same issue of Biometrika with a comment by M.G. Kendall noting that “Mr Whitfield has correctly surmised the variance [of τ] when one ranking contains ties, and the other is a dichotomy” [733, p. 297].

  36. 36.

    In 1968 Charles R. Kraft and Constance van Eeden showed how Kendall’s τ can be computed as a sum of Wilcoxon W statistics [768, pp. 180–181].

  37. 37.

    Whitfield lists the date of the Kendall article as 1946, but Kendall’s article was actually published in Biometrika in 1945.

  38. 38.

    It was common at this time to assume continuous variables as this ensured no tied values, cf. articles by Sun and Sherman in 1996 [1335, p. 90] and Gebhard and Schmitz in 1998 [502, p. 76].

  39. 39.

    Cedric Smith, Roland Brooks, Arthur Stone , and William Tutte met at Trinity College, University of Cambridge, and were known as the Trinity Four. Together they published mathematical papers under the pseudonym Blanche Descartes , much in the tradition of the putative Peter Ørno , John Rainwater, and Nicolas Bourbaki .

  40. 40.

    Equation (3.5) is incorrect in Haldane and Smith [573, p. 117] and is corrected here.

  41. 41.

    It should be noted that while the decomposition in Eq. (3.8) is different from that employed by Mann and Whitney in Eq. (3.4) [880], it is similar to the decomposition used by Festinger [427], although there is no indication that Haldane and Smith were familiar with the work of Festinger .

  42. 42.

    Phenylketonuria (PKU) is a autosomal recessive metabolic genetic disorder that can lead to mental retardation, seizures, behavioral problems, and autism. Dr. Asbjørn Følling , a Norwegian biochemist and physician, was the first to publish a description of phenylketonuria as a cause of mental retardation in 1934 [475].

  43. 43.

    The Fisher–Yates test of significance for 2 × 2 contingency tables was independently developed by R.A. Fisher in 1935 [452], F. Yates in 1934 [1472], and J.O. Irwin in 1935 [674] (qq.v. pages 25, 37, and 48).

  44. 44.

    Unfortunately, Finney recommended doubling the obtained one-tailed probability value when using a two-tailed test [434, p. 146]. This was destined to become a procedure of considerable controversy in the mid-1980s (q.v. page 51).

  45. 45.

    It should be noted that Kendall neglected to mention the two-sample rank-sum test developed by Festinger 2 years prior, perhaps because it was published in the psychology journal, Psychometrika, which was not commonly read by statisticians.

  46. 46.

    Southern Rhodesia was shortened to Rhodesia in 1965 and renamed the Republic of Zimbabwe in 1980.

  47. 47.

    For a brief history of the development of the two-sample rank-sum test, see a 2012 article by Berry , Mielke , and Johnston in Computational Statistics [160].

  48. 48.

    Authors’ note: in deciphering the article by van der Reyden we were often reminded of a comment by Nathaniel Bowditch . In the memoir prefixed to the fourth volume of Bowditch’s translation of Laplace’s Mécanique Céleste, page 62, Bowditch wrote: “[w]henever I meet in La Place with the words ‘Thus it plainly appears’ I am sure that hours, and perhaps days of hard study will alone enable me to discover how it plainly appears.” (Bowditch, quoted in Todhunter [1363, p. 478]; emphasis in the original).

  49. 49.

    Recall that the two-sample rank-sum method proposed by Wilcoxon in 1945 considered only equal sample sizes [1453] and Festinger , in 1946, was the first to develop a two-sample rank-sum procedure that could accommodate different sample sizes [427].

  50. 50.

    For brief biographical sketches of Evelyn Fix and Joseph L. Hodges , see Lehmann’s wonderful little book titled Reminiscences of a Statistician: The Company I Kept, published in 2008 [814, pp. 27–35].

  51. 51.

    In this regard, see an article by John Ludbrook on “The Wilcoxon–Mann–Whitney test condemned” in British Journal of Surgery [851] as well as a rejoinder by G.D. Murray [1017]. See also an exact permutation computer program for the Wilcoxon–Mann–Whitney test by Berry and Mielke in 2000 [155].

  52. 52.

    It should be explained that “computer” was a common term that referred to the person who was responsible for calculations, usually a woman or group of women. In this case the computer was Miss Joan Ayling of the National Institute for Social and Economic Research who was given due credit by the authors “for her customary patience and accuracy” [328, p. 131]. See also a discussion by George Dyson in a 2012 book titled Turing’s Cathedral [370, p. 59].

  53. 53.

    A rigorous derivation of the exact contingency formula was given by John Halton in Mathematical Proceedings of the Cambridge Philosophical Society in 1969 [578].

  54. 54.

    In many applications, “panels” are sometimes referred to as “slices” or “levels.”

  55. 55.

    As noted by Edwards [399, p. x], it was Pierre Raymond de Montmort who, in 1708, first attached the name of Pascal to the combinatorial triangle; however, he changed the form to a staggered version [334]. Then, in his Miscellanea Analytica of 1730, Abraham de Moivre christened Pascal’s original triangle “Triangulum Arithmeticum PASCALIANUM.”

  56. 56.

    As Box and Andersen noted in 1955, although there are (m + n)! possible arrangements of a sample, there are only (m + n)! ∕(m! n! ) arrangements that result in possibly different mean differences [193, p. 7].

  57. 57.

    Presently, resampling permutation routines, which are essentially sampling without replacement routines, generate hundreds of thousands of permutations per second when powered by an efficient uniform pseudorandom number generator (PRNG) such as the Mersenne Twister (MT) or the SIMD-oriented Fast Mersenne Twister (SFMT) on high-speed work stations [905, 1214].

  58. 58.

    Emphasis in the original.

References

  1. Agresti, A., Wackerly, D., Boyett, J.M.: Exact conditional tests for cross-classifications: Approximation of attained significance levels. Psychometrika 44, 75–83 (1979)

    MATH  MathSciNet  Google Scholar 

  2. Ahlswede, R.: Jacob Wolfowitz (1910–1981). http://www.ifp.illinois.edu/~junchen/jacob_wolfowitz.htm (1981). Accessed 19 Jan 2012

  3. Anonymous: Dr P. H. Leslie. Nature 239, 477–478 (1972)

    Google Scholar 

  4. Anonymous: Former RSS honorary secretary, Sidney Rosenbaum, dies. RSSeNews. http://www.rssenews.org.uk/2013/03/former-rss-honorary-secretary-sidney-rosenbaum-dies (20 March 2013). Accessed 9 June 2013

  5. Anonymous: Turing top secret. Significance 9, 3 (June 2012)

    Google Scholar 

  6. Armsen, P.: Tables for significance tests of 2 × 2 contingency tables. Biometrika 42, 494–511 (1955)

    MATH  MathSciNet  Google Scholar 

  7. Asimov, N.: Erich L. Lehmann — Berkeley professor — dies. San Francisco Chronicle, pp. D–8. http://www.sfgate.com/science/article/Erich-L-Lehmann-Berkeley-professor-dies-3214326.php (16 October 2009). Accessed 9 Sept 2010

  8. Askey, R.: The 1839 paper on permutations: Its relation to the Rodrigues formula and further developments. In: Altman, S., Ortiz E.L. (eds.) Mathematics and Social Utopias in France: Olinde Rodrigues and His Times, vol. 28, History of Mathematics, pp. 105–118. American Mathematical Society, Providence (2005)

    Google Scholar 

  9. Auble, D.: Extended tables for the Mann–Whitney statistic. B. Inst. Educ. Res. Ind. 1, 1–39 (1953)

    Google Scholar 

  10. Augarten, S.: Bit by Bit: An Illustrated History of Computers. Ticknor & Fields, New York. http://ds.haverford.edu/bitbybit/bit-by-bit-contents/chapter-five/5-8-the-ias-computer/ (1984). Accessed 7 Apr 2013

  11. Babington Smith, C.: Evidence in Camera: The Story of Photographic Intelligence in World War II. David & Charles, London (1957)

    Google Scholar 

  12. Bacaër, N.: The Leslie matrix. In: A Short History of Mathematical Population Dynamics, chap. 21, pp. 117–120. Springer, London (2011)

    Google Scholar 

  13. Backus, J.: The history of FORTRAN I, II, and III. ACM SIGPLAN Notices 13, 165–180 (1978)

    Google Scholar 

  14. Baker, F.B., Collier, Jr., R.O.: Monte Carlo F-II: A computer program for analysis of variance F-tests by means of permutation. Educ. Psychol. Meas. 26, 169–173 (1966)

    Google Scholar 

  15. Baker, F.B., Collier, Jr., R.O.: Some empirical results on variance ratios under permutation in the completely randomized design. J. Am. Stat. Assoc. 61, 813–820 (1966)

    Google Scholar 

  16. Baker, F.B., Hubert, L.J.: Inference procedures for ordering theory. J. Educ. Stat. 2, 217–232 (1977)

    Google Scholar 

  17. Barnard, G.A.: A new test for 2 × 2 tables. Nature 156, 177 (1945)

    MATH  MathSciNet  Google Scholar 

  18. Barnard, G.A.: A new test for 2 × 2 tables. Nature 156, 783–784 (1945)

    MathSciNet  Google Scholar 

  19. Barnard, G.A.: Significance tests for 2 × 2 tables. Biometrika 34, 123–138 (1947)

    MATH  MathSciNet  Google Scholar 

  20. Barnard, G.A.: Statistical inference. J. R. Stat. Soc. B Met. 11, 115–149 (1949)

    MATH  MathSciNet  Google Scholar 

  21. Barnard, G.A.: Discussion of “Tests of significance in 2 × 2 tables” by F. Yates. J. R. Stat. Soc. A Gen. 147, 449–450 (1984)

    Google Scholar 

  22. Barnard, G.A.: Discussion of “A new probability model for determining exact P-values for 2 × 2 contingency tables when comparing binomial proportions” by W.R. Rice. Biometrics 44, 16–18 (1988)

    Google Scholar 

  23. Bergmann, R., Ludbrook, J., Spooren, W.P.J.M.: Different outcomes of the Wilcoxon–Mann–Whitney test from different statistics packages. Am. Stat. 54, 72–77 (2000)

    Google Scholar 

  24. Berry, K.J., Johnston, J.E., Mielke, P.W.: Exact goodness-of-fit tests for unordered equiprobable categories. Percept. Motor Skill 98, 909–918 (2004)

    Google Scholar 

  25. Berry, K.J., Mielke, P.W.: Exact and Monte Carlo resampling procedures for the Wilcoxon–Mann–Whitney and Kruskal–Wallis tests. Percept. Motor Skill. 91, 749–754 (2000)

    Google Scholar 

  26. Berry, K.J., Mielke, P.W., Johnston, J.E.: The two-sample rank-sum test: early development. Elec. J. Hist. Prob. Stat. 8, 1–26 (2012)

    MathSciNet  Google Scholar 

  27. Beyer, K.W.: Grace Hopper and the Invention of the Information Age. MIT Press, Cambridge (2009)

    Google Scholar 

  28. Boothroyd, J.: Algorithm 29: Permutations of the elements of a vector. Comput. J. 10, 310–311 (1967)

    Google Scholar 

  29. Boothroyd, J.: Algorithm 30: Fast permutation of the elements of a vector. Comput. J. 10, 311–312 (1967)

    Google Scholar 

  30. Bowen, J.: Alan Turing. In: Robinson, A. (ed.) The Scientists: An Epic of Discovery, pp. 270–275. Thames & Hudson, London (2012)

    Google Scholar 

  31. Box, G.E.P.: Non-normality and tests on variances. Biometrika 40, 318–335 (1953)

    MATH  MathSciNet  Google Scholar 

  32. Box, G.E.P.: An Accidental Statistician: The Life and Memories of George E. P. Box. Wiley, New York (2013) [Also inscribed “With a little help from my friend, Judith L. Allen”]

    Google Scholar 

  33. Box, G.E.P., Andersen, S.L.: Permutation theory in the derivation of robust criteria and the study of departures from assumption (with discussion). J. R. Stat. Soc. B Met. 17, 1–34 (1955)

    MATH  Google Scholar 

  34. Bradbury, I.: Analysis of variance versus randomization — a comparison. Br. J. Math. Stat. Psychol. 40, 177–187 (1987)

    MATH  MathSciNet  Google Scholar 

  35. Bradley, R.A.: Frank Wilcoxon. Biometrics 22, 192–194 (1966)

    MATH  Google Scholar 

  36. Bradley, R.A., Hollander, M.: Wilcoxon, Frank. In: Heyde, C.C., Seneta, E. (eds.) Statisticians of the Centuries, pp. 420–424. Springer, New York (2001)

    Google Scholar 

  37. Bratley, P.: Algorithm 306: Permutations with repetitions. Commun. ACM 7, 450–451 (1967)

    Google Scholar 

  38. Brillinger, D.R.: Erich Leo Lehmann, 1917 – 2009. J. R. Stat. Soc. A Stat 173, 683–689 (2010)

    Google Scholar 

  39. Brooks, E.B.: Frank Wilcoxon, 2 Sept 1892 – 18 Nov 1965. Tales of Statisticians. http://www.umass.edu/wsp/statistics/tales/wilcoxon.html. Accessed 1 Apr 2012

  40. Burr, E.J.: The distribution of Kendall’s score S for a pair of tied rankings. Biometrika 47, 151–171 (1960)

    MATH  MathSciNet  Google Scholar 

  41. Cajori, F.: History of symbols for \(\underline{\text{n}}\) = factorial. Isis 3, 414–418 (1921)

    Google Scholar 

  42. Campbell, I.: Chi-squared and Fisher–Irwin tests of two-by-two tables with small sample recommendations. Stat. Med. 26, 3661–3675 (2007)

    MathSciNet  Google Scholar 

  43. Campbell-Kelly, M.: John von Neumann. In: Robinson, A. (ed.) The Scientists: An Epic of Discovery, pp. 276–279. Thames & Hudson, London (2012)

    Google Scholar 

  44. Chase, P.J.: Algorithm 382: Combinations of M out of N objects. Commun. ACM 13, 368–369 (1970)

    Google Scholar 

  45. Chase, P.J.: Algorithm 383: Permutations of a set with repetitions. Commun. ACM 13, 368–369 (1970)

    Google Scholar 

  46. Chung, J.H., Fraser, D.A.S.: Randomization tests for a multivariate two-sample problem. J. Am. Stat. Assoc. 53, 729–735 (1958)

    MATH  Google Scholar 

  47. Conroy, R.M.: What hypotheses do “nonparametric” two-group tests actually test? Stata J. 12, 182–190 (2012)

    Google Scholar 

  48. Crowcroft, P.: Elton’s Ecologists: A History of the Bureau of Animal Population. University of Chicago Press, Chicago (1991)

    Google Scholar 

  49. Daniel, W.W.: Applied Nonparametric Statistics. Houghton Mifflin, Boston (1978)

    MATH  Google Scholar 

  50. Daniels, H.E.: Rank correlation and population models (with discussion). J. R. Stat. Soc. B Met. 12, 171–191 (1950)

    MATH  MathSciNet  Google Scholar 

  51. David, H.A.: First (?) occurrence of common terms in mathematical statistics. Am. Stat. 49, 121–133 (1995)

    Google Scholar 

  52. David, H.A.: Samuel Stanley Wilks (1906–1964). Am. Stat. 60, 46–49 (2006)

    Google Scholar 

  53. David, S.T., Kendall, M.G., Stuart, A.: Some questions of distribution in the theory of rank correlation. Biometrika 38, 131–140 (1951)

    MATH  MathSciNet  Google Scholar 

  54. Defining a legend. University of Wisconsin Foundation Insights. http://www.supportuw.org/wp-content/uploads/insights_04_fall.pdf (Fall 2004). Accessed 20 June 2013

  55. de Montmort, P.R.: Essay d’Analyse sur les Jeux de Hazard (Analytical Essay on Gambling). Quillau, Paris (1708)

    Google Scholar 

  56. de Wet, T.: Statistics in the fifties. South African Statistical Association (2003) [Presidential Address on the 50th Anniversary of the South African Statistical Association, Johannesburg, 2003 by Tertius de Wet]

    Google Scholar 

  57. DeGroot, M.H.: A conversation with Charles Stein. Stat. Sci. 1, 454–462 (1986)

    MATH  MathSciNet  Google Scholar 

  58. DeGroot, M.H.: A conversation with Erich L. Lehmann. Stat. Sci. 1, 243–258 (1986)

    MATH  MathSciNet  Google Scholar 

  59. DeGroot, M.H.: A conversation with George Box. Stat. Sci. 2, 239–258 (1987)

    MATH  MathSciNet  Google Scholar 

  60. DeGroot, M.H.: A conversation with George A. Bernard. Stat. Sci. 3, 196–212 (1988)

    Google Scholar 

  61. Dershowitz, N.: A simplified loop-free algorithm for generating permutations. BIT 15, 158–164 (1975)

    MATH  MathSciNet  Google Scholar 

  62. Deuchler, G.: Über die Methoden der Korrelationsrechnung in der Pädagogik und Psychologie. Z. Padagog. Psychol. Exp. Padagog. 15, 114–131, 145–159, and 229–242 (1914)

    Google Scholar 

  63. Dixon, W.J.: A criterion for testing the hypothesis that two samples are from the same population. Ann. Math. Stat. 11, 199–204 (1940)

    Google Scholar 

  64. Doolen, G.D., Hendricks, J.: Monte Carlo at work. Los Alamos Sci. 15, 142–143 (1987)

    MathSciNet  Google Scholar 

  65. Dunnett, C.W.: Frank Wilcoxon, 1892–1965. Technometrics 8, 195–196 (1966)

    MATH  Google Scholar 

  66. Dupont, W.D.: Reply to Comment on “Sensitivity of Fisher’s exact test to minor perturbations in 2 × 2 contingency tables” by A. Martín Andrés and J.D. Luna del Castillo. Stat. Med. 8, 244–245 (1989)

    Google Scholar 

  67. Dwass, M.: Modified randomization tests for nonparametric hypotheses. Ann. Math. Stat. 28, 181–187 (1957)

    MATH  MathSciNet  Google Scholar 

  68. Dyson, G.: Turing’s Cathedral: The Origins of the Digital Universe. Pantheon/Vintage, New York (2012)

    Google Scholar 

  69. Eckhardt, R.: Stan Ulam, John von Neumann, and the Monte Carlo method. Los Alamos Sci. 15, 131–137 (1987)

    MathSciNet  Google Scholar 

  70. Eden, T., Yates, F.: On the validity of Fisher’s z test when applied to an actual example of non-normal data. J. Agric. Sci. 23, 6–17 (1933)

    Google Scholar 

  71. Edwards, A.W.F.: Pascal’s Arithmetical Triangle. Griffin, London (1987)

    MATH  Google Scholar 

  72. Edwards, A.W.F.: Professor C. A. B. Smith, 1917–2002. J. R. Stat. Soc. D Stat. 51, 404–405 (2002)

    Google Scholar 

  73. Edwards, A.W.F.: Fisher computes…. Significance 9, 44 (2012) [Letter to the editor regarding an article by Fisher in Significance, August 2012]

    Google Scholar 

  74. Churchill Eisenhart, statistics expert. NY Times. http://www.nytimes.com/1994/07/01/us/churchill-eisenhart-statistics-expert-82.html (1 July 1994). Accessed 20 Jan 2012

  75. Ernst, M.D.: Permutation methods: A basis for exact inference. Stat. Sci. 19, 676–685 (2004)

    MATH  MathSciNet  Google Scholar 

  76. Feinstein, A.R.: Clinical Biostatistics XXIII: The role of randomization in sampling, testing, allocation, and credulous idolatry (Part 2). Clin. Pharmacol. Ther. 14, 898–915 (1973)

    Google Scholar 

  77. Ferry, G.: A Computer Called LEO. HarperCollins, London (2004)

    Google Scholar 

  78. Festinger, L.: The significance of differences between means without reference to the frequency distribution function. Psychometrika 11, 97–105 (1946)

    MATH  MathSciNet  Google Scholar 

  79. Fienberg, S.E., Stigler, S.M., Tanur, J.M.: The William Kruskal legacy: 1919–2005. Stat. Sci. 22, 255–261 (2007)

    MATH  MathSciNet  Google Scholar 

  80. Finney, D.J.: The Fisher–Yates test of significance in 2 × 2 contingency tables. Biometrika 35, 145–156 (1948)

    MATH  MathSciNet  Google Scholar 

  81. Finney, D.J.: A numerate life. In: Gani, J. (ed.) The Making of Statisticians, pp. 150–164. Springer, New York (1982)

    Google Scholar 

  82. Fisher, R.A.: Statistical Methods for Research Workers. Oliver and Boyd, Edinburgh (1925)

    Google Scholar 

  83. Fisher, R.A.: The Design of Experiments. Oliver and Boyd, Edinburgh (1935)

    Google Scholar 

  84. Fisher, R.A.: The logic of inductive inference (with discussion). J. R. Stat. Soc. 98, 39–82 (1935)

    Google Scholar 

  85. Fisher, R.A.: A new test for 2 × 2 tables. Nature 156, 388 (1945)

    Google Scholar 

  86. Fisher, R.A.: Gene frequencies in a cline determined by selection and diffusion. Biometrics 6, 353–361 (1950)

    Google Scholar 

  87. Fix, E., Hodges, J.L.: Significance probabilities of the Wilcoxon test. Ann. Math. Stat. 26, 301–312 (1955)

    MATH  MathSciNet  Google Scholar 

  88. Flournoy, N.: A conversation with Wilfrid J. Dixon. Stat. Sci. 8, 458–477 (1993)

    MATH  MathSciNet  Google Scholar 

  89. Flournoy, N.: Wilfrid Joseph Dixon, 1915–2008. J. R. Stat. Soc. A Stat. 173, 455–456 (2010)

    Google Scholar 

  90. Følling, A.: The excretion of phenylpyruvic acid in the urine, an anomaly of metabolism in connection with imbecility. Z. Physiol. Chem. 227, 169–176 (1934)

    Google Scholar 

  91. Freeman, G.H., Halton, J.H.: Note on an exact treatment of contingency, goodness of fit and other problems of significance. Biometrika 38, 141–149 (1951)

    MATH  MathSciNet  Google Scholar 

  92. Friedman, M.: The use of ranks to avoid the assumption of normality implicit in the analysis of variance. J. Am. Stat. Assoc. 32, 675–701 (1937)

    Google Scholar 

  93. Friedman, M.: A comparison of alternative tests of significance for the problem of m rankings. Ann. Math. Stat. 11, 86–92 (1940)

    Google Scholar 

  94. Gebhard, J., Schmitz, N.: Permutation tests — a revival?! I. Optimum properties. Stat. Pap. 39, 75–85 (1998)

    MATH  MathSciNet  Google Scholar 

  95. Gelman, A.: Tables as graphs: The Ramanujan principle. Significance 8, 183 (December 2011)

    Google Scholar 

  96. Ghent, A.W.: A method for exact testing of 2 × 2, 2 × 3, 3 × 3, and other contingency tables, employing binomial coefficients. Am. Midl. Nat. 88, 15–27 (1972)

    Google Scholar 

  97. Good, P.I.: Permutation Tests: A Practical Guide to Resampling Methods for Testing Hypotheses. Springer, New York (1994)

    MATH  Google Scholar 

  98. Good, P.I.: Efficiency comparisons of rank and permutation tests by Janice M. Weinberg and Stephen W. Lagakos in Statistics in Medicine 2001; 20:705–731. Stat. Med. 23, 857 (2004)

    Google Scholar 

  99. Grier, D.A.: Statistics and the introduction of digital computers. Chance 4, 30–36 (1991)

    MathSciNet  Google Scholar 

  100. Griffin, H.D.: Graphic computation of tau as a coefficient of disarray. J. Am. Stat. Assoc. 53, 441–447 (1958)

    MATH  Google Scholar 

  101. Guide to the Meyer Dwass (1923–1996) papers. Northwestern University Library. http://findingaids.library.northwestern.edu/catalog/inu-ead-nua-archon-548 (2002). Accessed 19 Jan 2012

  102. Hack, H.R.B.: An empirical investigation into the distribution of the F-ratio in samples from two non-normal populations. Biometrika 45, 260–265 (1958)

    MATH  Google Scholar 

  103. Haden, H.G.: A note on the distribution of the different orderings of n objects. Math. Proc. Cambridge 43, 1–9 (1947)

    MathSciNet  Google Scholar 

  104. Haldane, J.B.S., Smith, C.A.B.: A simple exact test for birth-order effect. Ann. Eugenic. 14, 117–124 (1948)

    Google Scholar 

  105. Halton, J.H.: A rigorous derivation of the exact contingency formula. Math. Proc. Cambridge 65, 527–530 (1969)

    MATH  MathSciNet  Google Scholar 

  106. Halton, J.H.: A retrospective and prospective survey of the Monte Carlo method. SIAM Rev. 12, 1–63 (1970)

    MATH  MathSciNet  Google Scholar 

  107. Hamilton, A.: Brains that click. Pop. Mech. 91, 162–167, 256, 258 (1949)

    Google Scholar 

  108. Hardy, G.H., Ramanujan, S.: Asymptotic formulae in combinatory analysis. Proc. Lond. Math. Soc. 17, 75–115 (1918)

    Google Scholar 

  109. Hayes, B.: The memristor. Am. Sci. 99, 106–110 (2011)

    Google Scholar 

  110. Hemelrijk, J.: Note on Wilcoxon’s two-sample test when ties are present. Ann. Math. Stat. 23, 133–135 (1952)

    MATH  MathSciNet  Google Scholar 

  111. Higgon, K.: Rosenbaum, Dr Sidney (b 1918). Liddell Hart Centre for Military Archives, King’s College London. http://www.kingscollections.org/catalogues/lhcma/collection/p-t/ro75-001 (2007). Accessed 6 Dec 2012

  112. Hilbe, J.M.: The coevolution of statistics and HZ. In: Sawilowsky, S.S. (ed.) Real Data Analysis, pp. 3–20. Information Age, Charlotte (2007)

    Google Scholar 

  113. Hill, I.D.: Discussion of “A new probability model for determining exact P-values for 2 × 2 contingency tables when comparing binomial proportions” by W.R. Rice. Biometrics 44, 14–16 (1988)

    Google Scholar 

  114. Hoeffding, W.: The large-sample power of tests based on permutations of observations. Ann. Math. Stat. 23, 169–192 (1952)

    MATH  MathSciNet  Google Scholar 

  115. Hollander, M.: A conversation with Ralph A. Bradley. Stat. Sci. 16, 75–100 (2000)

    MathSciNet  Google Scholar 

  116. Hotelling, H.: The generalization of Student’s ratio. Ann. Math. Stat. 2, 360–378 (1931)

    Google Scholar 

  117. Hotelling, H., Pabst, M.R.: Rank correlation and tests of significance involving no assumption of normality. Ann. Math. Stat. 7, 29–43 (1936)

    Google Scholar 

  118. Householder, A.S., Forsythe, G.E., Germond, H.H. (eds.): Monte Carlo Methods. No. 12 in National Bureau of Standards Applied Mathematics Series. United States Government Printing Office, Washington, DC (1951)

    Google Scholar 

  119. In Memoriam: Dr. Colin White. Yale Univ. News. http://news.yale.edu/2011/03/14/memoriam-dr-colin-white (2011). Accessed 31 Mar 2012

  120. Irwin, J.O.: Tests of significance for differences between percentages based on small numbers. Metron 12, 83–94 (1935)

    Google Scholar 

  121. Ives, F.W.: Permutation enumeration: Four new permutation algorithms. Commun. ACM 19, 68–72 (1976)

    MATH  Google Scholar 

  122. Jacobson, J.E.: The Wilcoxon two-sample statistic: Tables and bibliography. J. Am. Stat. Assoc. 58, 1086–1103 (1963)

    MATH  Google Scholar 

  123. Jarrett, T.: On algebraic notation. Trans. Camb. Philos. Soc. 3, 65–103 (1830)

    Google Scholar 

  124. Jenkins, N.: W. H. Auden–‘Family Ghosts’. Department of English, Stanford University. http://www.stanford.edu/group/auden/cgi-bin/auden (2008). Accessed 6 Feb 2012

  125. Johnson, N.L.: Theoretical considerations regarding H.R.B. Hack’s system of randomization for cross-classifications. Biometrika 45, 265–266 (1958)

    MATH  Google Scholar 

  126. Johnson, N.L., Kotz, S.: Wilks, Samuel Stanley. In: Johnson, N.L., Kotz, S. (eds.) Leading Personalities in Statistical Sciences: From the Seventeenth Century to the Present, Wiley Series in Probability and Statistics, pp. 211–212. Wiley, New York (1997)

    Google Scholar 

  127. Jonckheere, A.R.: A distribution-free k-sample test against ordered alternatives. Biometrika 41, 133–145 (1954)

    MATH  MathSciNet  Google Scholar 

  128. Kamat, A.R.: A two-sample distribution-free test. Biometrika 43, 388–387 (1956)

    MathSciNet  Google Scholar 

  129. Kean, S.: The Disappearing Spoon. Little, Brown, New York (2010)

    Google Scholar 

  130. Kempthorne, O.: The randomization theory of experimental inference. J. Am. Stat. Assoc. 50, 946–967 (1955)

    MathSciNet  Google Scholar 

  131. Kendall, M.G.: A new measure of rank correlation. Biometrika 30, 81–93 (1938)

    MATH  MathSciNet  Google Scholar 

  132. Kendall, M.G.: The treatment of ties in ranking problems. Biometrika 33, 239–251 (1945)

    MATH  MathSciNet  Google Scholar 

  133. Kendall, M.G.: The Advanced Theory of Statistics, vol. II. Griffin, London (1946)

    MATH  Google Scholar 

  134. Kendall, M.G.: The variance of τ when both rankings contain ties. Biometrika 34, 297–298 (1947)

    MATH  MathSciNet  Google Scholar 

  135. Kendall, M.G.: Rank Correlation Methods. Griffin, London (1948)

    MATH  Google Scholar 

  136. Kendall, M.G., Babington Smith, B.: The problem of m rankings. Ann. Math. Stat. 10, 275–287 (1939)

    Google Scholar 

  137. Kendall, M.G., Babington Smith, B.: On the method of paired comparisons. Biometrika 31, 324–345 (1940)

    MATH  MathSciNet  Google Scholar 

  138. Kendall, M.G., Kendall, S.F.H., Babington Smith, B.: The distribution of Spearman’s coefficient of rank correlation in a universe in which all rankings occur an equal number of times. Biometrika 30, 251–273 (1939)

    MATH  Google Scholar 

  139. Kiang, L.Y.: Charles Stein: The invariant, the direct and the “pretentious”. In: Kiang, L.Y. (ed.) Creative Minds, Charmed Lives: Interviews at Institute for Mathematical Sciences, National University of Singapore, pp. 282–287. World Scientific, Singapore (2010)

    Google Scholar 

  140. Kiernan, D.: The Girls of Atomic City: The Untold Story of the Women Who Helped Win World War II. Touchstone, New York (2013)

    Google Scholar 

  141. Kotz, S., Johnson, N.L. (eds.): Breakthroughs in Statistics: Foundations and Basic Theory, vol. I. Springer Series in Statistics. Springer, New York (1992)

    Google Scholar 

  142. Kraft, C.A., van Eeden, C.: A Nonparametric Introduction to Statistics. Macmillan, New York (1968)

    Google Scholar 

  143. Kramp, C.: Éléments d’arithmétique universelle. Hansen, Cologne (1808)

    Google Scholar 

  144. Kruskal, W.H.: Historical notes on the Wilcoxon unpaired two-sample test. J. Am. Stat. Assoc. 52, 356–360 (1957)

    MATH  Google Scholar 

  145. Kruskal, W.H., Wallis, W.A.: Use of ranks in one-criterion variance analysis. J. Am. Stat. Assoc. 47, 583–621 (1952) [Erratum: J. Am. Stat. Assoc. 48, 907–911 (1953)]

    Google Scholar 

  146. Langdon, Jr., G.G.: An algorithm for generating permutations. Commun. ACM 10, 5 (1967)

    Google Scholar 

  147. Latscha, R.: Tests of significance in a 2 × 2 contingency table: Extension of Finney’s table. Biometrika 40, 74–86 (1953)

    MATH  MathSciNet  Google Scholar 

  148. Leach, C.: Introduction to Statistics: A Nonparametric Approach for the Social Sciences. Wiley, New York (1979)

    Google Scholar 

  149. Ledermann, W.: Walter Ledermann: Encounters of a Mathematician. http://www-history.mcs.st.andrews.ac.uk/Ledermann/Ch7.html (2000). Accessed 6 Feb 2012

  150. Lehmann, E.L.: Reminiscences of a Statistician: The Company I Kept. Springer, New York (2008)

    Google Scholar 

  151. Lehmann, E.L.: Parametrics vs. nonparametrics: Two alternative methodologies. J. Nonparametr. Stat. 21, 397–405 (2009)

    Google Scholar 

  152. Lehmann, E.L., Stein, C.M.: On the theory of some non-parametric hypotheses. Ann. Math. Stat. 20, 28–45 (1949)

    MathSciNet  Google Scholar 

  153. Leslie, P.H.: A simple method of calculating the exact probability in 2 × 2 contingency tables with small marginal totals. Biometrika 42, 522–523 (1955)

    MATH  MathSciNet  Google Scholar 

  154. Levin, R.C.: A Yale pioneer: The freshman address. Yale Alum. Mag., 1–4. http://www.yalealumnimagazine.com/issues/2009_11/levin5962.html (November/December 2009). Accessed 14 Mar 2012

  155. Lindley, D.V.: Professor George A. Barnard, 1915–2002. Statistician 52, 231–234 (2003)

    Google Scholar 

  156. Lindley, D.V.: George Barnard: Anti-establishment statistician concerned with quality control. The Guardian. http://www.guardian.co.uk/news/2002/aug/09/guardianobituaries.highereducation (9 August 2002). Accessed 2 Oct 2012

  157. Litchfield, Jr., J.T., Wilcoxon, F.: The rank correlation method. Anal. Chem. 27, 299–300 (1955)

    Google Scholar 

  158. Liu, C.N., Tang, D.T.: Algorithm 452: Enumerating combinations of m out of n objects. Commun. ACM 16, 485 (1973)

    Google Scholar 

  159. Ludbrook, J.: The Wilcoxon–Mann–Whitney test condemned. Br. J. Surg. 83, 136–137 (1996)

    Google Scholar 

  160. MacMahon, P.A.: Combinatory Analysis, vol. II. Cambridge University Press, Cambridge (1916)

    Google Scholar 

  161. MacNeill, I.: A conversation with David J. Finney. Stat. Sci. 8, 187–201 (1993)

    MATH  MathSciNet  Google Scholar 

  162. Mahanti, S.: John Burdon Sanderson Haldane: The ideal of a polymath. Vigyan Prasar Science Portal. http://www.vigyanprasar.gov.in/scientists/JBSHaldane.htm (2007). Accessed 20 Jan 2012

  163. Maisel, M., Smart, L.: Admiral Grace Murray Hopper: Pioneer computer scientist. http://www.sdsc.edu/ScienceWomen/hopper.html (1997). Accessed 13 Mar 2012

  164. Management: Du Pont educates engineers. Chem. Eng. News 36, 38–39 (1958)

    Google Scholar 

  165. Mann, H.B.: Nonparametric tests against trend. Econometrica 13, 245–259 (1945)

    MATH  MathSciNet  Google Scholar 

  166. Mann, H.B., Whitney, D.R.: On a test of whether one of two random variables is stochastically larger than the other. Ann. Math. Stat. 18, 50–60 (1947)

    MATH  MathSciNet  Google Scholar 

  167. Martín Andrés, A., Luna del Castillo, J.D.: Comment on “Sensitivity of Fisher’s exact test to minor perturbations in 2 × 2 contingency tables” by W.D. Dupont. Stat. Med. 8, 243–245 (1989)

    Google Scholar 

  168. Matsumoto, M., Nishimura, T.: Mersenne twister: A 623-dimensionally equidistributed uniform pseudo-random number generator. ACM Trans. Model. Comput. S. 8, 3–30 (1998)

    MATH  Google Scholar 

  169. May, R.B., Hunter, M.A.: Some advantages of permutation tests. Can. Psychol. 34, 401–407 (1993)

    Google Scholar 

  170. McDonald, L.L., Davis, B.M., Milliken, G.A.: A nonrandomized unconditional test for comparing two proportions in 2 × 2 contingency tables. Technometrics 19, 145–157 (1977)

    MATH  Google Scholar 

  171. Metropolis, N.: The beginning of the Monte Carlo method. Los Alamos Sci. 15, 125–130 (1987)

    MathSciNet  Google Scholar 

  172. Metropolis, N., Ulam, S.: The Monte Carlo method. J. Am. Stat. Assoc. 44, 335–341 (1949)

    MATH  MathSciNet  Google Scholar 

  173. Mielke, P.W.: Asymptotic behavior of two-sample tests based on powers of ranks for detecting scale and location alternatives. J. Am. Stat. Assoc. 67, 850–854 (1972)

    MATH  MathSciNet  Google Scholar 

  174. Mielke, P.W.: Squared rank test appropriate to weather modification cross-over design. Technometrics 16, 13–16 (1974)

    MATH  MathSciNet  Google Scholar 

  175. Mielke, P.W., Berry, K.J.: Permutation Methods: A Distance Function Approach, 2nd edn. Springer, New York (2007)

    Google Scholar 

  176. Mielke, P.W., Berry, K.J., Johnson, E.S.: Multi-response permutation procedures for a priori classifications. Commun. Stat. Theor. Methods 5, 1409–1424 (1976)

    Google Scholar 

  177. Mielke, P.W., Sen, P.K.: On asymptotic non-normal null distributions for locally most powerful rank test statistics. Commun. Stat. Theor. Methods 10, 1079–1094 (1981)

    MathSciNet  Google Scholar 

  178. Mielke, P.W., Siddiqui, M.M.: A combinatorial test for independence of dichotomous responses. J. Am. Stat. Assoc. 60, 437–441 (1965)

    MathSciNet  Google Scholar 

  179. Milton, R.C.: An extended table of critical values for the Mann–Whitney (Wilcoxon) two-sample statistic. J. Am. Stat. Assoc. 59, 925–934 (1964)

    MATH  MathSciNet  Google Scholar 

  180. Montgomery, D.C.: A conversation with Stu Hunter. Qual. Eng. 21, 233–240 (2009)

    Google Scholar 

  181. Mood, A.M.: The distribution theory of runs. Ann. Math. Stat. 11, 367–392 (1940)

    MathSciNet  Google Scholar 

  182. Mood, A.M.: Introduction to the Theory of Statistics. McGraw-Hill, New York (1950)

    MATH  Google Scholar 

  183. Mood, A.M.: On the asymptotic efficiency of certain nonparametric two-sample tests. Ann. Math. Stat. 25, 514–522 (1954)

    MATH  MathSciNet  Google Scholar 

  184. Moran, P.A.P.: On the method of paired comparisons. Biometrika 34, 363–365 (1947)

    MATH  MathSciNet  Google Scholar 

  185. Moran, P.A.P.: Rank correlation and permutation distributions. Math. Proc. Camb. 44, 142–144 (1948)

    MATH  Google Scholar 

  186. Moran, P.A.P.: Recent developments in ranking theory. J. R. Stat. Soc. B Met. 12, 152–162 (1950)

    Google Scholar 

  187. Morton, N.: Cedric Smith (1917–2002). Int. Stat. Inst. News 26, 9–10 (2002)

    MathSciNet  Google Scholar 

  188. Moscovici, S.: Obituary: Leon Festinger. Eur. J. Soc. Psychol. 19, 263–269 (1989)

    Google Scholar 

  189. Moses, L.E.: Non-parametric statistics for psychological research. Psychol. Bull. 49, 122–143 (1952)

    Google Scholar 

  190. Moses, L.E.: Statistical theory and research design. Annu. Rev. Psychol. 7, 233–258 (1956)

    Google Scholar 

  191. Mosteller, F.: Samuel S. Wilks: Statesman of statistics. Am. Stat. 18, 11–17 (1964)

    Google Scholar 

  192. Munro, T.A.: Phenylketonuria: Data on forty-seven British families. Ann. Hum. Genet. 14, 60–88 (1947)

    Google Scholar 

  193. Murray, G.D.: Reply from BJS statistical advisor to “The Wilcoxon–Mann–Whitney test condemned” by J. Ludbrook. Br. J. Surg. 83, 137 (1996)

    Google Scholar 

  194. Murray, M.A.M.: The first lady of math? Yale Alum. Mag., 5–6. http://www.yalealumnimagazine.com/issues/2010_05/letters_412.html (May/June 2010). Accessed 14 Mar 2012

  195. Nadkarni, A.S.: Anant Raoji Kamat. Econ. Polit. Weekly 18, 1351–1352 (30 July 1983)

    Google Scholar 

  196. Noether, G.E.: Asymptotic properties of the Wald–Wolfowitz test of randomness. Ann. Math. Stat. 21, 231–246 (1950)

    MATH  MathSciNet  Google Scholar 

  197. Noether, G.E.: On a theorem of Pitman. Ann. Math. Stat. 26, 64–68 (1955)

    MATH  MathSciNet  Google Scholar 

  198. Norman, R.: Biographies of women mathematicians: Grace Murray Hopper. http://www.agnesscott.edu/lriddle/women/hopper.htm (2001). Accessed 13 Mar 2012

  199. Olds, E.G.: Distribution of sums of squares of rank differences for small numbers of individuals. Ann. Math. Stat. 9, 133–148 (1938)

    Google Scholar 

  200. Olkin, I.: A conversation with W. Allen Wallis. Stat. Sci. 6, 121–140 (1991)

    MATH  MathSciNet  Google Scholar 

  201. Olkin, I.: A conversation with Churchill Eisenhart. Stat. Sci. 7, 512–530 (1992)

    MATH  MathSciNet  Google Scholar 

  202. Olmstead, P.S., Tukey, J.W.: A corner test for association. Ann. Math. Stat. 18, 495–513 (1947)

    MATH  MathSciNet  Google Scholar 

  203. Olson, J.: Henry Berthold Mann. Department of Mathematics, The Ohio State University. http://www.math.osu.edu/history/biographies/mann/. Accessed 20 Jan 2012

  204. Ord-Smith, R.J.: Algorithm 308: Generation of permutations in pseudo-lexicographic order. Commun. ACM 10, 7 (1967)

    Google Scholar 

  205. Ord-Smith, R.J.: Algorithm 323: Generation of permutations in lexicographic order. Commun. ACM 11, 2 (1968)

    Google Scholar 

  206. Page, E.S.: A note on generating random permutations. J. R. Stat. Soc. C Appl. 16, 273–274 (1967)

    Google Scholar 

  207. Pascal, B.: Traité du triangle arithmétique (Treatise on the arithmetical triangle). In: Smith, D.E. (ed.) A Source Book in Mathematics, vol. I, pp. 67–79. Dover, New York (1959) [Translated by A. Savitsky]

    Google Scholar 

  208. Payne, W.H., Ives, F.M.: Combination generators. ACM Trans. Math. Software 5, 163–172 (1979)

    Google Scholar 

  209. Pearson, E.S.: The choice of statistical tests illustrated on the interpretation of data classed in a 2 × 2 table. Biometrika 34, 139–167 (1947)

    MATH  MathSciNet  Google Scholar 

  210. Phillips, J.P.N.: Algorithm 28: Permutations of the elements of a vector in lexicographic order. Comput. J. 10, 311 (1967)

    Google Scholar 

  211. Pitman, E.J.G.: Significance tests which may be applied to samples from any populations. Suppl. J. R. Stat. Soc. 4, 119–130 (1937)

    Google Scholar 

  212. Pitman, E.J.G.: Significance tests which may be applied to samples from any populations: II. The correlation coefficient test. Suppl. J. R. Stat. Soc. 4, 225–232 (1937)

    Google Scholar 

  213. Pitman, E.J.G.: Significance tests which may be applied to samples from any populations: III. The analysis of variance test. Biometrika 29, 322–335 (1938)

    MATH  Google Scholar 

  214. Pitman, E.J.G.: Lecture notes on non-parametric statistical inference (1948) [Unpublished lecture notes for a course given at Columbia University in 1948]

    Google Scholar 

  215. Plackett, R.L.: Obituary: Churchill Eisenhart. J. R. Stat. Soc. A Stat. 158, 338 (1995)

    MATH  MathSciNet  Google Scholar 

  216. Randles, R.H., Wolfe, D.A.: Introduction to the Theory of Nonparametric Statistics. Wiley, New York (1979)

    MATH  Google Scholar 

  217. Rice, W.R.: A new probability model for determining exact p-values for 2 × 2 contingency tables when comparing binomial proportions. Biometrics 44, 1–22 (1988)

    MATH  MathSciNet  Google Scholar 

  218. Rice, W.R.: Reply to the discussion of “A new probability model for determining exact P-values for 2 × 2 contingency tables when comparing binomial proportions” by W.R. Rice. Biometrics 44, 18–22 (1988)

    MathSciNet  Google Scholar 

  219. Robinson, J.: The large-sample power of permutation tests for randomization models. Ann. Stat. 1, 291–296 (1973)

    MATH  Google Scholar 

  220. Rodrigues, O.: Note sur les inversions, ou dérangements produits dans les permutations (Note on inversions, or products of derangements in permutations). J. Math. Pure. Appl. 4, 236–240 (1839) [The Journal de Mathématiques Pures et Appliquées is also known as the Journal de Liouville]

    Google Scholar 

  221. Rohl, J.S.: Programming improvements to Fike’s algorithm for generating permutations. Comput. J. 19, 156–159 (1976)

    Google Scholar 

  222. Rohl, J.S.: Generating permutations by choosing. Comput. J. 21, 302–305 (1978)

    MATH  Google Scholar 

  223. Rojo, J.: Erich Leo Lehmann — A glimpse into his life and work. Ann. Stat. 39, 2244–2265 (2011)

    MATH  MathSciNet  Google Scholar 

  224. Rosenbaum, S.: Tables for a nonparametric test of dispersion. Ann. Math. Stat. 24, 663–668 (1953)

    MATH  MathSciNet  Google Scholar 

  225. Saito, M., Matsumoto, M.: SIMD-oriented fast Mersenne twister: A 128-bit pseudorandom number generator. In: Keller, A., Heinrich, S., Niederreiter, H. (eds.) Monte Carlo and Quasi-Monte Carlo Methods 2006, pp. 607–622. Springer, Berlin (2008) [Proceedings of the Seventh International Conference on Monte Carlo and Quasi-Monte Carlo Methods in Scientific Computing, held at Ulm University, Germany, in August 2006]

    Google Scholar 

  226. Salsburg, D.: The Lady Tasting Tea: How Statistics Revolutionized Science in the Twentieth Century. Holt, New York (2001)

    Google Scholar 

  227. Sandiford, P.: Educational Psychology. Longmans, Green & Company, New York (1928) [The graphical method appears in an Appendix by S.D. Holmes, ‘A graphical method of estimating R for small groups’, pp. 391–394]

    Google Scholar 

  228. Savage, I.R.: Nonparametric statistics. J. Am. Stat. Assoc. 52, 331–344 (1957)

    MathSciNet  Google Scholar 

  229. Sawrey, W.L.: A distinction between exact and approximate nonparametric methods. Psychometrika 23, 171–177 (1958)

    MATH  Google Scholar 

  230. Schachter, S.: Leon Festinger, May 8, 1919 – February 11, 1989. Natl. Acad. Sci. Bio. Mem., 99–110. http://www.motherjones.com/files/lfestinger.pdf (1994). Accessed 19 June 2012

  231. Scheffé, H.: Statistical inference in the non-parametric case. Ann. Math. Stat. 14, 305–332 (1943)

    MATH  Google Scholar 

  232. Scheffé, H.: Alternative models for the analysis of variance. Ann. Math. Stat. 27, 251–271 (1956)

    MATH  Google Scholar 

  233. Siegel, S., Tukey, J.W.: A nonparametric sum of ranks procedure for relative spread in unpaired samples. J. Am. Stat. Assoc. 55, 429–445 (1960) [Corrigendum: J. Am. Stat. Assoc. 56, 1005 (1961)]

    Google Scholar 

  234. Silvey, S.D.: The equivalence of asymptotic distributions under randomisation and normal theories. Proc. Glasgow Math. Assoc. 1, 139–147 (1953)

    MATH  MathSciNet  Google Scholar 

  235. Silvey, S.D.: The asymptotic distributions of statistics arising in certain nonparametric tests. Proc. Glasgow Math. Assoc. 2, 47–51 (1954)

    MATH  MathSciNet  Google Scholar 

  236. Soms, A.P.: An algorithm for the discrete Fisher’s permutation test. J. Am. Stat. Assoc. 72, 662–664 (1977)

    MATH  Google Scholar 

  237. Spearman, C.E.: The proof and measurement of association between two things. Am. J. Psychol. 15, 72–101 (1904)

    Google Scholar 

  238. Spearman, C.E.: ‘Footrule’ for measuring correlation. Br. J. Psychol. 2, 89–108 (1906)

    Google Scholar 

  239. Sun, Y.Q., Sherman, M.: Some permutation tests for survival data. Biometrics 52, 87–97 (1996)

    MATH  Google Scholar 

  240. Swed, F.S., Eisenhart, C.: Tables for testing randomness of grouping in a sequence of alternatives. Ann. Math. Stat. 14, 66–87 (1943)

    MATH  MathSciNet  Google Scholar 

  241. Teichroew, D.: A history of distribution sampling prior to the era of the computer and its relevance to simulation. J. Am. Stat. Assoc. 60, 27–49 (1965)

    MATH  MathSciNet  Google Scholar 

  242. Terpstra, T.J.: The asymptotic normality and consistency of Kendall’s test against trend, when ties are present in one ranking. Indagat. Math. 14, 327–333 (1952)

    MathSciNet  Google Scholar 

  243. Thompson, W.R.: Biological applications of normal range and associated significance tests in ignorance of original distribution forms. Ann. Math. Stat. 9, 122–128 (1938)

    Google Scholar 

  244. Todhunter, I.: A History of the Mathematical Theory of Probability: From the Time of Pascal to That of Laplace. Chelsea, Bronx (1965/1865) [A 1965 textually-unaltered reprint of the 1865 original]

    Google Scholar 

  245. Tukey, J.W., Olmstead, P.S.: The corner test for association. Ann. Math. Stat. 18, 299 (1947)

    MathSciNet  Google Scholar 

  246. van der Reyden, D.: A simple statistical significance test. Rhod. Agric. J. 49, 96–104 (1952)

    Google Scholar 

  247. Verdooren, L.R.: Extended tables of critical values for Wilcoxon’s test statistic. Biometrika 50, 177–186 (1963)

    MathSciNet  Google Scholar 

  248. Wald, A., Wolfowitz, J.: On a test whether two samples are from the same population. Ann. Math. Stat. 11, 147–162 (1940)

    MathSciNet  Google Scholar 

  249. Wald, A., Wolfowitz, J.: An exact test for randomness in the non-parametric case based on serial correlation. Ann. Math. Stat. 14, 378–388 (1943)

    MATH  MathSciNet  Google Scholar 

  250. Wald, A., Wolfowitz, J.: Statistical tests based on permutations of the observations. Ann. Math. Stat. 15, 358–372 (1944)

    MATH  MathSciNet  Google Scholar 

  251. W. Allen Wallis, obituary. Institute of Political Economy. http://www.lib.rochester.edu/index.cfm?page=4727. Accessed 20 Jan 2012

  252. Wallis, W.A.: The correlation ratio for ranked data. J. Am. Stat. Assoc. 34, 533–538 (1939)

    MATH  Google Scholar 

  253. Wasserstein, R.: George Box: A model statistician. Significance 7, 134–135 (2010)

    Google Scholar 

  254. Watnik, M.: Early computational statistics. J. Comput. Graph. Stat. 20, 811–817 (2011)

    MathSciNet  Google Scholar 

  255. Weik, M.H.: The ENIAC story. Ordnance 45, 571–575 (1961)

    Google Scholar 

  256. Weiss, L.: Wald, Abraham. In: Johnson, N.L., Kotz, S. (eds.) Leading Personalities in Statistical Sciences: From the Seventeenth Century to the Present, Wiley Series in Probability and Statistics, pp. 164–167. Wiley, New York (1997)

    Google Scholar 

  257. Welch, B.L.: On the z-test in randomized blocks and Latin squares. Biometrika 29, 21–52 (1937)

    MATH  Google Scholar 

  258. Welch, B.L.: On tests for homogeneity. Biometrika 30, 149–158 (1938)

    MATH  Google Scholar 

  259. Welch, B.L.: The significance of the difference between two means when the population variances are unequal. Biometrika 29, 350–362 (1938)

    MATH  Google Scholar 

  260. Welch, W.J.: Rerandomizing the median in matched-pairs designs. Biometrika 74, 609–614 (1987)

    MathSciNet  Google Scholar 

  261. Wells, M.B.: Computing at LASL in the 1940s and 1950s: MANIAC. Tech. rep., Los Alamos Scientific Laboratory, Los Alamos (May 1978)

    Google Scholar 

  262. White, C.: The use of ranks in a test of significance for comparing two treatments. Biometrics 8, 33–41 (1952)

    MATH  Google Scholar 

  263. Whitfield, J.W.: Rank correlation between two variables, one of which is ranked, the other dichotomous. Biometrika 34, 292–296 (1947)

    MATH  MathSciNet  Google Scholar 

  264. Whitfield, J.W.: Uses of the ranking method in psychology. J. R. Stat. Soc. B Met. 12, 163–170 (1950)

    Google Scholar 

  265. Whitworth, W.A.: Choice and Chance. G. E. Stechert, New York (1942)

    Google Scholar 

  266. Wilcoxon, F.: Individual comparisons by ranking methods. Biometrics Bull. 1, 80–83 (1945)

    Google Scholar 

  267. Wilcoxon, F.: Probability tables for individual comparisons by ranking methods. Biometrics 3, 119–122 (1947)

    MathSciNet  Google Scholar 

  268. Wilkes, M.V.: Memoirs of a Computer Pioneer. MIT Press, Cambridge (1985)

    Google Scholar 

  269. Wilks, S.S.: Order statistics. Bull. Am. Math. Soc. 54, 6–50 (1948)

    MATH  MathSciNet  Google Scholar 

  270. Willke, T.: In Memoriam – Ransom Whitney. The Ohio State University, Department of Statistics News 16, 8. http://www.stat.osu.edu/sites/default/files/news/statnews2008.pdf (2008). Accessed 17 Jan 2012

  271. Wolfowitz, J.: Additive partition functions and a class of statistical hypotheses. Ann. Math. Stat. 13, 247–279 (1942)

    MATH  MathSciNet  Google Scholar 

  272. Wolfowitz, J.: On the theory of runs with some applications to quality control. Ann. Math. Stat. 14, 280–288 (1943)

    MATH  MathSciNet  Google Scholar 

  273. Wolfowitz, J.: Non-parametric statistical inference. In: Neyman, J. (ed.) Proceedings of the [First] Berkeley Symposium on Mathematical Statistics and Probability, pp. 93–113. University of California Press, Berkeley (1949)

    Google Scholar 

  274. Yates, F.: Contingency tables involving small numbers and the χ 2 test. Suppl. J. R. Stat. Soc. 1, 217–235 (1934)

    MATH  Google Scholar 

  275. Zabell, S.: A conversation with William Kruskal. Stat. Sci. 9, 285–303 (1994)

    MATH  MathSciNet  Google Scholar 

  276. Zabell, S.: Meyer Dwass 1923–1996. B. Inst. Math. Stat. 27, 1–67 (1998)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Rights and permissions

Reprints and permissions

Copyright information

© 2014 Springer International Publishing Switzerland

About this chapter

Cite this chapter

Berry, K.J., Johnston, J.E., Mielke, P.W. (2014). 1940–1959. In: A Chronicle of Permutation Statistical Methods. Springer, Cham. https://doi.org/10.1007/978-3-319-02744-9_3

Download citation

Publish with us

Policies and ethics