Testing Across Cultures
Abstract
There has been a longstanding, scientific interest in the comparison of people belonging to different cultural groups. In the course of the history of Western science, practitioners of different disciplines have been involved. During the Renaissance the equality of races was an issue for theologians. In 1550 a number of them convened at the court of Charles V in Spain to solve the question of how the American Indians could be colonized “in a Christian fashion.” According to the chronicles, the debate focused on the question of whether the Indians formed an inferior race in comparison with their Spanish colonizers. The issue was never settled, even though “some of the most learned and powerful men of the age” participated (Boorstin, 1985, p. 633). During the nineteenth century, racial differences had become the domain of social philosophers, who, in turn, “passed the buck” (the use of the expression in this context coming from Mann, 1940) to psychologists.
Keywords
Item Response Theory Context Variable Intergroup Difference Skin Conductance Response Multiple Correlation CoefficientPreview
Unable to display preview. Download preview PDF.
References
- Allen, M. J., & Yen, W. M. (1979). Introduction to measurement theory. Monterey, CA: Brooks/Cole.Google Scholar
- Andersen, E. B. (1973). A goodness of fit test for the Rasch model. Psychometrika 38:123–140.CrossRefGoogle Scholar
- Angoff, W. H., & Ford, S. F. (1973). Item-race interaction on a test for scholastic aptitude. Journal of Educational Measurement 10:95–105.CrossRefGoogle Scholar
- Benson, J. (1987). Detecting item bias in affective scales. Educational and Psychological Measurement 47:55–67.CrossRefGoogle Scholar
- Berk, R. A. (ed.) (1982). Handbook of methods for detecting item bias. Baltimore: Johns Hopkins University Press.Google Scholar
- Biesheuvel, S. (1949). Psychological tests and their application to non-European peoples. In G. B. Jeffery (ed.), The yearbook of education. London: Evans, pp. 87–126.Google Scholar
- Bijnen, E. J., Van der Net, Th. Z. J., & Poortinga, Y. H. (1986). On cross-cultural comparative studies with the Eysenck Personality Questionnaire. Journal of Cross-Cultural Psychology 17:3–16.Google Scholar
- Boorstin, D.J. (1985). The discoverers. New York: Random House.Google Scholar
- Browne, M.W. (1978). The likelihood ratio test for the equality of correlation matrices. British Journal of Mathematical and Statistical Psychology 31:209–217.CrossRefGoogle Scholar
- Campbell, D. T. (1961). The mutual methodological relevance of anthropology and psychology. In F. L. K. Hsu (ed.), Psychological anthropology: Approaches to culture and personality. Homewood, IL: Dorsey Press, pp. 333–352.Google Scholar
- Cleary, T. A., & Hilton, T. L. (1968). An investigation of item bias. Educational and Psychological Measurement 28:61–75.CrossRefGoogle Scholar
- Cohen, J., & Cohen, P. (1983). Applied multiple regression/correlation analysis for the behavioral sciences, 2nd ed. Hillsdale, NJ: Erlbaum.Google Scholar
- Cole, N.S., & Moss, P. A. (1989). Bias in test use. In R. L. Linn (ed.), Educational measurement, 3rd ed. New York: Macmillan, pp. 201–219.Google Scholar
- Cronbach, L.J., Gleser, G.C., Nanda, H., & Rajaratnam, N. (1972). The dependability of behavioral instruments New York: Wiley.Google Scholar
- David, K.H. (1974). Cross-cultural uses of the Porteus Maze. Journal of Social Psychology 92:11–18.CrossRefGoogle Scholar
- Deregowski, J. B., & Serpell, R. (1971). Performance on a sorting task: A cross-cultural experiment. International Journal of Psychology 6:271–281.Google Scholar
- Dixon, W.J. (1981). BMDP statistical software. Berkeley: University of California Press.Google Scholar
- Eysenck, H.J. (1984). The effect of race on human abilities and mental test scores. In C. R. Reynolds & R. T. Brown (eds.), Perspectives on bias in mental testing. New York: Plenum, pp. 249–262.CrossRefGoogle Scholar
- Eysenck, H. J., & Eysenck, S. B. G. (1983). Recent advances in the cross-cultural study of personality. In J, N. Butcher & C. D, Spielberger (eds.), Advances in personality assessment, Vol. 2. Hillsdale, NJ: Erlbaum, pp. 41–70.Google Scholar
- Golding, S.L. (1975). Flies in the ointment: Methodological problems in the analysis of the percentage of variance due to persons and situations. Psychological Bulletin 82:278–288.CrossRefGoogle Scholar
- Greenfield, P. M. (1966). On culture and conservation. In J. S. Bruner, R. R. Olver, & P. M. Greenfield (eds.), Studies in cognitive growth. New York: Wiley, pp. 225–256.Google Scholar
- Greenfield, P. M. (1979). Response to Wolof “magical thinking.” Journal of Cross-Cultural Psychology 10:251–256.CrossRefGoogle Scholar
- Hays, W.L. (1973). Statistics for the social sciences. London: Holt, Rinehart and Winston.Google Scholar
- Holland, P. W., & Rubin, D. B. (1983). On Lord’s paradox. In H. Wainer & S. Messick (eds.), Principals of modern psychological measurement. Hillsdale, NJ:Google Scholar
- Horn, J.L. (1967). On subjectivity in factor analysis. Educational and Psychological Measurement 27:811–820.Google Scholar
- Horn, J. L., & Knapp, J. R. (1973). On the subjective character of the empirical base of Guilford’s structure-of-intellect model. Psychological Bulletin 80:33–43. Erlbaum, pp. 3–26.CrossRefGoogle Scholar
- Humphreys, L. G., Ilgen, D., McGrath, D., & Montanelli, R. (1969). Capitalization on chance in rotation of factors. Educational and Psychological Measurement 29:259–271.CrossRefGoogle Scholar
- Hutchins, E. (1980). Culture and inference. Cambridge, MA: Harvard University Press.Google Scholar
- Irvine, J. T. (1978). Wolof “magical thinking”: Culture and conservation revisited. Journal of Cross-Cultural Psychology 9:300–310.CrossRefGoogle Scholar
- Irvine, S. H. (1979). The place of factor-analysis in cross-cultural methodology and its contribution to cognitive theory. In L. Eckensberger, W. Lonner, & Y. H. Poortinga (eds.), Cross-cultural contributions to psychology. Lisse: Swets & Zeitlinger, pp. 300–343.Google Scholar
- Irvine, S.H., & Carroll, W. K. (1980). Testing and assessment across cultures: Issues in methodology and theory. In H. C. Triandis & J.W. Berry (eds.), Handbook of cross-cultural psychology, Vol. 2. Boston: Allyn & Bacon, pp. 181–244.Google Scholar
- Jensen, A. R. (1980). Bias in mental testing. New York: Free Press.Google Scholar
- Kaiser, H.F., Hunka, S., & Bianchini, J.C. (1971). Relating factors between studies based upon different individuals. Multivariate Behavioral Research 5:409–422.CrossRefGoogle Scholar
- Kraemer, H. C. (1981). Extension of Feldt’s approach to testing homogeneity of coefficients of reliability. Psychometrika 46:41–45.CrossRefGoogle Scholar
- Kristof, W. (1963). The statistical theory of stepped up reliability coefficients when a test has been divided into several equivalent parts. Psychometrika 28:221–238.CrossRefGoogle Scholar
- Lancy, D. E. (1983). Cross-cultural studies in cognition and mathematics. London: Academic Press.Google Scholar
- Lord, F. M. (1980). Applications of item response theory to practical testing problems. Hillsdale, NJ: Erlbaum.Google Scholar
- Malpass, R.S. (1977). Theory and method in cross-cultural psychology. American Psychologist 32:1069–1079.CrossRefGoogle Scholar
- Malpass, R. S., & Poortinga, Y. H. (1986). Strategies for design and analysis. In W. J. Lonner & J. W. Berry (eds.), Field methods in cross-cultural psychology. Newbury Park, CA: Sage, pp. 47–83.Google Scholar
- Mann, C. W. (1940). Mental measurement in primitive communities. Psychological Bulletin 37:366–395.CrossRefGoogle Scholar
- Marascuilo, L. A., & Slaughter, R. E. (1981). Statistical procedures for identifying possible sources of item bias based on χ2-statistics. Journal of Educational Measurement 18:229–248.CrossRefGoogle Scholar
- McNemar, Q. (1975). On so-called test bias. American Psychologist 30:848–851.CrossRefGoogle Scholar
- Mellenbergh, G.J. (1982). Contingency table models for assessing item bias. Journal of Educational Statistics 7:105–118.CrossRefGoogle Scholar
- Mellenbergh, G.J. (1989). Item bias and item response theory. International Journal of Educational Research 13:127–143.CrossRefGoogle Scholar
- Mercer, J. R. (1984). What is a racially and culturally nondiscriminatory test? A sociological and pluralistic perspective. In C. R. Reynolds & R.T. Brown (eds.), Perspectives on bias in mental testing. New York: Plenum Press, pp. 293–356.CrossRefGoogle Scholar
- Narroll, R., Michick, G. L., & Narroll, F. (1980). Holocultural research methods. In H. C. Triandis & J. W. Berry (eds.), Handbook of cross-cultural psychology, Vol. 2. Boston: Allyn & Bacon, pp. 479–521.Google Scholar
- Neimark, E. D. (1975). Intellectual development during adolescence. In F. D. Horowitz (ed.), Review of child development research, Vol. 4. Chicago: University of Chicago Press, pp. 541–594.Google Scholar
- Ombrédane, A., Robaye, F., & Plumail, H. (1956). Résultats d’une application répétée du matrix-couleur à une population de Noirs Congolais. Bulletin du Centre d’Etudes de Recherches Psychotechniques 5:129–147.Google Scholar
- Ord, I.G. (1970). Mental tests for pre-literates. London: Ginn.Google Scholar
- Pedhazur, E. (1982). Multiple regression in behavioral research, 2nd ed. New York: Holt, Rinehart & Winston.Google Scholar
- Pick, A. D. (1981). Cognition: Psychological perspectives. In H. C. Triandis & W. Lonner (eds.), Handbook of cross-cultural psychology, Vol. 3. Boston: Allyn & Bacon, pp. 117–154.Google Scholar
- Poortinga, Y. H. (1971). Cross-cultural comparison of maximum performance tests. Psychologia Africana Monograph 6.Google Scholar
- Poortinga, Y. H., & Foden, B.I.M. (1975). A comparative study of curiosity in black and white South African students. Psychologia Africana Monograph 8.Google Scholar
- Poortinga, Y. H., & Malpass, R. S. (1986). Making inferences from cross-cultural data. In W.J. Lonner & J.W. Berry (eds.), Field methods in cross-cultural psychology. Newbury Park, CA: Sage, pp. 17–46.Google Scholar
- Poortinga, Y. H., & Van de Vijver, F. J. R. (1987). Explaining cross-cultural differences: Bias analysis and beyond. Journal of Cross-Cultural Psychology 18:259–282.CrossRefGoogle Scholar
- Poortinga, Y. H., & Van der Flier, H. (1988). The meaning of item bias in ability tests. In S. H. Irvine & J. W. Berry (eds.), Human abilities in cultural context. Cambridge: Cambridge University Press, pp. 166–183.Google Scholar
- Porteus, S.D. (1917). Mental tests with delinquents and Australian aboriginal children. Psychological Review 24:32–42.CrossRefGoogle Scholar
- Porteus, S. D. (1965). Porteus Maze Test: Fifty years of application. Palo Alto, CA: Pacific Books.Google Scholar
- Price-Williams, D. R. (1962). Abstract and concrete modes of classification in a primitive society. British Journal of Educational Psychology 32:50–61.CrossRefGoogle Scholar
- Reuning, H., & Wortley, W. (1973). Psychological studies of the Bushmen. Psychologia Africana, Monograph Supplement, 7.Google Scholar
- Rock, D.A., Werts, C, & Grandy, D. (1982). Construct validity of the GTE Aptitude Test across populations (ETS Research Report 81-57). Princeton, NJ: Educational Testing Service.Google Scholar
- Rudner, L.M., Getson, P. R., & Knight, D.L. (1980) Biased item detection techniques. Journal of Educational Statistics 5:213–233.CrossRefGoogle Scholar
- Schwarz, P. A. (1961). Aptitude tests for use in developing nations. Pittsburgh: American Institute for Research.Google Scholar
- Scribner, S., & Cole, M. (1981). The psychology of literacy, Cambridge, MA: Harvard University Press.Google Scholar
- Segall, M. H. (1986). Culture and behavior: Psychology in global perspective. Annual Review of Psychology 37:523–564.CrossRefGoogle Scholar
- Serpell, R. (1979). How specific are perceptual skills? British Journal of Psychology 70:365–380.CrossRefGoogle Scholar
- Shepard, L., Camilli, G., & Averill, M. (1981). Comparisons of procedures for detecting test-item bias with both internal and external ability criteria. Journal of Educational Statistics 6:317–375.CrossRefGoogle Scholar
- Shepard, L., Camilli, G., & Williams, D.M. (1984). Accounting for statistical artifacts in item bias research. Journal of Educational Statistics 9:93–128.CrossRefGoogle Scholar
- Strelau, J. A. (1972). A diagnosis of temperament by nonexperimental techniques. Polish Psychological Bulletin 3:97–103.Google Scholar
- Super, C. M. (1981). Behavior development in infancy. In R. H. Munroe, R. L. Munroe, & B.B. Whiting (eds.), Handbook of cross-cultural human development New York: Garland STPM Press, pp. 181–270.Google Scholar
- Ten Berge, J. M.F. (1977). Optimizing factorial invariance. Groningen: VRB Drukkerijen.Google Scholar
- Van de Vijver, F. J. R. (1984, December). Group differences on structured tests. Paper presented at the Advanced Study Institute, Athens.Google Scholar
- Van de Vijver, F. J. R. (1988). Systematizing the item content in test design. In R. Langeheine & J. Rost (eds.), Latent trait and latent class models. New York: Plenum, pp. 291–307.CrossRefGoogle Scholar
- Van de Vijver, F.J. R., & Poortinga, Y. H. (1982). Cross-cultural generalizability and universality. Journal of Cross-Cultural Psychology 13:387–408.CrossRefGoogle Scholar
- Van de Vijver, F. J. R. (1985). A comment on McCauley and Colberg’s conception of cross-cultural transportability of tests. Journal of Educational Measurement 22:157–161.CrossRefGoogle Scholar
- Van de Vijver, F. J. R., Daal., M., & Van Zonneveld, R. (1986). The trainability of formal thinking: A cross-cultural comparison. International Journal of Psychology 21:589–615.CrossRefGoogle Scholar
- Van den Wollenberg, A. L. (1982). Two new test statistics for the Rasch model. Psychometrika 47:123–140.CrossRefGoogle Scholar
- Van der Flier, H. (1972). Evaluating environmental influences on test scores. In L.J. Cronbach & P. J. D. Drenth (eds.), Mental tests and cultural adaptation. The Hague: Mouton, pp. 447–452.Google Scholar
- Van der Flier, H. (1980). De vergelijkbaarheid van individuele testprestaties. Dissertation. Lisse: Swets & Zeitlinger.Google Scholar
- Van der Flier, H., Mellenbergh, G. J., Ader H. J., & Wijn, M. (1984). An iterative item bias detection method. Journal of Educational Measurement 21:131–145.CrossRefGoogle Scholar
- Vernon, P. E. (1979). Intelligence: Heredity and environment. San Francisco: Freeman.Google Scholar
- Whiting, B. (1976). The problem of the packaged variable. In K. F. Riegel & J. A. Meacham (eds.), The developing individual in a changing world. The Hague: Mouton, pp. 303–309.Google Scholar