Abstract
Do all components of a sign contribute equally to its recognition? In the present study, misperceptions in the sign-spotting task (based on the word-spotting task; Cutler & Norris, 1988) were analyzed to address this question. Three groups of deaf signers of British Sign Language (BSL) with different ages of acquisition (AoA) saw BSL signs combined with nonsense signs, along with combinations of two nonsense signs. They were asked to spot real signs and report what they had spotted. We will present an analysis of false alarms to the nonsense-sign combinations—that is, misperceptions of nonsense signs as real signs (cf. van Ooijen, 1996). Participants modified the movement and handshape parameters more than the location parameter. Within this pattern, however, there were differences as a function of AoA. These results show that the theoretical distinctions between formbased parameters in sign-language models have consequences for online processing. Vowels and consonants have different roles in speech recognition; similarly, it appears that movement, handshape, and location parameters contribute differentially to sign recognition.
Article PDF
Similar content being viewed by others
References
Battison, R. (1978). Lexical borrowing in American Sign Language. Silver Spring, MD: Linstok Press.
Bellugi, U., Klima, E. S., & Siple, P. (1975). Remembering in signs. Cognition, 3, 93–125.
Bonatti, L. L., Peña, M., Nespor, M., & Mehler, J. (2005). Linguistic constraints on statistical computations. Psychological Science, 16, 451–459.
Bonatti, L. L., Peña, M., Nespor, M., & Mehler, J. (2007). On consonants, vowels, chickens, and eggs. Psychological Science, 18, 924–925.
Brentari, D. (1990). Theoretical foundations of American Sign Language phonology. Unpublished doctoral dissertation, University of Chicago.
Brentari, D. (1998). A prosodic model of sign language phonology. Cambridge, MA: MIT Press.
Brentari, D. (2006). Effects of language modality on word segmentation: An experimental study of phonological factors in a sign language. In L. Goldstein, D. Whalen, & C. Best (Eds.), Papers in laboratory phonology VIII (pp. 155–164). The Hague: Mouton de Gruyter.
British Deaf Association (1992). Dictionary of British Sign Language. London: Faber and Faber.
Caramazza, A., Chialant, D., Capasso, R., & Miceli, G. (2000). Separable processing of consonants and vowels. Nature, 403, 428–430.
Carreiras, M., Gutiérrez-Sigut, E., Baquero, S., & Corina, D. (2008). Lexical processing in Spanish Sign Language. Journal of Memory & Language, 58, 100–122.
Channon, R. (2002). Beads on a string? Representations of repetition in spoken and signed languages. In R. Meier, K. Cormier, & D. Quinto-Pozos (Eds.), Modality and structure in signed and spoken language (pp. 65–87). Cambridge: Cambridge University Press.
Conlin, K., Mirus, G. R., Mauk, C., & Meier, R. P. (2000). The acquisition of first signs: Place, handshape, and movement. In C. Chamberlain, J. P. Morford, & R. I. Mayberry (Eds.), Language acquisition by eye (pp. 51–69). Mahwah, NJ: Erlbaum.
Corina, D. (1990). Reassessing the role of sonority in syllable structure: Evidence from a visual-gestural language. In M. Ziolkowski, M. Noske, & K. Deaton (Eds.), Proceedings from the 26th Annual Meeting of the Chicago Linguistics Society (Vol. 2, pp. 33–44). Chicago: The Chicago Linguistics Society.
Corina, D. (2000). Some observations regarding paraphasia in American Sign Language. In K. Emmorey & H. Lane (Eds.), The signs of language revisited: An anthology to honor Ursula Bellugi and Edward Klima (pp. 493–507). Mahwah, NJ: Erlbaum.
Corina, D., & Emmorey, K. (1993, November). Lexical priming in American Sign Language. Poster presented at the 34th Annual Meeting of the Psychonomic Society, Washington DC.
Corina, D., & Hildebrandt, U. (2002). Psycholinguistic investigations of phonological structure in American Sign Language. In R. P. Meier, K. Cormier, & D. Quinto-Pozos (Eds.), Modality and structure in signed and spoken languages (pp. 88–111). Cambridge: Cambridge University Press.
Corina, D., & Knapp, H. P. (2006). Lexical retrieval in American Sign Language production. In L. M. Goldstein, D. H. Whalen, & C. T. Best (Eds.), Papers in laboratory phonology 8: Varieties of phonological competence (pp. 213–240). Berlin: Mouton de Gruyter.
Coulter, G. R., & Anderson, S. R. (1992). Introduction. In G. Coulter (Ed.), Current issues in ASL phonology: Phonetics and phonology (Vol. 3, pp. 1–17). San Diego: Academic Press.
Crasborn, O. (2001). Phonetic implementation of phonological categories in Sign Language of the Netherlands. Unpublished doctoral dissertation, Netherlands Graduate School of Linguistics, Utrecht, The Netherlands.
Crasborn, O., & van der Kooij, E. (1997). Relative orientation in sign language phonology. In J. Coerts & H. de Hoop (Eds.), Linguistics in the Netherlands 1997 (pp. 37–48). Amsterdam: John Benjamins.
Crystal, T. H., & House, A. S. (1988a). Segmental durations in connected-speech signals: Current results. Journal of the Acoustical Society of America, 83, 1553–1573.
Crystal, T. H., & House, A. S. (1988b). Segmental durations in connected-speech signals: Syllabic stress. Journal of the Acoustical Society of America, 83, 1574–1585.
Cutler, A., & Norris, D. (1988). The role of strong syllables in segmentation for lexical access. Journal of Experimental Psychology: Human Perception & Performance, 14, 113–121.
Cutler, A., Sebastián-Gallés, N., Soler-Vilageliu, O., & van Ooijen, B. (2000). Constraints of vowels and consonants on lexical selection: Cross-linguistic comparisons. Memory & Cognition, 28, 746–755.
Cutler, A., van Ooijen, B., Norris, D., & Sánchez-Casas, R. (1996). Speeded detection of vowels: A cross-linguistic study. Perception & Psychophysics, 58, 807–822.
Dumay, N., Frauenfelder, U. H., & Content, A. (2002). The role of the syllable in lexical segmentation in French: Word-spotting data. Brain & Language, 81, 144–161.
Dye, M. W. G., & Shih, S. (2006). Phonological priming in British Sign Language. In L. M. Goldstein, D. H. Whalen, & C. T. Best (Eds.), Papers in laboratory phonology 8 (pp. 241–263). Berlin: Mouton de Gruyter.
Emmorey, K., & Corina, D. (1990). Lexical recognition in sign language: Effects of phonetic structure and morphology. Perceptual & Motor Skills, 71, 1227–1252.
Emmorey, K., McCullough, S., & Brentari, D. (2003). Categorical perception in American Sign Language. Language & Cognitive Processes, 18, 21–45.
Forster, K. L., & Forster, J. C. (2003). DMDX: A Windows display program with millisecond accuracy. Behavior Research Methods, Instruments, & Computers, 35, 116–124.
Fry, D. B. (1979). The physics of speech. Cambridge: Cambridge University Press.
Grosjean, F. (1981). Sign and word recognition: A first comparison. Sign Language Studies, 32, 195–220.
Hallé, P. A., Segui, J., Frauenfelder, U., & Meunier, C. (1998). Processing of illegal consonant clusters: A case of perceptual assimilation, Journal of Experimental Psychology: Human Perception & Performance, 24, 592–608.
Hildebrandt, U., & Corina, D. (2002). Phonological similarity in American Sign Language. Language & Cognitive Processes, 17, 593–612.
Hohenberger, A., Happ, D., & Leuninger, H. (2002). Modality-dependent aspects of sign language production: Evidence from slips of the hands and their repairs in German Sign Language. In R. P. Meier, K. Cormier, & D. Quinto-Pozos (Eds.), Modality and structure in signed and spoken languages (pp. 112–142). Cambridge: Cambridge University Press.
Jakobson, R. (1968). Child language, aphasia, and phonological universals. The Hague: Mouton. (Original work published 1941)
Karnopp, L. B. (2002). Phonology acquisition in Brazilian Sign Language. In G. Morgan & B. Woll (Eds.), Directions in sign language acquisition (pp. 29–53). Amsterdam: John Benjamins.
Klima, E. S., & Bellugi, U. (1979). The signs of language. Cambridge, MA: Harvard University Press.
Ladefoged, P. (1989). A note on “information conveyed by vowels.” Journal of the Acoustical Society of America, 85, 223–224.
Lane, H., Boyes-Braem, P., & Bellugi, U. (1976). Preliminaries to a distinctive feature analysis of American Sign Language. Cognitive Psychology, 8, 263–289.
Liddell, S., & Johnson, R. (1989). American Sign Language: The phonological base. Sign Language Studies, 64, 197–277.
Luce, P. A., & Pisoni, D. B. (1998). Recognizing spoken words: The neighborhood activation model. Ear & Hearing, 19, 1–36.
Mann, W., Marshall, C., Mason, K., & Morgan, G. (2008). The interplay between phonology and phonetics in sign language development: Data from nonsense sign repetition. Manuscript submitted for publication.
Mathur, G., & Best, C. (2007, March). Three experimental techniques for investigating sign language processing. Paper presented at the 20th annual CUNY Conference on Human Sentence Processing, La Jolla, CA.
Mayberry, R. I. (1994). The importance of childhood to language acquisition: Evidence from American Sign Language. In J. C. Goodman & H. C. Nusbaum (Eds.), The development of speech perception (pp. 57–90). Cambridge, MA: MIT Press.
Mayberry, R. I., & Fischer, S. D. (1989). Looking through phonological shape to lexical meaning: The bottleneck of non-native sign language processing. Memory & Cognition, 17, 740–754.
Mayberry, R. I., Lock, E., & Kazmi, H. (2002). Linguistic ability and early language exposure. Nature, 417, 38.
McClelland, J. L., & Elman, J. L. (1986). The TRACE model of speech perception. Cognitive Psychology, 18, 1–86.
McQueen, J. M. (1998). Segmentation of continuous speech using phonotactics. Journal of Memory & Language, 39, 21–46.
Meier, R. P. (2000). Shared motoric factors in the acquisition of sign and speech. In K. Emmorey & H. Lane (Eds.), The signs of language revisited: An anthology to honor Ursula Bellugi and Edward Klima (pp. 333–356). Mahwah, NJ: Erlbaum.
Moates, D. R., Bond, Z. S., & Stockmal, V. (2002). Phoneme frequency in spoken word reconstruction. In C. Gussenhoven & N. Warner (Eds.), Laboratory phonology 7 (pp. 141–170). Berlin: Mouton de Gruyter.
Moates, D. R., & Russell, S. (1999). Word reconstruction with printed materials. Paper presented at the conference on Basic Mechanisms of Language and Language Disorders, Leipzig.
Morgan, G. (2006). Children are just lingual: The development of phonology in British Sign Language (BSL). Lingua, 116, 1507–1523.
Newkirk, D., Klima, E., Pedersen, C., & Bellugi, U. (1980). Linguistic evidence from slips of the hand. In V. A. Fromkin (Ed.), Errors in linguistic performance: Slips of the tongue, ear, pen, and hand (pp. 165–197). New York: Academic Press.
Newport, E. L. (1990). Maturational constraints on language learning. Cognitive Science, 14, 11–28.
Norris, D., & McQueen, J. M. (2008). Shortlist B: A Bayesian model of continuous speech recognition. Psychological Review, 115, 357–395.
Orfanidou, E., Adam, R., Morgan, G., & McQueen, J. M. (2008). Segmentation in signed and spoken language: Different modalities, same segmentation procedure. Manuscript submitted for publication.
Perlmutter, D. (1992). Sonority and syllable structure in American Sign Language. Linguistic Inquiry, 23, 407–422.
Peterson, G. E., & Barney, H. L. (1952). Control methods used in a study of the vowels. Journal of the Acoustical Society of America, 24, 175–184.
Poizner, H. (1981). Visual and “phonetic” coding of movement: Evidence from American Sign Language. Science, 212, 691–693.
Poizner, H. (1983). Perception of movement in American Sign Lan guage: Effects of linguistic structure and linguistic experience. Perception & Psychophysics, 33, 215–231.
Poizner, H., & Lane, H. (1978). Discrimination of location in American Sign Language. In P. Siple (Ed.), Understanding language through sign language research (pp. 271–287). New York: Academic Press.
Raven, J. C. (1938). Progressive matrices: A perceptual test of intelligence, individual form. London: H. K. Lewis.
Repp, B. (1984). Closure duration and release burst amplitude cues to stop consonant manner and place of articulation. Language & Speech, 27, 245–254.
Sandler, W. (1989). Phonological representation of the sign: Linearity and nonlinearity in American Sign Language. Dordrecht: Foris.
Sandler, W., & Lillo-Martin, D. (2006). Sign language and linguistic universals. Cambridge: Cambridge University Press.
Siedlecki, T., & Bonvillian, J. D. (1993). Location, handshape and movement: Young children’s acquisition of the formational aspects of American Sign Language. Sign Language Studies, 78, 31–52.
Smith, N. V. (1973). The acquisition of phonology: A case study. Cambridge: Cambridge University Press.
Smith, N. V. (2004). Universal tendencies in the child’s acquisition of phonology. In B. Lust & C. Foley (Ed.), First language aquisition: The essential readings (pp. 294–306). Oxford: Blackwell.
Stokoe, W. C., Jr., Casterline, D. C., & Croneberg, C. G. (1965). A dictionary of American Sign Language on linguistic principles. Washington, DC: Gallaudet College Press.
Strange, W., Jenkins, J. J., & Johnson, T. L. (1983). Dynamic specification of coarticulated vowels. Journal of the Acoustical Society of America, 74, 695–705.
Sutton-Spence, R., & Woll, B. (1999). The linguistics of BSL: An introduction. Cambridge: Cambridge University Press.
Thompson, R., Emmorey, K., & Gollan, C. G. (2005). Tip of the fingers: Experiences by deaf signers. Psychological Science, 16, 856–860.
Uyechi, L. (1996). The geometry of visual phonology. Stanford, CA: CSLI Publications.
van der Hulst, H. (1993). Units in the analysis of signs. Phonology, 10, 209–242.
van Ooijen, B. (1994). The processing of vowels and consonants. Unpublished doctoral dissertation, University of Leiden, Leiden, The Netherlands.
van Ooijen, B. (1996). Vowel mutability and lexical selection in English: Evidence from a word reconstruction task. Memory & Cognition, 24, 573–583.
van Ooijen, B., Cutler, A., & Norris, D. (1991). Detection times for vowels versus consonants. In Eurospeech 91: Proceedings of the 2nd European Conference on Speech Communication and Technology (Vol. 3, pp. 1451–1454). Genova, Italy: European Speech Communication Association.
van Ooijen, B., Cutler, A., & Norris, D. (1992). Detection of vowels and consonants with minimal acoustic variation. Speech Communication, 11, 101–108.
Wilson, M. (2001). The case for sensorimotor coding in working memory. Psychonomic Bulletin & Review, 8, 44–57.
Wilson, M., & Emmorey, K. (1997). A visuospatial “phonological loop” in working memory: Evidence from American Sign Language. Memory & Cognition, 25, 313–320.
Author information
Authors and Affiliations
Corresponding author
Additional information
This research was funded by ESRC Grant 000-23-1450 to G.M. and J.M.M. We thank all our deaf participants, as well as three anonymous reviewers for constructive comments.
Rights and permissions
About this article
Cite this article
Orfanidou, E., Adam, R., McQueen, J.M. et al. Making sense of nonsense in British Sign Language (BSL): The contribution of different phonological parameters to sign recognition. Memory & Cognition 37, 302–315 (2009). https://doi.org/10.3758/MC.37.3.302
Received:
Accepted:
Issue Date:
DOI: https://doi.org/10.3758/MC.37.3.302