Skip to main content
Top
Gepubliceerd in: Psychological Research 5-6/2005

01-06-2005 | Original Article

Statistical approaches to language acquisition and the self-organizing consciousness: a reversal of perspective

Auteur: Pierre Perruchet

Gepubliceerd in: Psychological Research | Uitgave 5-6/2005

Log in om toegang te krijgen
share
DELEN

Deel dit onderdeel of sectie (kopieer de link)

  • Optie A:
    Klik op de rechtermuisknop op de link en selecteer de optie “linkadres kopiëren”
  • Optie B:
    Deel de link per e-mail

Abstract

Recent years have seen the upsurge of a new approach to language that moves away from the rule-based conventional framework. In this approach, mostly supported by the success of connectionist models, children learn language by exploiting the distributional properties of the input. It is argued in this paper that, in the same way as conforming to rules does not imply the existence of mental rules, conforming to statistical regularities does not imply that statistical computations are performed mentally. Sensitivity to statistical regularities can alternatively be conceived of as a by-product of the recurrent interplay between the properties of the current conscious content and the properties of the linguistic and extralinguistic environment. The validity of including the content of conscious experiences in an otherwise standard dynamical approach rooted in the notion of self-organization is discussed.
Voetnoten
1
The shift from Universal to idiosyncratic grammar has obvious consequences with regard to an innatist position. A specific rule needs to be learned. However, there is no clear explanation of how a rule can be learned. For instance, when referring to a monograph of Marcus et al. on over-generalization, Bybee (1995, pp.449–450) noted that the authors “do not address the question of exactly how the rule is extracted and deposited in a separable module. Thus, despite the fact that the relevant section in their paper is named “How might a regular rule be learned?”, the question of how the restructuring from lexical schema to symbolic rule takes place is actually not addressed!”
 
2
This is reminiscent of the traditional Chomskyan distinction between (inferred) competence and (observed) performance, and its associated requirement for researchers to account for the extraneous limitations that prevent unlimited competence from fully translating into performance.
 
3
Consider the following story for a short illustration of the ambiguities inherent in the notion of “computational irrelevance.” A cognitive scientist builds a psychological model that implies at some location the computation of 2 × 2 = 4. The scientist notes (rightly) that nothing has changed in his program according to whether or not this computation is thought to be accompanied by a conscious experience in the actual subjects he intends to simulate. From this observation, he coins the notion of “computational irrelevance of consciousness.” In some later location of his program, he requires that his model now computes the cubic power of 6371, and he is first baffled by the fact that it is highly implausible that actual subjects are able to perform this computation mentally. Fortunately, he realizes that this limitation holds only if it is assumed that this computation is performed consciously. Because the issue of consciousness has been declared computationally irrelevant, this slight glitch is automatically removed, and even turns out to be an advantage: His program succeeds at simulating behavior without ever involving the need for consciousness! This story allows a contrast of two ways of conceiving constraints and parsimony: The conventional one, in which actual subjects are assumed to be able to compute the cubic power of 6371, but which calls for no conscious counterpart for this computation, and the one to which I subscribe, in which actual subjects are assumed to be able to compute only what they do consciously, which is hardly more than 2 × 2.
 
4
Although they do not directly address the word segmentation issue, Boucher and Dienes (2003) also explore the possibility that the sensitivity to statistical regularities is not the result of statistical computations on individual elements, but rather the by-product of local representations of chunks of individual elements. In their view, to borrow the title of their paper, there are “two ways of learning associations,” one in which chunking is an emergent property of statistical analyses, and the other in which chunking is a primitive process, the result of which amounts to simulating statistical computations. However, they do not equate their chunks with the focal content of phenomenal consciousness, as I do.
 
5
This presentation is obviously an over-simplification. I do not intend to mean that learning a language amounts to successively isolating the words from the speech flow, to map the word to its meaning, and so on. Those processes are considered here as independent steps for the sake of clarity, but it would be in keeping with a dynamic approach to consider them as closely interconnected processes.
 
Literatuur
go back to reference Aslin, R. N., Woodward, J. Z., LaMendola, N. P., & Bever, T. G. (1996). Models of word segmentation in fluent maternal speech to infants. In J. L. Morgan, & K. Demuth (Eds.), Signal to syntax (pp. 117–134). Mahvah, NJ: Erlbaum. Aslin, R. N., Woodward, J. Z., LaMendola, N. P., & Bever, T. G. (1996). Models of word segmentation in fluent maternal speech to infants. In J. L. Morgan, & K. Demuth (Eds.), Signal to syntax (pp. 117–134). Mahvah, NJ: Erlbaum.
go back to reference Barton, S. (1994). Chaos, self-organization, and psychology. American Psychologist, 49, 5–14. Barton, S. (1994). Chaos, self-organization, and psychology. American Psychologist, 49, 5–14.
go back to reference Boucher, L., & Dienes, Z. (2003). Two ways of learning associations. Cognitive Science, 27, 807–842. Boucher, L., & Dienes, Z. (2003). Two ways of learning associations. Cognitive Science, 27, 807–842.
go back to reference Brent, M. R. (1996). Advances in the computational study of language acquisition. Cognition, 61, 1–38. Brent, M. R. (1996). Advances in the computational study of language acquisition. Cognition, 61, 1–38.
go back to reference Brent, M. R., & Cartwright, T. A. (1996). Distributional regularity and phonotactic constraints are useful for segmentation. Cognition, 61, 93–125. Brent, M. R., & Cartwright, T. A. (1996). Distributional regularity and phonotactic constraints are useful for segmentation. Cognition, 61, 93–125.
go back to reference Brent, M. R., & Siskind, J. M. (2001). The role of exposure to isolated words in early vocabulary development. Cognition, 81, B33–B44. Brent, M. R., & Siskind, J. M. (2001). The role of exposure to isolated words in early vocabulary development. Cognition, 81, B33–B44.
go back to reference Bybee, J. (1995). Regular morphology and the lexicon. Language and Cognitive Processes, 10, 425–455. Bybee, J. (1995). Regular morphology and the lexicon. Language and Cognitive Processes, 10, 425–455.
go back to reference Chomsky, N. (1957). Syntactic structures. Mouton, The Hague. Chomsky, N. (1957). Syntactic structures. Mouton, The Hague.
go back to reference Christiansen, M. H., & Chater, N. (1999). Toward a connectionist model of recursion in human linguistic performance. Cognitive Science, 23, 157–205. Christiansen, M. H., & Chater, N. (1999). Toward a connectionist model of recursion in human linguistic performance. Cognitive Science, 23, 157–205.
go back to reference Christiansen, M. H., Allen, J., & Seidenberg, M. S. (1998). Learning to segment speech using multiple cues: A connectionist model. Language and Cognitive Processes, 13, 221–268. Christiansen, M. H., Allen, J., & Seidenberg, M. S. (1998). Learning to segment speech using multiple cues: A connectionist model. Language and Cognitive Processes, 13, 221–268.
go back to reference Cleeremans, A. (1993). Mechanisms of implicit learning: A connectionist model of sequence processing (pp. 227). Cambridge, MA: MIT Press/Bradford. Cleeremans, A. (1993). Mechanisms of implicit learning: A connectionist model of sequence processing (pp. 227). Cambridge, MA: MIT Press/Bradford.
go back to reference Cowan, N. (1991). Recurrent speech patterns as cues to the segmentation of multisyllabic sequences. Acta Psychologica, 77, 121–135. Cowan, N. (1991). Recurrent speech patterns as cues to the segmentation of multisyllabic sequences. Acta Psychologica, 77, 121–135.
go back to reference Creel, S. C., Newport, E. L., & Aslin, R. N. (2004). Distant melodies: Statistical learning of nonadjacent dependencies in tone sequences.Journal of Experimental Psychology: Learning, Memory, and Cognition, 30, 1119–1130. Creel, S. C., Newport, E. L., & Aslin, R. N. (2004). Distant melodies: Statistical learning of nonadjacent dependencies in tone sequences.Journal of Experimental Psychology: Learning, Memory, and Cognition, 30, 1119–1130.
go back to reference Dulany, D. E. (1991). Conscious representation and thought systems. In R. S. Wyer, & T. K. Srull (Eds.), Advances in social cognition, Vol. 4 (pp. 97–120). Hillsdale, NJ: Erlbaum Dulany, D. E. (1991). Conscious representation and thought systems. In R. S. Wyer, & T. K. Srull (Eds.), Advances in social cognition, Vol. 4 (pp. 97–120). Hillsdale, NJ: Erlbaum
go back to reference Dulany, D. E. (2002). Mentalistic metatheory and strategies. Behavioral and Brain Sciences, 25, 337–338. Dulany, D. E. (2002). Mentalistic metatheory and strategies. Behavioral and Brain Sciences, 25, 337–338.
go back to reference Eliasmith, C. (1996). The third contender: A critical examination of the dynamicist theory of cognition. Journal of Philosophical Psychology, 9, 441–463. Eliasmith, C. (1996). The third contender: A critical examination of the dynamicist theory of cognition. Journal of Philosophical Psychology, 9, 441–463.
go back to reference Ellefson, M. R. (2002). The difficulty of learning complex structure: A comparative study of knowledge acquisition. Unpublished doctoral dissertation, Southern Illinois University, Carbondale. Ellefson, M. R. (2002). The difficulty of learning complex structure: A comparative study of knowledge acquisition. Unpublished doctoral dissertation, Southern Illinois University, Carbondale.
go back to reference Elman, J. L. (1990). Finding structure in time. Cognitive Science, 14, 179–211. Elman, J. L. (1990). Finding structure in time. Cognitive Science, 14, 179–211.
go back to reference Fitch, W. T., & Hauser, M. D. (2004). Computational constraints on syntactic processing in a nonhuman primate. Science, 303, 377–380. Fitch, W. T., & Hauser, M. D. (2004). Computational constraints on syntactic processing in a nonhuman primate. Science, 303, 377–380.
go back to reference Gibson, E., & Thomas, J. (1999). Memory limitations and structural forgetting: The perception of complex ungrammatical sentences as grammatical. Language and Cognitive Processes, 14, 225–248. Gibson, E., & Thomas, J. (1999). Memory limitations and structural forgetting: The perception of complex ungrammatical sentences as grammatical. Language and Cognitive Processes, 14, 225–248.
go back to reference Gomez, R. (2002). Variability and detection of invariant structure. Psychological Science, 13, 431–436. Gomez, R. (2002). Variability and detection of invariant structure. Psychological Science, 13, 431–436.
go back to reference Hunt, R. H., & Aslin, R. N. (2001). Statistical learning in a serial reaction time task: Access to separable statistical cues by individual learners. Journal of Experimental Psychology: General, 130, 658–680. Hunt, R. H., & Aslin, R. N. (2001). Statistical learning in a serial reaction time task: Access to separable statistical cues by individual learners. Journal of Experimental Psychology: General, 130, 658–680.
go back to reference Jusczyk, P. W., Houston DM, Derek M., & Newsome, M. (1999). The beginnings of word segmentation in English-learning infants. Cognitive Psychology, 39, 159–207. Jusczyk, P. W., Houston DM, Derek M., & Newsome, M. (1999). The beginnings of word segmentation in English-learning infants. Cognitive Psychology, 39, 159–207.
go back to reference Kagan, J. (1971). Change and continuity in infancy. New York: Wiley. Kagan, J. (1971). Change and continuity in infancy. New York: Wiley.
go back to reference Karmiloff-Smith, A. (1992). Beyond modularity: A developmental perspective on cognitive science. Cambridge, MA: Bradford/MIT Press. Karmiloff-Smith, A. (1992). Beyond modularity: A developmental perspective on cognitive science. Cambridge, MA: Bradford/MIT Press.
go back to reference Kemp, N., & Bryant, P. (2003) Do beez buzz? Rule-based and frequency-based knowledge in learning to spell plural -s. Child Development, 74, 63–74. Kemp, N., & Bryant, P. (2003) Do beez buzz? Rule-based and frequency-based knowledge in learning to spell plural -s. Child Development, 74, 63–74.
go back to reference Lewicki, P., Hill, T., & Bizot, E. (1988). Acquisition of procedural knowledge about a pattern of stimuli that cannot be articulated. Cognitive Psychology, 20, 24–37. Lewicki, P., Hill, T., & Bizot, E. (1988). Acquisition of procedural knowledge about a pattern of stimuli that cannot be articulated. Cognitive Psychology, 20, 24–37.
go back to reference McDonald, S., & Ramscar, M. (2001). Testing the distributional hypothesis: The influence of context on judgements of semantic similarity. Paper presented at the 23rd Annual Conference of the Cognitive Science Society. McDonald, S., & Ramscar, M. (2001). Testing the distributional hypothesis: The influence of context on judgements of semantic similarity. Paper presented at the 23rd Annual Conference of the Cognitive Science Society.
go back to reference Miller, G., & Chomsky, N. (1963). Finitary models of language users. In R. Luce, R. Bush, & E. Galenter (Eds.), Handbook of mathematical psychology, Vol. 2 (pp. 419–493). New York: Wiley. Miller, G., & Chomsky, N. (1963). Finitary models of language users. In R. Luce, R. Bush, & E. Galenter (Eds.), Handbook of mathematical psychology, Vol. 2 (pp. 419–493). New York: Wiley.
go back to reference O’Brien, G., & Opie, J. (1999). A connectionist theory of phenomenal experience. Behavioral and Brain Sciences, 22, 127–196. O’Brien, G., & Opie, J. (1999). A connectionist theory of phenomenal experience. Behavioral and Brain Sciences, 22, 127–196.
go back to reference Pacton, S., Perruchet, P., Fayol, M., & Cleeremans, A. (2001). Implicit learning out of the lab: The case of orthographic regularities. Journal of Experimental Psychology: General, 130, 401–426. Pacton, S., Perruchet, P., Fayol, M., & Cleeremans, A. (2001). Implicit learning out of the lab: The case of orthographic regularities. Journal of Experimental Psychology: General, 130, 401–426.
go back to reference Peereman, R., Dubois-Dunilac, N., Perruchet, P., & Content, A. (2004). Distributional properties of language and sub-syllabic processing units. In P. Bonin (Ed.), Mental lexicon. New York: NovaScience. Peereman, R., Dubois-Dunilac, N., Perruchet, P., & Content, A. (2004). Distributional properties of language and sub-syllabic processing units. In P. Bonin (Ed.), Mental lexicon. New York: NovaScience.
go back to reference Peña, M., Bonatti, L .L., Nespor, M., & Mehler, J. (2002). Signal-driven computations in speech processing. Science, 298, 604–607. Peña, M., Bonatti, L .L., Nespor, M., & Mehler, J. (2002). Signal-driven computations in speech processing. Science, 298, 604–607.
go back to reference Perruchet, P., & Peereman, R. (2004). The exploitation of distributional information in syllable processing. Journal of Neurolinguistics, 17, 97–119. Perruchet, P., & Peereman, R. (2004). The exploitation of distributional information in syllable processing. Journal of Neurolinguistics, 17, 97–119.
go back to reference Perruchet, P., & Rey, A. (in press). Does the mastery of center-embedded linguistic structures distinguish humans from non human primates. Psychonomic Bulletin and Review. Perruchet, P., & Rey, A. (in press). Does the mastery of center-embedded linguistic structures distinguish humans from non human primates. Psychonomic Bulletin and Review.
go back to reference Perruchet, P., & Vinter, A. (1998). PARSER: A model for word segmentation. Journal of Memory and Language, 39, 246–263. Perruchet, P., & Vinter, A. (1998). PARSER: A model for word segmentation. Journal of Memory and Language, 39, 246–263.
go back to reference Perruchet, P., & Vinter, A. (2002). The self-organizing consciousness. Behavioral and Brain Sciences, 25, 297–388. Perruchet, P., & Vinter, A. (2002). The self-organizing consciousness. Behavioral and Brain Sciences, 25, 297–388.
go back to reference Perruchet, P., Vinter, A. (2003). Linking learning and consciousness: The self-organizing consciousness (SOC) model. In A. Cleeremans (Ed.), The unity of consciousness: Binding, integration, and dissociation. Oxford: Oxford University Press. Perruchet, P., Vinter, A. (2003). Linking learning and consciousness: The self-organizing consciousness (SOC) model. In A. Cleeremans (Ed.), The unity of consciousness: Binding, integration, and dissociation. Oxford: Oxford University Press.
go back to reference Perruchet, P., Gallego, J., & Savy, I. (1990). A critical reappraisal of the evidence for unconscious abstraction of deterministic rules in complex experimental situations. Cognitive Psychology, 22, 493–516 Perruchet, P., Gallego, J., & Savy, I. (1990). A critical reappraisal of the evidence for unconscious abstraction of deterministic rules in complex experimental situations. Cognitive Psychology, 22, 493–516
go back to reference Perruchet, P., Vinter, A., Pacteau, C., & Gallego, J. (2002). The formation of structurally relevant units in artificial grammar learning. Quarterly Journal of Experimental Psychology, 55A, 485–503. Perruchet, P., Vinter, A., Pacteau, C., & Gallego, J. (2002). The formation of structurally relevant units in artificial grammar learning. Quarterly Journal of Experimental Psychology, 55A, 485–503.
go back to reference Perruchet, P., Tyler, M. D., Galland, N., & Peereman, R. (2004). Learning nonadjacent dependencies: No need for algebraic-like computations. Journal of Experimental Psychology: General, 133, 573–583. Perruchet, P., Tyler, M. D., Galland, N., & Peereman, R. (2004). Learning nonadjacent dependencies: No need for algebraic-like computations. Journal of Experimental Psychology: General, 133, 573–583.
go back to reference Pinker, S., & Prince, A.(1988). On language and connectionism: Analysis of a parallel distributed processing model of language acquisition. Cognition, 28, 73–193. Pinker, S., & Prince, A.(1988). On language and connectionism: Analysis of a parallel distributed processing model of language acquisition. Cognition, 28, 73–193.
go back to reference Plunkett, K. (1990). The segmentation problem in early language acquisition. Center for Research in Language Newsletter, 5, 1–17. Plunkett, K. (1990). The segmentation problem in early language acquisition. Center for Research in Language Newsletter, 5, 1–17.
go back to reference Ramscar, M. (2002). The role of meaning in inflection: Why the past tense does not require a rule. Cognitive Psychology, 45, 45–94. Ramscar, M. (2002). The role of meaning in inflection: Why the past tense does not require a rule. Cognitive Psychology, 45, 45–94.
go back to reference Redington, M., Chater, N. (1998). Connectionist and statistical approaches to language acquisition: A distributional perspective. Language and Cognitive Processes, 13, 129–191. Redington, M., Chater, N. (1998). Connectionist and statistical approaches to language acquisition: A distributional perspective. Language and Cognitive Processes, 13, 129–191.
go back to reference Redington, M., Chater, N., & Finch, S. (1998). Distributional information: A powerful cue for acquiring syntactic categories. Cognitive Science, 22, 425–469. Redington, M., Chater, N., & Finch, S. (1998). Distributional information: A powerful cue for acquiring syntactic categories. Cognitive Science, 22, 425–469.
go back to reference Rumelhart, D., & McClelland, J. (1986). On learning the past tenses of English verbs: Implicit rules or parallel distributed processing? In J. McClelland, D. Rumelhart, & the PDP Research Group (Eds.), Parallel distributed processing: Explorations in the microstructure of cognition. Cambridge, MA.: MIT Press. Rumelhart, D., & McClelland, J. (1986). On learning the past tenses of English verbs: Implicit rules or parallel distributed processing? In J. McClelland, D. Rumelhart, & the PDP Research Group (Eds.), Parallel distributed processing: Explorations in the microstructure of cognition. Cambridge, MA.: MIT Press.
go back to reference Saffran, J. R., Newport, E. L., & Aslin, R. N. (1996). Word segmentation: The role of distributional cues. Journal of Memory and Language, 35, 606–621. Saffran, J. R., Newport, E. L., & Aslin, R. N. (1996). Word segmentation: The role of distributional cues. Journal of Memory and Language, 35, 606–621.
go back to reference Searle, J. R. (1992). The rediscovery of the mind. Cambridge, MA: MIT Press. Searle, J. R. (1992). The rediscovery of the mind. Cambridge, MA: MIT Press.
go back to reference Seidenberg, M. S., & MacDonald, M. C. (1999). A probabilistic constraints approach to language acquisition and processing. Cognitive Science, 23, 569–588. Seidenberg, M. S., & MacDonald, M. C. (1999). A probabilistic constraints approach to language acquisition and processing. Cognitive Science, 23, 569–588.
go back to reference Shanon, B. (2002). Remember the old masters! Behavioral and Brain Sciences, 25, 353–354. Shanon, B. (2002). Remember the old masters! Behavioral and Brain Sciences, 25, 353–354.
go back to reference Smolensky, P. (1988). On the proper treatment of connectionism. Behavioral and Brain Sciences, 11, 1–23. Smolensky, P. (1988). On the proper treatment of connectionism. Behavioral and Brain Sciences, 11, 1–23.
go back to reference Sproat, R. (2002). The linguistic significance of finite state techniques. Boston, MA: American Association for the Advancement of Science. Sproat, R. (2002). The linguistic significance of finite state techniques. Boston, MA: American Association for the Advancement of Science.
go back to reference Stanback, M. L. (1992). Syllable and rime patterns for teaching reading: Analysis of a frequency-based vocabulary of 17,602 words. Annals of Dyslexia, 42, 196–221. Stanback, M. L. (1992). Syllable and rime patterns for teaching reading: Analysis of a frequency-based vocabulary of 17,602 words. Annals of Dyslexia, 42, 196–221.
go back to reference Thelen, E., & Smith, L. B. (1994). A dynamic systems approach to the development of cognition and action. Cambridge, MA: MIT Press. Thelen, E., & Smith, L. B. (1994). A dynamic systems approach to the development of cognition and action. Cambridge, MA: MIT Press.
go back to reference Vinter, A. (1986). The role of movement in eliciting early imitations. Child Development, 57, 66–71. Vinter, A. (1986). The role of movement in eliciting early imitations. Child Development, 57, 66–71.
go back to reference Wright, R. L., & Burton, A. M. (1995). Implicit learning of an invariant: Just say no. Quarterly Journal Experimental Psychology, 48A, 783–796. Wright, R. L., & Burton, A. M. (1995). Implicit learning of an invariant: Just say no. Quarterly Journal Experimental Psychology, 48A, 783–796.
Metagegevens
Titel
Statistical approaches to language acquisition and the self-organizing consciousness: a reversal of perspective
Auteur
Pierre Perruchet
Publicatiedatum
01-06-2005
Uitgeverij
Springer-Verlag
Gepubliceerd in
Psychological Research / Uitgave 5-6/2005
Print ISSN: 0340-0727
Elektronisch ISSN: 1430-2772
DOI
https://doi.org/10.1007/s00426-004-0205-6

Andere artikelen Uitgave 5-6/2005

Psychological Research 5-6/2005 Naar de uitgave