Elsevier

Consciousness and Cognition

Volume 12, Issue 4, December 2003, Pages 549-571
Consciousness and Cognition

The emergence of a shared action ontology: Building blocks for a theory

https://doi.org/10.1016/S1053-8100(03)00072-2Get rights and content

Abstract

To have an ontology is to interpret a world. In this paper we argue that the brain, viewed as a representational system aimed at interpreting our world, possesses an ontology too. It creates primitives and makes existence assumptions. It decomposes target space in a way that exhibits a certain invariance, which in turn is functionally significant. We will investigate which are the functional regularities guiding this decomposition process, by answering to the following questions: What are the explicit and implicit assumptions about the structure of reality, which at the same time shape the causal profile of the brain’s motor output and its representational deep structure, in particular of the conscious mind arising from it (its “phenomenal output”)? How do they constrain high-level phenomena like conscious experience, the emergence of a first-person perspective, or social cognition? By reviewing a series of neuroscientific results and integrating them with a wider philosophical perspective, we will emphasize the contribution the motor system makes to this process. As it will be shown, the motor system constructs goals, actions, and intending selves as basic constituents of the world it interprets. It does so by assigning a single, unified causal role to them. Empirical evidence demonstrates that the brain models movements and action goals in terms of multimodal representations of organism-object-relations. Under a representationalist analysis, this process can be conceived of as an internal, dynamic representation of the intentionality-relation itself. We will show how such a complex form of representational content, once it is in place, can later function as a functional building block for social cognition and for a more complex, consciously experienced representation of the first-person perspective as well.

Introduction

Actions in the external world can be experienced as such, recognized, and understood. Simultaneously, the intentional content correlated with them (i.e., their satisfaction conditions resp. their intended goal-state) is interpreted by the observer as playing a causal role in determining the behavior of the observed other individuals. From a first-person perspective, the dynamic social environment appears as populated by volitional agents capable to entertain, similarly to the observer, an intentional relation to the world. We experience other agents as directed at certain target states or objects. We are “intentionality-detectors”: As human beings, we cannot only mentally build an “objective,” third-person account of the behaviors constituting the events of our social world. Beyond phenomenally experiencing the objective nature of a witnessed action, we can also experience its goal-directedness or intentional character, similarly to when we experience ourselves as the willful conscious agents of an ongoing behavior.

In the present paper we will provide and integrate some empirical and conceptual building blocks for a theory of the emergence of a common ontology between members of a group. We will examine, from a third-person scientific perspective, the fundamentally relational character of actions in the world. In particular, we want to look at the “ontological commitments” the brain makes when representing actions and goals. It will be further shown that the brain builds an ontology, an internal model of reality, which—on a very fundamental level within its representational architecture—incorporates the relational character of inter-actions between organism and environment, and that this architecture can actually be traced at the microfunctional level implemented in the brain’s neural networks. The same subpersonal ontology then guides organisms when they are epistemic agents in a social world: Interpersonal relations become meaningful in virtue of a shared action ontology.

An action ontology can only be shared and successfully used by two systems, if there is a sufficient degree of functional overlap between them, if they decompose target space in similar ways. We will posit that the cognitive development of social competence capitalizes upon such a shared ontology to trigger the timely onset of behaviors such as gaze following, shared attention, and mind reading, which will eventually give rise to a full-blown capacity to entertain mental accounts of the behavior and goal states of other agents. We will also propose that what makes humans special is the fact that their functional ontology is much richer in socially individuated goal representations and that their model of reality is not only rich and flexible, but that they can actively expand their own functional ontology by mentally ascribing distal goals to conspecifics.

Neuroscientific results discussing the functional properties of mirror neurons, a class of premotor neurons in the monkey brain, will be introduced. It will be proposed that mirror neurons can be conceived of as the dawning of what the equivalent matching systems in our human brains are the fully developed realization of: a fundamental and mostly unconscious representational structure capable to build a shared action ontology. However, in closing we will also provide an example for a late and high-level utilization of this structure: enabling beings like ourselves to mutually acknowledge each other as persons, and to consciously experience this very fact at the same time.

Section snippets

The neural underpinnings of social understanding

Primates, and particularly human beings are social animals whose cognitive development capitalizes upon the interaction with other conspecifics (adults, siblings, etc.). During social interactions we overtly manifest our inner intentions, dispositions and thoughts by means of overt behavior. We reciprocate this by trying to figure out what are the intentions, dispositions, and thoughts of others, when witnessing their behavior. Detecting another agent’s intentions, or other inner states, helps

Embodied simulation

So far we have characterized the function of mirror neurons in terms of implicit action understanding, by means of embodied simulation. The notion of simulation is at present employed in many different domains, often with different, not necessarily overlapping meanings. Simulation is a functional process that possesses a certain representational content, typically focussing on the temporal evolution or on possible states of its target object. For example, an authoritative view on motor control

Sharing an action ontology: the general idea

One useful way to look at the brain is to describe it as a dynamic representational system. Every representational system presupposes an ontology: A set of assumptions about what the elementary building blocks of the reality to be represented actually are. By necessity, it constructs primitives. For example, many natural languages, viewed as representational systems, typically assume that extralinguistic reality is constituted by objects, properties, and relations. Their underlying ontology

Goals

We think that the neuroscientific data so far presented make it necessary to conceptually restructure the questions that have to be asked. Let us begin by defining some basic notions. What is a goal? From a strict scientific point of view, no such things as goals exist in the objective world. All that exists are goal-representations, for instance, as we have seen in Section 2, those activated by biological nervous systems. A goal-representation is, first, formed by the representation of a

Actions

On a non-conceptual level, actions are elementary building blocks of reality for certain living organisms: Some kinds of organisms have developed agent-detecting modules, and some of them also conceive of themselves as agents. They have an extended ontology, because their reality has been considerably enriched. We can define such functionally enriched systems as possessors of an “action ontology.” Let us now define what an action is on a conceptual level. Let us begin by distinguishing

What is a PMIR?

Before addressing the problem of the phenomenal aspect of the shared action ontology, we must first focus on the way the agent-object relationship can be phenomenally represented. What is the phenomenal model of the intentionality relation (for details see Metzinger, 2003, Chapter 6)? It is a conscious mental model, and its content is an ongoing, episodic subject–object-relation. Here are four different examples, in terms of typical phenomenological descriptions of the class of phenomenal

Intentionality phenomenalized

The philosophical step just taken consists in phenomenalizing intentionality. Phenomenalizing intentionality, we submit, may be an indispensable first step in the project of naturalizing intentionality tout court. Meaning and the conscious experience of meaningfulness have to be separated. Of course, this does not mean that no such thing as intentional content exists.

Mental representations possess at least two kinds of content: Phenomenal content (PC) and intentional content (IC). As a large

Consciously sharing an action ontology: A phenomenological multi-level analysis

Phenomenal mental models are instruments used to make a certain subset of information currently active in the system globally available for the control of action, for focal attention and for cognitive processing. A phenomenal model of transient subject–object relations makes an enormous amount of new information available for the system: All information related to the fact that it is currently perturbed by perceptual objects, that certain cognitive states are currently occurring in itself,

Acknowledgements

Vittorio Gallese was supported by MIURST and the Eurocores Program of the European Science Foundation.

Thomas Metzinger was supported by the McDonnell Project in Philosophy and Neuroscience.

References (54)

  • A.R. Damasio

    Descartes’ error

    (1994)
  • A.R. Damasio

    The Feeling of What Happens: Body and Emotion in the Making of Consciousness

    (1999)
  • A.R. Damasio et al.

    Images and subjectivity: Neurobiological trials and tribulations

  • A. Damasio et al.

    Making images and creating subjectivity

  • J. Decety et al.

    Brain activity during observation of actions. Influence of action content and subject’s strategy

    Brain

    (1997)
  • D.C. Dennett

    The intentional stance

    (1987)
  • Dennett, D. C. (1987b). Intentional systems in cognitive ethology: The Panglossian Paradigm defended. In: Dennett...
  • D.C. Dennett

    Consciousness explained

    (1991)
  • L. Fadiga et al.

    Motor facilitation during action observation: A magnetic stimulation study

    Journal of Neurophysiology

    (1995)
  • C.M. Filion et al.

    Can monkeys (Macaca mulatta) represent invisible displacement?

    Journal of Comparative Psychology

    (1996)
  • L. Fogassi et al.

    The neural correlates of action understanding in non human primates

  • V. Gallese

    The acting subject: Towards the neural basis of social cognition

  • V. Gallese

    The “Shared Manifold” Hypothesis: From mirror neurons to empathy

    Journal of Consciousness Studies

    (2001)
  • V. Gallese

    The manifold nature of interpersonal relations: The quest for a common mechanism

    Philosophical Transactions of the Royal Society London B

    (2003)
  • V. Gallese

    A neuroscientific grasp of concepts: From control to representation

    Philosophical Transactions of the Royal Society London B

    (2003)
  • V. Gallese et al.

    The mirror matching system: A shared manifold for intersubjectivity

    Behavioral Brain Sciences

    (2002)
  • V. Gallese et al.

    Action recognition in the premotor cortex

    Brain

    (1996)
  • Cited by (114)

    • Shot scale matters: The effect of close-up frequency on mental state attribution in film viewers

      2020, Poetics
      Citation Excerpt :

      Experiencing the mental states of others (also referred to as embodied simulation, affective empathy, or emotional contagion) is an involuntary process, not dependant on higher cognitive processes. It occurs when one resonates with matching affective bodily states of the observed person (Decety & Jackson, 2004; Gallese, 2007; Lieberman, 2007; Metzinger & Gallese, 2003), for example directly experiencing a similar intensity of anxiety or pain when seeing someone in stress. This reaction has been linked to the simulation theory and the mirror neuron system (Gallese, 2007).

    • Evolutionary efficiency in economic systems: A proposal

      2016, Cuadernos de Economia
      Citation Excerpt :

      From this perspective, and by means of the analytical concept of an agent's action plan, it is possible to propose an evolutionary efficiency criterion in economic processes.7 The argument is consistent with the role that the categories of intentionality, such as belief, goal, intention, and collective intentionality, are part of cognitive sciences, artificial intelligence and social philosophy, among other fields, and serve as the explanation of individual and collective behavior and the emergence of institutions (see Baldwin and Baird, 2001; Grosz and Hunsberger, 2006; Metzinger and Gallese, 2003). If we are right, this proposal would contribute to the microfoundations of economic systems concerning agent action, which results in individual and organizational evolving capabilities, and the consequences of intentional action for economic change (Felin and Foss, 2006; Loasby, 2008).

    • Mindfulness meditation and consciousness: An integrative neuroscientific perspective

      2016, Consciousness and Cognition
      Citation Excerpt :

      The concept of self is as difficult to define as the concept of consciousness. Most research (Metzinger & Gallese, 2003; Pacherie, 2008; Roessler & Eilan, 2003), focusing on the central representation of different parts of the body, has linked the sense of self to other concepts, such as agency – i.e., “the sense that a person’s action is the consequence of his or her intention” (Seth, Suzuki, & Critchley, 2012) – and embodiment – i.e., “the sense of being localized within one’s physical body” (Arzy, Thut, Mohr, Michel, & Blanke, 2006). Agency and embodiment might be connected with what has been called the “minimal phenomenal selfhood” (MPS), that is, “the experience of being a distinct, holistic entity capable of global self-control and attention, possessing a body and a location in space and time” (Blanke & Metzinger, 2009).

    • Thinking through the imagination: Aesthetics in human cognition

      2023, Thinking Through the Imagination: Aesthetics in Human Cognition
    View all citing articles on Scopus

    We thank Wolfgang Prinz for a number of very helpful comments to an earlier version of this paper.

    View full text