Interpreting and inverting with less cursing: A guide to interpreting IRAP data

https://doi.org/10.1016/j.jcbs.2015.05.001Get rights and content

Highlights

  • The IRAP is a procedure used to assess the "strength" of relational responding.

  • We clarify the steps involved in scoring and interpreting IRAP data.

  • Correct scoring and inversion techniques are key to appropriate statistical analysis.

Abstract

This Professional Interest Brief seeks to provide a clear guide to interpreting data generated by Implicit Relational Assessment Procedure (IRAP). The interpretation of IRAP data is not immediately intuitive and yet has received little explicit attention in the published literature. As such, it is hoped that this guide will help clarify this matter, particularly for those new to using the IRAP or intending to use the measure in the future. In doing so, we hope to make the measure more accessible and facilitate continued use of the methodology and its contribution to the contemporary Relational Frame Theory (RFT) literature.

Introduction

One of the cornerstones of Contextual Behavioral Science (CBS: Hayes, Barnes-Holmes, & Wilson, 2012) is its appeal to a basic account of human language and cognition through Relational Frame Theory (RFT). Relational Frame Theory argues that the fundamental building block of human cognitive abilities, such as abstract reasoning and generative language is “arbitrarily applicable relational responding” (AARR: see Hayes, Barnes-Holmes, and Roche, 2001). Much early RFT research revolved around demonstrating its proposed analytic units, relational frames, that were established in the laboratory (see Hughes and Barnes-Holmes, in press, for review). However, in recent years, RFT researchers have attempted to extend RFT's conceptual account by also assessing histories of relational responding that were established outside of the laboratory (see Barnes-Holmes, Barnes-Holmes, and Hussey, in press; Hussey, Barnes-Holmes, and Barnes-Holmes, 2015), such as by posing questions about the probability or “strength” of individuals' relational responding in applied domains such as obsessive compulsive tendancies, depression, or professional burnout (see Nicholson and Barnes-Holmes, 2012a, Hussey and Barnes-Holmes, 2012, Kelly and Barnes-Holmes, 2013, respectively). In order to do this, RFT researchers have built on methodologies frequently used in cognitive and social psychology to assess what are referred to as “implicit attitudes” (see De Houwer and Moors, 2010; see also Hughes, Barnes-Holmes, and Vahey, 2012). This has produced a procedure that has shown utility in assessing the relative strength of relational responding: the Implicit Relational Assessment Procedure (IRAP: Barnes-Holmes, Barnes-Holmes, Stewart, & Boles, 2010). IRAP research now represents one of the forefronts of RFT research (Barnes-Holmes et al., in press).

Section snippets

Task structure

A brief description of the procedure will now be provided, as the interpretation of IRAP data is best understood through an understanding of the structure of the task itself. The IRAP involves presenting pairs of stimuli to participants on a computer screen. Participants respond to blocks of these stimulus pairings, and are required to respond as accurately and quickly as possible according to what we will describe as two responding rules. In some IRAP studies, specific instructions regarding

Methods of quantifying effects on the IRAP

To reiterate, the IRAP presents stimuli to participants in pairs of blocks. The same categories of stimuli are presented in both blocks. However, the critical difference between the two blocks is that the required response option for each trial-type alternates between them. For example, on one block, participants must respond to a given stimulus pair (e.g., “I am” and “Loyal”) with one response option (e.g., “True”), whereas on the other block, participants must respond with the other response

Acknowledgment

We would like to thank Brian Nosek for his very helpful feedback on the details of the G algorithm.

References (29)

  • D. Barnes-Holmes et al.

    A sketch of the Implicit Relational Assessment Procedure (IRAP) and the Relational Elaboration and Coherence (REC) model

    The Psychological Record

    (2010)
  • D. Barnes-Holmes et al.

    Using the Implicit Association Test and the Implicit Relational Assessment Procedure to measure attitudes toward meat and vegetables in vegetarians and meat-eaters

    The Psychological Record

    (2010)
  • D.A. Balota et al.

    Moving beyond the mean in studies of mental chronometry: The power of response time distributional analyses

    Current Directions in Psychological Science

    (2011)
  • J. Cohen

    Statistical power analysis for the behavioral sciences

    (1977)
  • Cited by (0)

    1

    IH was assisted by a Government of Ireland Scholarship by the Irish Research Council.

    View full text