Skip to main content
Top
Gepubliceerd in: Journal of Psychopathology and Behavioral Assessment 1/2023

Open Access 16-12-2022

The Development and Validation of the Firesetting Questionnaire

Auteurs: Theresa A. Gannon, Mark E. Olver, Emma Alleyne, Helen Butler, Victoria Lister, Caoilte Ó Ciardha, Katie Sambrooks, Nichola Tyler

Gepubliceerd in: Journal of Psychopathology and Behavioral Assessment | Uitgave 1/2023

Abstract

This research developed and evaluated a measure to examine fire-specific constructs relevant to fire misuse. In the first study, using UK community members asked to disclose deliberate firesetting, we tested a large pool of theoretically informed questionnaire items. First, we found that 1 in 10 adults reported setting a deliberate fire that they had not been apprehended for. Then, exploratory and confirmatory factor analyses suggested an eight-factor measure with broader coverage of theoretically-informed risk factors, relative to previous measures, and acceptable test item validity and robust internal consistencies. In the second study, we tested the Firesetting Questionnaire with imprisoned men who held a record of firesetting and imprisoned and community comparisons. The findings illustrated psychometric robustness. Our results suggest that the Firesetting Questionnaire has the potential to be a useful clinical tool for highlighting fire-specific treatment needs and informing clinical formulation and associated risk management.
Opmerkingen

Supplementary Information

The online version contains supplementary material available at https://​doi.​org/​10.​1007/​s10862-022-10011-x.

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Introduction

Deliberate firesetting is an international public health issue of vast proportions (Tyler et al., 2019). Latest available statistics from the US National Fire Protection Association suggest that more than 250,000 deliberate firesetting incidents were responded to by fire services over the five-year term from 2014 to 2018 (Campbell, 2021). These incidents were annually responsible for around 1,350 civilian casualties, including 400 deaths, and $815 million costs in direct property damage (Campbell, 2021). Yet, despite the huge human and economic costs associated with deliberate firesetting, compared with other offending behaviors such as sexual offending and violence, empirical research examining deliberate firesetting is embryonic. To date, there are no established assessments available for assessing deliberate firesetting risk factors which makes it difficult to establish convincing evidence of ‘what works’ to reduce deliberate firesetting behavior (Fritzon et al., 2013; Palmer et al., 2007).
Low levels of research in this area appear to have resulted from a long-standing assumption that individuals who deliberately fireset are offence ‘generalists’ who do not require specialist psychological assessment or intervention. However, psychological research shows that males who have set deliberate fires are psychologically different to other matched males who have offended; exhibiting, in particular, higher endorsement of fire-specific variables (e.g., serious fire interest and identification with fire; Gannon et al., 2013; Ó Ciardha, Barnoux et al., 2015). These variables, amongst others, are conceptualized in the most recent empirically-informed theoretical framework examining the development and maintenance of firesetting (i.e., the Multi-Trajectory Theory of Adult Firesetting [M-TTAF]; Gannon et al., 2012; Gannon et al., 2022) as dynamic risk factors. Within the M-TTAF, three key fire-specific dynamic risk factors are emphasized as being important in the etiology of deliberate firesetting. These are: (1) an inappropriate interest in fire or fire misuse, (2) inappropriate fire scripts (i.e., cognitive rules in which fire is the preferred mechanism for achieving particular goals such as crime concealment or communication), and (3) attitudes that support deliberate firesetting such as believing that fire is controllable. Although these factors are conceptualized within the M-TTAF (Gannon et al., 2012) as being independent, the pattern of these fire-specific features are predicted to be important for the individualized formulation of firesetting behavior. Since fire-specific interests, cognitive associations, and attitudes appear to represent key risk factors for firesetting behavior, it critical that professionals are able to accurately assess these variables to inform clinical formulation and associated risk management. To date, very few questionnaires have been constructed to examine fire-specific dynamic risk factors in adults.
Perhaps the best-known questionnaires developed to examine fire-specific dynamic risk factors are the Fire-setting Assessment Schedule and the Fire Interest Rating Scale which were developed some decades ago by Murphy and Clare (1996). The Fire-setting Assessment Schedule contains 32 items and was developed to examine the events, affect, and cognitions associated with firesetting incidents via eight constructs covering themes such as self-stimulation (“I felt that starting fires was the most exciting thing I could do”) and social attention (“I started fires to make people pay attention and listen to me”). However, this schedule was constructed for use with individuals holding intellectual disabilities and has not been widely validated with other populations. The Fire Interest Rating Scale is made up of 14 fire-specific situations (e.g., “watching a house burn down”) that participants are requested to assess on a 7-point Likert scale regarding their affective response. Initially developed with individuals experiencing intellectual disabilities, this questionnaire has been used more widely with adult firesetting populations to measure extent of inappropriate fire interest (Barrowcliffe & Gannon, 2016; Swaffer et al., 2001) and has demonstrated good internal consistency (α = 0.82; Barrowcliffe & Gannon, 2016). Another measure developed, in part, to assess fire interest is the Fire Setting Scale (Gannon & Barrowcliffe, 2012). This measure comprises 20 items and was originally developed to assess fire interest (10 items; “I find fire intriguing”) and antisocial behavior (10 items; “I am a rule breaker”) in community members. Although the scale holds good discriminative ability between community members who self-report deliberate firesetting and those who do not (Barrowcliffe & Gannon, 2015, 2016; Barrowcliffe et al., 2022; Gannon & Barrowcliffe, 2012), it has yet to be validated with apprehended populations. The Fire Attitude Scale (Muckley, 1997) consists of 20 items developed to examine fire supportive attitudes (e.g., “setting just a small fire can make you feel a lot better”). It was originally developed in the UK in the context of an intervention provided by Fire and Rescue but has been adopted by clinicians to inform assessment and intervention with adults who have set fires (Collins, Barnoux, & Langdon, 2021; Taylor & Thorne, 2019).
In 2015, Ó Ciardha, Barnoux and colleagues set out to improve construct measurement in firesetting assessment through combining items from the Fire Interest Rating Scale (Murphy & Clare, 1996), and the Fire Attitude Scale (Muckley, 1997) with a recently constructed Identification with Fire Questionnaire (Gannon et al., 2011) in order to assess the number of distinct constructs measured by these scales. The Identification with Fire Questionnaire is comprised of 10 items (e.g., “fire is an important part of my identity”) designed to measure personal identification with fire. After factor analyzing the items from the three measures using a sample of 234 imprisoned males (half of whom had a history of setting deliberate fires), five distinct constructs were initially reported: identification with fire (as per Gannon et al., 2011), serious fire interest (inappropriate interest in highly destructive and dangerous fires), everyday fire interest (inappropriate interest in everyday fire-related phenomena), fire safety awareness (perceived lack of fire safety knowledge), and firesetting as normal (perception of fire misuse being common). These five constructs were later pruned down to four (named the Four Factor Fire Scales; Ó Ciardha, Tyler, & Gannon, 2015) for clinical use after the everyday fire interest construct failed to discriminate between imprisoned individuals who had a history of deliberate firesetting and those who did not (Ó Ciardha, Barnoux et al., 2015). The final Four Factor Fire Scales assessment was normed across mixed gender forensic health and prison samples (N = 565) to provide practitioners with a reliable set of comparable data with which to compare assessment scores (Ó Ciardha, Tyler, & Gannon, 2015).
While the Five and Four Factor Fire Scales (Ó Ciardha, Barnoux et al., 2015; Ó Ciardha, Tyler, & Gannon, 2015) have enabled researchers and clinicians to assess fire-specific factors in a more meaningful way using pre-existing scales, there are key limitations. Most notable, perhaps, is that the scales do not contain items that reflect current firesetting theory since the majority of underpinning items stem from scales developed in the 1990s (i.e., The Fire Interest Rating Scale, Murphy & Clare, 1996; The Fire Attitude Scale, Muckley 1997). The most obvious caveat relates to the absence of items that assess inappropriate fire scripts (Butler & Gannon, 2015; Gannon et al., 2012; Gannon et al., 2022). Fire scripts refer to a learnt set of cognitive rules regarding how fire is perceived and used (Butler & Gannon, 2015; Gannon et al., 2022). Within westernized cultures, when fire scripts are appropriate, fire is typically perceived to be comforting or invigorating in particular contexts (e.g., at a religious celebration, or at organized bonfires where fire is used safely; Gannon et al., 2022). An inappropriate fire script, on the other hand, may result in fire being misused preferentially in order to achieve particular goals such as crime concealment or communication (e.g., an individual may perceive fire as being the best way to destroy evidence or cope with distressing situations; Butler & Gannon, 2015; Gannon et al., 2012). Such scripts can exist either in addition to—or in the absence of—an inappropriate fire interest. A further clear caveat of the Five and Four Factor Fire Scales relates to the lack of item diversity within particular domains. For example, although there are items that assess attitudes that support deliberate firesetting, these focus on the concept of fire normalization and do not tap other attitudes proposed to be etiological such as believing that fire is controllable (see Gannon et al., 2012; Ó Ciardha & Gannon, 2012). Finally, neither the Five or Four Factor Fire Scales measure has been appropriately validated with samples of unapprehended individuals who have reported setting deliberate fires in the community.
The prevalence of unapprehended firesetting in the community has almost exclusively been examined via a series of small-scale studies in the UK (Gannon & Barrowcliffe, 2012; Barrowcliffe & Gannon, 2015, 2016; see also Johnston 2022). Members of the community were invited to anonymously self-report whether they had ever set a deliberate fire since the age of 10 years that they had never been apprehended for. Across these studies, between 11% and 18% of community members self-reported having engaged in deliberate firesetting. Barrowcliffe and Gannon’s (2015) study was the most methodologically rigorous regarding sampling, revealing the prevalence of individuals who had set a deliberate fire to be 11.5%. Individuals across all three studies were asked to provide relevant details concerning firesetting characteristics (e.g., materials used to start the fire) and motivations. In these studies, popular measures of fire-specific dynamic risk factors were used (e.g., the Fire Interest Rating Scale, Murphy & Clare, 1996; the Fire Attitude Scale, Muckley 1997; the Identification with Fire Questionnaire Gannon et al., 2011) with varying levels of discriminatory success. However, these measures were never examined using the Five or Four Factor Fire Scales’ (Ó Ciardha et al., 2015, 2016) scoring algorithms.
The aim of the current research was to develop and evaluate a new questionnaire to examine fire-specific constructs relevant to fire misuse with both apprehended and unapprehended samples. Using latest comprehensive firesetting theory (i.e., the M-TTAF; Gannon et al., 2012), the theoretical constructs of inappropriate fire scripts and attitudes (Butler & Gannon, 2015; Ó Ciardha & Gannon,2012), and clinical practice, a large pool of questionnaire items was devised. Our predefined hypotheses are available via the Open Science Framework Repository (https://​osf.​io/​p4v2j/​). In Study 1, the large pool of items were presented to community participants alongside existing measures of fire-related constructs (i.e., the original Five Factor Fire Scales; Ó Ciardha et al., 20151; The Fire Interest Subscale; Gannon & Barrowcliffe, 2012). Using Barrowcliffe and Gannon (2015) as a guide, we first attempted to replicate their findings in relation to self-reported deliberate firesetting that had not been officially recorded. Specifically, we predicted that approximately 10% of participants would self-report having set a deliberate fire. We predicted that these individuals would not differ to comparison UK community adults who do not self-report having set a deliberate fire on key demographic factors such as age, educational status, ethnicity, employment status, presence of a mental health diagnosis, learning disability, or criminal convictions. We aimed to then explore key features of the deliberate fires reported by unapprehended individuals as well as firesetting motivators and modus operandi and compare these findings to Barrowcliffe and Gannon (2015). We also aimed to replicate the original Five Factor Fire Scale Structure reported by Ó Ciardha et al. (2015) in a mixed group of unapprehended community adults who self-report deliberate firesetting and community members who do not report such behavior. We expected to be able to discriminate these two groups of community individuals on four out of the five subscales (i.e., identification with fire, serious fire interest, fire safety awareness, firesetting normalization) in line with Ó Ciardha et al. (2015). Following this, we explored the emerging factor structure when combining the Five Factor Fire Scale with the Fire Interest subscale of the Fire Setting Scale (Gannon & Barrowcliffe, 2012), and the large pool of new questionnaire items that we had devised to see if these additional items elucidated new factors. We anticipated that any new factor structure would better discriminate community adults who self-report deliberate firesetting from other community members relative to the Five Factor Fire Scales (Ó Ciardha et al., 2015). As an extension to this project, in Study 2, we validated the new measure developed in Study 1 with imprisoned individuals (with and without a firesetting history) as a well as community comparisons. We anticipated that any new firesetting questionnaire that emerged would discriminate individuals in prison who had set fires from their imprisoned counterparts who had not set fires and community comparisons. We also predicted that this discrimination would be superior to that exhibited by the pre-existing Five Factor Fire Scale (Ó Ciardha et al., 2015).

Study 1

Method

Participants

Individuals registered on the Prolific platform were invited to partake in this research entitled “Attitudes Towards Firesetting Study” if they were (a) 18 + years of age, (b) resident in the UK, and (c) had a 98%+ approval rate with a 200 + hit rate recorded on Prolific. This latter criterion was implemented to ensure that the participants we recruited had a record of extensive good conduct when engaging in online research. In total, 1,408 participants were recruited. However, six individuals answered the firesetting questions in such a manner that it was impossible to ascertain their firesetting status and so they were removed. This left 1,402 participants (M age = 40.8 years; 50.1% female; 91.2% White British). This study was ethically reviewed and approved by the University of Kent School of Psychology Ethics Committee [ID201815238945904987] and participants were reassured in the information and consent form that any disclosures of unapprehended firesetting would not be passed to the authorities.

Measures

We report internal consistency and reliability according to the following criteria (George & Mallery, 2003): ≥ 0.90 excellent, 0.89 to ≥ 0.80 good, 0.79 to ≥ 0.70 acceptable, and 0.69 to 0.60 questionable.
Demographic and Firesetting Disclosure Variables
A series of questions—stemming from the work of Gannon and Barrowcliffe (2012) and Barrowcliffe and Gannon (2015)—were used to gain information on basic demographics, health/criminal background, and firesetting history of participants. Basic demographic variables collected included age, ethnicity, education level, and employment status. Health/criminal background variables collected were presence of a mental health diagnosis or learning disability, and any previous criminal convictions. Within the firesetting history section, in line with Barrowcliffe and Gannon (2015), participants were asked to indicate whether they had deliberately set a fire or fires. They were provided with relevant examples of deliberate firesetting such as setting fires to annoy other people, to relieve boredom, to create excitement, for insurance purposes, due to peer pressure or to get rid of evidence. Participants were requested to exclude fires set accidentally, or set for organized events such as bonfires. In Barrowcliffe and Gannon (2015) and other previous work using the firesetting history questions (e.g., Barrowcliffe & Gannon, 2016; Gannon & Barrowcliffe, 2012) participants have been requested to exclude fires set before the age of 10 years (i.e., the age of criminal responsibility in the UK). In this study, we chose 14 years as the cut-off point for fire reporting to rule out self-reported childhood fire play. The majority of children in western cultures play with fire until they reach early adolescence (Kolko et al., 2001; Okulitch & Pinsonneault, 2002; Perrin-Wallqvist & Norlander, 2003) and these ‘play’ fires are likely to involve different etiological pathways to those associated with deliberate firesetting that persists into or occurs in adulthood. Participants who reported that they had set a deliberate fire were asked to answer additional questions (using a mostly forced choice response format) examining whether the participant had ever been arrested, convicted, or treated for their firesetting, number of fires set, presence of any co-perpetrators, age at first/last/only firesetting, factors preceding the firesetting (e.g., planning), modus operandi (e.g., use of accelerants), motivations and targets of the firesetting, community and perpetrator response to the firesetting (e.g., fire service attendance), and self-assessment of firesetting seriousness and factors that could have prevented the firesetting.
The Five Factor Fire Scale (Ó Ciardha, Barnoux et al., 2015)
This scale combines items from the Fire Interest Rating Scale (Murphy & Clare, 1996)2, Fire Attitude Scale (Muckley, 1997), and Identification with Fire Questionnaire (Gannon et al., 2011). Factor analysis (Ó Ciardha, Barnoux et al., 2015) has indicated that five subscales can be empirically determined from this combination of measures: (a) identification with fire (“Fire is almost part of my personality”), (b) serious fire interest (“Watching a house burn down”), (c) perceived fire safety awareness (“I know a lot about how to prevent fires”), (d) everyday fire interest (“Watching a bonfire outdoors, like on bonfire night”), and (e) firesetting as normal (“Most people have set a few small fires just for fun”). Although a total score of four factors (omitting everyday fire interest) has been devised because everyday fire interest did not usefully discriminate firesetting from non-firesetting individuals (Gannon et al., 2013, Ó Ciardha, Barnoux et al., 2015), we summed all five factors to produce a total score for this study. This total score reflects an individual’s overall fire interest, attitudes, and affiliation to fire with higher scores indicating problems in this area. Ó Ciardha, Barnoux et al. (2015) has reported excellent (α = 0.90) measure reliability for the Five Factor Total Score with male prisoners. We found good measure reliability (α = 0.87).
The Fire Interest Subscale (Gannon & Barrowcliffe, 2012)
This is a 10-item scale developed to measure general fire interest. Examples of items include “I get excited thinking about fire” and “I like to watch and feel fire”. Items are scored on a 7-point Likert scale from 1 (Not at all like me) to 7 (Very strongly like me). Barrowcliffe and Gannon (2015) have reported excellent (α = 0.92) measure reliability for UK (Kent) community members. We also found excellent (α = 0.93) measure reliability.
The New Firesetting Items
Five members of the research team (TG, EA, HB, CÓC, and NT) created a shared document to develop, and agree upon, questionnaire items for testing. Several iterations of the document were developed until all five members of the research team agreed that ideas on content had been saturated. The research team used latest available firesetting theory (the M-TTAF; Gannon et al., 2012), fire scripts/cognitive theory (Butler & Gannon, 2015; Ó Ciardha & Gannon,2012), and clinical practice knowledge to devise 117 separate questionnaire items spanning 12 constructs (Fire is a good way of coping [9 items], Fire and self-harm [8 items], Fire as a powerful tool [18 items], Fire as soothing/comforting [11 items], Fire is controllable [11 items], Interest in fire paraphernalia [9 items], Fire interest/sensory stimulation [21 items], Fire-related social desirability [9 items], Fire as normal [6 items], Fire safety awareness/confidence [7 items], Fire destroys evidence [5 items], and Identification with fire [3 items]). Efforts were made to ensure that each item reflected the respondent’s own thoughts and feelings regarding fire rather than how they felt other individuals who have set fires might feel (e.g., “Watching even a small fire makes me happy”). Participants were instructed to show how much they agreed or disagreed with each statement using a 5-point scale from 1 (strongly disagree) to 5 (strongly agree). Eleven items were constructed to be reverse scored. A full list of the original questionnaire items is available on the OSF.
Impression Management
The Impression Management Scale (IM) of the Balanced Inventory of Desirable Responding (BIDR6; Paulhus 1991) is a 20-item self-report measure of intentional fake good responses (e.g., “I never swear”) that can be rated on either a 5- or 7-point scale. We selected a 5-point scale (1 = not true, 5 = very true) to keep the answer format broadly in line with the other measures used in this research. We updated the item “I never look at sexy books or magazines” to “I never look at sexy books, magazines, or websites” in keeping with modern sexual image use. Continuous rather than dichotomous scoring of the scale was used (Paulhus, 1994; Stöber, Dette, & Musch, 2002). The IM has well-established psychometric properties with offending populations (Gannon et al., 2013; Gannon et al., 2015; Lanyon & Carle, 2007; Paulhus, 1991) and we found good measure reliability (α = 0.84).

Procedure

Eligible participants completed the questionnaires online in August 2018 and were compensated financially for their time. Participants were presented first with the demographic and firesetting disclosure questions. Those who answered affirmatively to the firesetting screen were then presented with the further questions to explore key features of their firesetting incident(s). For the remainder of the online task, the questionnaire blocks were presented in a random order for each participant with item order randomized within each block. To identify participants who were not appropriately engaged with our study, we included regular attention checks (e.g., “Please select ‘No’ for this question”). For the key demographic variables and main questionnaire blocks, we included five attention checks. An additional two checks were included in the firesetting disclosure section since identifying as someone who has set a fire made the survey longer. Participants’ responses to these attention checks were calculated in line with our preregistration (where < 4/5 or < 6/7 indicated a failed attention check for non-firesetters and firesetters respectively). Only one person failed the attention check by scoring 5/7. This individual self-reported firesetting and correctly answered both attention check items in this section. They also took 952 s to complete the survey which was close to the average completion time (see below) and so in a departure from our preregistration were retained in the analysis. Average completion times for the survey were 1380.4s (SD = 701.4) for individuals who self-reported firesetting, and 1132.6s (SD = 499.3) for individuals who did not. No participant completed the study too quickly (i.e., in less than one quarter of the mean time taken by comparable firesetting or non-firesetting participants) or failed to complete any of the questionnaires and so all responses were retained in the analyses.

Analysis Plan

Data were analyzed in three key stages in line with our preregistered plan. Data for factor analyses were conducted using Mplus 7.4 (Muthén & Muthén, 2015), all other analyses were undertaken in SPSS for Windows 25.0 (IBM Corp., 2017).

Firesetting Prevalence and Features

The aim of this stage was to replicate Barrowcliffe and Gannon (2015) using a 14-year minimum age for deliberate firesetting. In line with our pre-registration, we planned to recruit 1,400 community participants using the online crowdsourcing platform Prolific. This was based on a calculation of eight participants per questionnaire item (see Tabachnik & Fidell, 2007) and an estimated prevalence of 10% of individuals reporting having engaged in deliberate firesetting to ensure sufficient power (0.90) to detect an effect size of d = 0.30 with α = 0.05, when comparing unapprehended firesetting and non-firesetting participants. Here, we summed the number of participants who self-reported having set a deliberate fire not officially recorded and reported this as a percentage. We then used univariate comparisons (t test for continuous data, chi-squared for categorical data) to compare the demographic features of unapprehended individuals who self-reported firesetting with other community members who never reported setting a fire. Finally, we explored the key features of the deliberate fires (e.g., motive, modus operandi) using summary statistics.

2. Replication of The Five Factor Fire Scale Structure (Ó Ciardha et al., 2015)

We conducted a confirmatory factor analysis (CFA) to directly examine the factor structure and item parameters proposed by Ó Ciardha et al. (2015) in a sample of community adults. We employed a loading criterion of 0.40 for items to be considered for retention, maximum likelihood model estimation, and Geomin oblique rotation to allow the factors to correlate. Comparative fit index (CFI) and root mean squared error of approximation (RMSEA) were computed and interpreted to evaluate strength of model fit and variations of factor solutions. Marsh et al., (2010) note that values > 0.90 and 0.95, regarding TLI and CFI respectively typically reflect acceptable and excellent fit to the data. For the RMSEA, values less than 0.05 and 0.08 reflect a close fit and a reasonable fit to the data, respectively. Marsh et al. (2004) cautioned about overgeneralizing these interpretive heuristics which can be questioned with respect to their practical significance; as such, we employ these metrics as a guide. Further, Schermelleh-Engel et al., (2003) identify that a χ2/df ratio between 2 and 3 represents good to acceptable fit, but they too caution that this procedure is heavily sample size dependent and is best considered a descriptive index. Modification indices from the Lagrange Multiplier test were used to identify other indicator-latent construct pathways not formally examined and/or that could be removed to improve model fit.
To examine how well the Five Factor Fire Scale structure discriminated between unapprehended individuals who had set fires and other community members, Receiver Operating Characteristic (ROC) analyses were conducted to generate Area under the Curve (AUC) statistics, representing the probability that a randomly selected individual from the firesetting group obtained a more problematic score than a randomly selected comparison individual. With AUC values of 0.50 representing chance level prediction, values of 0.56, 0.64, and 0.71 represent small, medium, and large effects, respectively (Rice & Harris, 2005).

3. Development of A New Firesetting Questionnaire

The third stage of analysis aimed to explore the possible development of a new Firesetting Questionnaire, using a sample of community adults. Items from the Five Factor Fire Scale (Ó Ciardha et al., 2015) and the Fire Interest Subscale (Gannon & Barrowcliffe, 2012), were combined with the 117 new firesetting items to investigate if these items further consolidated existing Five Factor Fire Scale factors or elucidated new factors. An exploratory factor analysis (EFA) was conducted on one randomly selected half of the sample to identify the strongest model fit to the obtained data and draw a relative comparison to the Five Factor Fire Scale factor item loadings obtained under our second stage of analysis and by Ó Ciardha et al. (2015). As above, we employed the maximum likelihood model estimation and Geomin oblique rotation to allow the factors to correlate. The final goal was to maximize parsimony and fit through scrutiny of the item content of the factor solution and three fit indices. CFI and RMSEA were computed and interpreted to evaluate strength of model fit and consistent with the results of EFA values loading below 0.40 were dropped (cf. preregistration). A CFA—employing the same model estimation parameters as the EFA—was then conducted on the second half of the data to test the initial EFA solution and refine questionnaire composition. The same fit criteria employed with the EFA were used to evaluate the replicability of the solution of overall CFA fit.
The remaining psychometric analyses were conducted on the aggregate sample to examine scale properties, and specifically, indexes of construct validity. Explorations of impression management (IM) were undertaken through a univariate comparison of non-firesetting and firesetting participants and a correlation between the firesetting questionnaire and IM. Residualized factor scores (i.e., controlling for IM score) were obtained for discriminatory analyses to control for IM effects. ROC curves were then plotted with associated AUC figures generated to examine factor and overall questionnaire discriminative ability. Again, Rice and Harris’ (2005) guidelines were used to interpret AUCs and p values and 95% CIs were calculated for comparison with the pre-existing Five Factor Fire Scale (Ó Ciardha et al., 2015). To further compare the discriminative performance of the Firesetting Questionnaire relative to the original Five Factor Fire Scale, we opted to undertake a binary logistic regression analysis not specified in our original preregistration. This involved entering all Firesetting Questionnaire and Five Factor Fire Scale subscales simultaneously to examine which subscales were incrementally associated with binary self-reported firesetting.

Results

Firesetting Prevalence and Features

In line with our hypothesis, 137 participants (9.8%) reported having set a deliberate fire since the age of 14 years that they had not been arrested or convicted for. Two participants self-reported having interacted with a therapist as a result of their firesetting. Table 1 outlines the key demographic characteristics of individuals who reported having set a deliberate fire compared to those who reported never having set a deliberate fire. As hypothesized, there were no significant differences between the groups on ethnicity, educational level, or employment status. Both groups were majority White British, tended to hold post school qualifications, and were in some type of employment. Contrary to our hypotheses, those who self-reported firesetting were overwhelmingly male, and significantly younger than their non-firesetting counterparts. Individuals who had set a deliberate fire were also significantly more likely to have had a mental health or learning disability diagnosis at some point in their lives and were approximately four times more likely to have a prior criminal history.
Table 1
Study 1 Comparison of Individuals with vs. without a Self-Reported History of Firesetting on Demographic Factors and Impression Management
Variable
Firesetting % (n)/M (SD)
 
No
Yes
χ2/t
φ/d
Ethnicity
    
 White British
91.5 (1158)
88.3 (121)
4.88
.06
 Asian
3.9 (49)
4.4 (6)
  
 Black/Caribbean
1.7 (21)
3.6 (5)
  
 Gypsy/Irish Traveler
0.1 (1)
0 (0)
  
 Multiple ethnicities
1.9 (24)
1.5 (2)
  
 Other
0.9 (12)
2.2 (3)
  
Education
    
 No qualifications
1.3 (16)
0.7 (1)
3.82
.05
 GCSE or O Levels
16.0 (203)
21.9 (30)
  
 A Levels, NVQ level
25.3 (320)
24.8 (34)
  
 Degree
40.8 (516)
39.4 (54)
  
 Masters or higher
16.6 (210)
13.1 (18)
  
Sex
    
 Male
46.4 (587)
80.3 (110)
56.84***
.20
 Female
53.4 (675)
19.7 (27)
  
 Did not disclose
0.2 (3)
0.0 (0)
  
Age
41.1 (12.4)
37.9 (10.5)
2.85**
.26
Employment
    
 Full time student
4.0 (50)
3.6 (5)
9.14
.08
 Full time employment
55.1 (697)
67.9 (93)
  
 Part time employment
20.5 (259)
15.3 (21)
  
 Unemployed
13.9 (176)
10.2 (14)
  
 Retired
6.6 (83)
2.9 (4)
  
Mental health diagnosis?
    
 Yes
19.8 (251)
29.9 (41)
7.03**
.07
 No
80.2 (1014)
70.1 (96)
  
Learning disability diagnosis?
    
 Yes
1.7 (22)
5.8 (8)
8.06**
.08
 No
98.3 (1243)
94.2 (129)
  
Criminal history?
    
 Yes
3.6 (46)
16.1 (22)
38.68***
.17
 No
96.4 (1219)
83.9 (115)
  
Impression Management
59.9 (5.9)
59.7 (6.2)
.35
.03
Note: * p < .05, ** p < .01, *** p < .001. GCSE = General Certificate of Secondary Education, O Level = GCSE Ordinary Level, A Level = Advanced Level, NVQ = National Vocational Qualification
Individuals who reported having set a deliberate fire had set, on average, 1.8 fires (range 1–5, SD = 1.3). Participants who had set multiple deliberate fires (n = 56) reported setting their first fire between the ages of 143 and 34 years (M = 15.9; SD = 3.8) and their most recent deliberate fire between the ages 14 and 57 years (M = 19.7; SD = 7.6). Participants who had set one deliberate fire (n = 81) reported setting this fire between the ages of 14 and 40 years (M = 16.9; SD = 4.4). The majority of individuals reported setting their fire(s) with another person or persons (76.7%; n = 105). Participants reported varied motivations for firesetting. The most commonly selected motives related to experimenting with fire (64.2%; n = 88), wanting to create excitement or loving fire (54%; n = 74), and being bored (32%; n = 44). Participants most commonly reported setting fire to outside rubbish bins (29.9%; n = 41), grass or shrubbery (25.5%; n = 35), inside rubbish bins or wastepaper baskets (16.8%; n = 23), clothing (11.7%; n = 16), or a house or building believed to be empty (7.3%; n = 10). The majority of participants reported using matches (59.8%; n = 82) or a lighter (54.7%; n = 75) to start their fires, while smaller proportions reported using aerosols (17.5%; n = 24), lighter fuel (16.1%; n = 22), and white or mineral spirits (16.1%; n = 22). Only a small proportion of participants rated their only fire or, for individuals who had set multiple fires, their most recent fire, as being serious through scoring > 4 out of 7 on a scale examining firesetting seriousness (6.6%; n = 9). Most participants stated that being more aware of the dangers of fire and having better fire safety knowledge would have prevented them from setting their fire(s) (46.7%; n = 64). However, just under a third of participants reported that nothing would have prevented them from setting their fire(s) (31.4%; n = 43).

Replication of the Five Factor Fire Scale Structure (Ó Ciardha et al., 2015)

CFA was conducted on the full community sample (N = 1402) to test a correlated five factor solution. The CFA without modification generated a relatively poor fit (CFI = 0.77; TLI = 0.75; RMSEA = 0.07; 95% CI. 0.066, 0.070), χ2 / df ratio = 17884.844/666 = 26.85. The CFI and TLI values were below the conventional 0.90 to 0.95 threshold although the RMSEA value was within the acceptable threshold. There was a large χ2 / df ratio indicating poor fit between the CFI model and the data. Table 2 presents the standardized CFA results with standardized item loading parameters (ranging between − 1.0 and + 1.0) presented. All items loaded on their respective factors with one exception (see Table 2) and were significant at p < .001. However, modification indices indicated a number of item cross loadings would be required to improve model fit.
Table 2
Study 1 CFA Factor Loading Matrix of the Five Factor Fire Scale
Item and Factor Label
CFA Loading
Factor 1: Identification with Fire (12 items)
 Fire is a part of me
.819
 Fire is an important part of my identity
.805
 Fire is almost part of my personality
.791
 Fire is an important part of my life
.745
 I have to have fire in my life
.698
 I need fire in my life
.651
 Without fire, I am nobody
.637
 If you've got problems, a small fire can help you sort them out
.607
 I don't know who I am without fire
.586
 Setting just a small fire can make you feel a lot better
.575
 The best thing about fire is watching it spread
.530
 I don't need fire
− .445
Factor 2: Serious Fire Interest (7 items)
 Watching a house burn down
.712
 Watching people run from a fire
.693
 Seeing a hotel on fire in the TV news
.657
 Striking a match to set fire to a building
.592
 Watching a person with his clothes on fire
.575
 Seeing firemen hosing a fire
.462
 Going to a police station to be questioned about a fire
.455
Factor 3: Fire Safety (5 items4)
 Playing with matches can be very dangerous
.661
 Fires can easily get out of control
.545
 They should teach you about fire prevention at school
.488
 Parents should spend money on buying a fire extinguisher
.339
 I know a lot about how to prevent fires
.097
Factor 4: Everyday Fire Interest (6 items)
 Seeing firemen get their equipment ready
.666
 Watching a fire engine come down the road
.657
 Watching a bonfire outdoors, like on bonfire night
.464
 Having a box of matches in your pocket
.370
 Watching an ordinary coal, wood, or gas fire burn
.356
 Giving matches back to someone
.328
Factor 5: Firesetting as Normal (7 items)
 Most people have set a few small fires just for fun
.805
 Most people's friends have lit a fire or two
.785
 Most people have been questioned about fires by the police
.466
 When you're with your mates, you act now and think later
.441
 Most families have had a fire accident at home
.432
 I get bored easily in my spare time
.337
 I usually go along with what my mates decide
.332
Table 3 presents the AUC values for the Five Factor Fire Scale (Ó Ciardha et al., 2015) factors and total scores in the discrimination of people with a self-reported history of firesetting versus those without. The Total score demonstrated large magnitude effects for accurately identifying people with a history of firesetting. Factor 5 (Firesetting as Normal) also demonstrated a large discriminatory effect. Factor 3 (Fire Safety) did not discriminate better than chance, and the remaining factors demonstrated small to moderate effects.
Table 3
Study 1 Discrimination (AUC) of Individuals with vs. without a Self-Reported History of Firesetting on the Five Factor Fire Scales and Firesetting Questionnaire
 
AUC
95%CI
p
Firesetting Measure
   
 Five Factor Fire Scales
   
 Factor 1 Identification with fire
0.649
[0.598, 0.700]
< 0.001
 Factor 2 Serious fire interest
0.651
[0.603, 0.699]
< 0.001
 Factor 3 Fire safety
0.509
[0.457, 0.561]
0.718
 Factor 4 Everyday fire interest
0.562
[0.513, 0.612]
0.017
 Factor 5 Firesetting as normal
0.812
[0.778, 0.846]
< 0.001
  FIRS total
0.779
[0.741, 0.816]
< 0.001
Firesetting Questionnaire
   
 Factor 1 Firesetting as normal
0.837
[0.807, 0.867]
< 0.001
 Factor 2 Identification with fire
0.573
[0.519, 0.627]
0.005
 Factor 3 Fire interest
0.656
[0.608, 0.705]
< 0.001
 Factor 4 Fire safety
0.680
[0.634, 0.726]
< 0.001
 Factor 5 Pathological fire interest
0.634
[0.588, 0.681]
< 0.001
 Factor 6 Coping using fire
0.711
[0.661, 0.761]
< 0.001
 Factor 7 Fire is a powerful messenger
0.634
[0.581, 0.687]
< 0.001
 Factor 8 Fascination with fire paraphernalia
0.631
[0.580, 0.683]
< 0.001
  FQ Total
0.727
[0.681, 0.773]
< 0.001
Note: Firesetting measures employ residualized scores controlling for impression management.

Development of a New Firesetting Questionnaire

EFA was used on one half of the community sample (N = 701) to identify the latent constructs underpinning firesetting for subscale development, identify potentially weaker psychometric items that did not load on a given factor, and to prune down the scale to a manageable length. This analysis suggested the retention of 90-items arranged into eight factors (see Table 4). These factors were labelled firesetting as normal (5 items), identification with fire (8 items), fire interest (21 items), fire safety (9 items), pathological fire interest (4 items), coping using fire (12 items), fire is a powerful messenger (21 items), and fascination with fire paraphernalia (10 items). Note that we removed one overlooked duplicate item from Factor 7 (i.e., “Setting a deliberate fire is a good way to tell people you need help”). The final model fit was strong (CFI = 0.90; TLI = 0.87; RMSEA = 0.04; 95% CI. 0.039, 0.042), χ2 / df ratio = 7279.30/3395 = 2.14. Attempts to extend the solution beyond eight factors yielded diminished returns, specifically, factors extracted tended not to have any items loading highly and thus appeared to be pseudo factors. These factors improved model fit in theory but offered little additional information to the eight-factor solution.
Table 4
Study 1 EFA Factor Loading Matrix of Firesetting Questionnaire Items
Item and Factor Label
EFA Loading
CFA Loading
Factor 1: Firesetting as Normal (5 items)
 
Most people have set a few small fires just for fun
.831
.815
Most people's friends have lit a fire or two
.778
.750
All people have misused fire as an adult at some point in their lives
.575
.628
Most people have been questioned about fires by the police
.486
.454
Most families have had a fire accident at home
.435
.425
Factor 2: Identification with Fire (8 items)
 
I need fire in my life
.787
.659
Fire is an important part of my life
.718
.766
I have to have fire in my life
.709
.715
Fire is a part of me
.585
.808
Fire is an important part of my identity
.515
.797
Without fire, I am nobody
.458
637
Fire is almost part of my personality
.428
.777
I don't need fire*
− .634
− .451
Factor 3: Fire Interest (21 items)
 
I like watching fire
.926
.823
I like to watch and feel fire
.879
.783
I find fire intriguing
.800
.820
I am fascinated by fire
.789
.830
I like watching fire
.780
.775
I am attracted to fire
.721
.842
I like to feel the heat from fire
.715
.642
The best thing about fire is watching the colors and flames
.685
.630
I am mesmerized by fire
.630
.771
Watching even a small fire makes me happy
.632
.743
I have a strong interest in fire
.576
.760
I find any fire I look at incredibly soothing
.579
.678
Watching an ordinary coal, wood, or gas fire burn
.570
.379
Watching a bonfire outdoors, like on bonfire night
.523
.452
For me, fire is comforting
.590
.693
I like the smell of smoke from a fire
.511
.476
I always feel better when I am looking at a fire
.496
.702
I get excited thinking about fire
.461
.741
If I ever see a garden fire or bonfire unexpectedly I stay to watch it
.449
.575
Lighting a fire or a couple of candles can make a room look nicer
.445
.337
I enjoy seeing how fire melts/destroys things
.419
.645
Factor 4: Fire Safety (9 items)
 
I know a lot about fire safety
.732
.734
I could teach others a lot about fire safety
.720
.738
I know a lot about how to prevent fires
.691
.696
I know how to stop a fire from spreading
.643
.685
If my room caught fire, I would have the skills to get out safely
.639
.638
If a fire broke out I would be able to stay cool under the pressure
.543
.626
People would turn to me for help if a fire broke out
.516
.587
If I set a fire, I would have the skills to control it
.428
.536
If a fire broke out in my home I would panic and not know what to do*
− .565
− .645
Factor 5: Pathological Fire Interest (4 items)
 
Watching a house burn down
.621
.690
Seeing a hotel on fire in the TV news
.560
.675
Watching people run from a fire
.563
.653
Seeing firemen hosing a fire
.460
.502
Factor 6: Coping using Fire (12 items)
 
I feel like I am more interested in fire than other people
.630
.723
I sometimes worry that I am too excited by fire
.625
.681
I have always felt like my relationship with fire is different to that of other people
.580
.646
Setting a deliberate fire would calm me down if I were stressed
.557
.734
I set fires to unwind
.552
.588
For me, setting a deliberate fire gets rid of tension
.536
.716
Looking at fire is the only thing that calms me down
.532
.633
Messing around with fire takes my mind off things that are bothering me
.527
.742
If I had a problem, setting a small fire would make me feel a lot better
.520
.721
I am more interested in watching fire than the average person
.502
.731
If I was watching an empty building catch fire, I would be disappointed if the fire brigade showed up
.478
.555
I have sometimes downplayed my interest in fire to other people
.471
.693
Factor 7: Fire is a Powerful Messenger (21 items)
 
Setting a deliberate fire is the best way to send people a strong message
.725
.692
Setting a deliberate fire is a good way to show people not to mess with you
.724
.741
Setting a deliberate fire gets you the help you need
.679
.670
Setting a deliberate fire is a good way to tell people you need help
.668
.626
Setting a deliberate fire is a powerful way of getting back at someone
.646
.584
If someone sets a deliberate fire, other people realize they need to pay attention to what that person has to say
.648
.525
Setting a deliberate fire is a great way to get revenge
.635
.707
Setting a deliberate fire sends a powerful message of revenge
.622
.483
Making threats about setting a deliberate fire is the best way to scare others
.604
.524
Fire is a great way to show your distress to others
.600
.636
People respect you if they think you might set a deliberate fire
.575
.726
Fire will get a person what they want
.573
.687
For me, fire is a powerful tool for getting your own way
.574
.711
Setting a deliberate fire allows me to be taken seriously
.574
.709
Setting a deliberate fire is a good way to show people who’s boss
.545
.792
Setting a deliberate fire is a good way to show people how you feel
.539
.686
When someone sets a deliberate fire, other people give them the kind of attention they were looking for
.532
.446
If a person mentions setting a deliberate fire, people do what that persons wants
.502
.498
Unexpected fires are useful because they create a scene
.476
.621
Fire will get me attention
.451
.413
I imagine that setting a fire would be a good way of ending your own life
.411
.350
Factor 8: Fascination with Fire Paraphernalia (10 items)
 
I get excited when I see fire fighters turning up to a fire
.778
.807
I feel excited when I hear fire engine sirens
.720
.768
Seeing the fire service attending a fire is exciting
.682
.778
I love watching fire fighters putting out fire
.648
.715
I often find myself staring at a fire engine if I see one
.649
.611
I am more interested in fire engines than the average person
.604
.641
I stop to watch fire engines when I see them coming down the road
.594
.620
I am more interested in the fire service/brigade than the average person
.540
.592
Watching a fire engine come down the road
.539
.511
Seeing firemen get their equipment ready
.508
.516
CFA was conducted on the second half of the community sample (N = 701) to test a correlated eight factor solution. The CFA without modification generated an acceptable fit (CFI = 0.80; TLI = 0.80; RMSEA = 0.05; 95% CI. 0.049, 0.051), χ2 / df ratio = 10960.437/3976 = 2.76. Due to the lengthy nature of the scale, CFI and TLI values were below the conventional 0.90 to 0.95 threshold although RMSEA values were within the acceptable threshold, as well as a small χ2 / df ratio indicating close fit between the CFI model and the data. Table 4 presents the standardized CFA results with standardized item loading parameters (ranging between − 1.0 and + 1.0) presented. All loadings were significant at p < .001.

Convergent Validity and Internal Consistency of Test Item Content

Table 5 shows the inter-factor associations generated from the eight-factor solution for the EFA (top diagonal) and the CFA (lower diagonal), with Cronbach alpha values for the aggregate sample on the principal diagonal. Broadly, moderate in magnitude associations were found for the factors generated from the EFA, with the exceptions of Factors 4 (Fire Safety) and 5 (Pathological Fire Interest), which had small in magnitude associations with most factors. A similar pattern of associations were found among the factors generated from CFA, however, these tended to be moderate to large in magnitude and these were slightly higher than observed in the EFA. The Firesetting Questionnaire Total had excellent internal consistency (α = 0.96, MIC = 0.24), demonstrating a high level of interrelatedness of test item content in measuring the psychological dimensions of the firesetting construct. The internal consistency properties also extended to each of the eight factors, with moderate to high alpha values observed. Finally, the item total correlations ranged from a low of 0.20 to well over 0.50 (see Supplemental Table S1) indicating that each item is measuring the same overall construct as the scale as a whole.
Table 5
Study 1 Inter-factor Associations for 8-Factor EFA (Upper Diagonal) and CFA (Lower Diagonal) Solutions
 
F1
F2
F3
F4
F5
F6
F7
F8
F1 Firesetting as normal
(0.77)
0.347
0.281
0.175
0.126
0.447
0.404
0.241
F2 Identification with fire
0.454
(0.87)
0.414
0.224
0.074
0.479
0.355
0.325
F3 Fire interest
0.362
0.533
(0.95)
0.284
0.308
0.324
0.264
0.436
F4 Fire safety
0.213
0.224
0.305
(0.86)
0.089
0.132
0.053
0.214
F5 Pathological fire interest
0.382
0.430
0.548
0.249
(0.71)
0.112
0.188
0.076
F6 Coping using fire
0.529
0.768
0.611
0.248
0.625
(0.91)
0.486
0.307
F7 Fire is a powerful messenger
0.445
0.537
0.301
0.118
0.508
0.712
(0.92)
0.298
F8 Fascination with fire paraphernalia
0.381
0.430
0.604
0.274
0.569
0.589
0.427
(0.89)
Note: Associations 0.10 or greater are significant at p < .05. All associations on lower diagonal significant at p < .001, except F4 with F7 (p = .004). Cronbach alpha values for a given factor in parentheses (aggregate sample) on the principal diagonal

Discrimination Ability

Although our univariate comparison did not illustrate any notable difference between the study groups regarding IM (see Table 1), there was a significant positive relationship between IM and the Firesetting Questionnaire Total, r = .23, n = 1402, p < .001. Because of this, residualized factor scores were obtained to control for IM in analyses examining discriminative ability5. Table 3 presents the AUC values for the Firesetting Questionnaire factor and total scores in the discrimination of individuals with a self-reported history of firesetting versus those without. Like the Five Factor Fire Scale (Ó Ciardha et al., 2015), the Firesetting Questionnaire Total score demonstrated large magnitude effects for accurately identifying people with a history of firesetting. Factors 1 (Firesetting as Normal), and 6 (Coping using Fire) had large effects, while the remaining factors had small to moderate effects; all AUCs were significant. This discrimination performance was enhanced relative to that demonstrated by the Five Factor Fire Scale (Ó Ciardha et al., 2015; see Table 3). To further compare the discrimination performance of the Firesetting Questionnaire relative to the original Five Factor Fire Scale, Firesetting Questionnaire and Five Factor Fire Scale factors were entered simultaneously into the regression to examine which factors uniquely and incrementally predicted a self-reported history of firesetting whilst controlling for all other factors (see Table 6). Table 6 is arranged so that analogous Firesetting Questionnaire and Five Factor Fire Scale factors are paired for the first fire factors, while factor domains unique to the Firesetting Questionnaire (factors 6–8) are presented at the bottom of the table. Only the Firesetting Questionnaire factors significantly and uniquely predicted firesetting status. The relevant factors were factor 1 (firesetting as normal), factor 4 (fire safety), and factor 6 (coping using fire) which also had the strongest bivariate associations in the ROC analysis. Factor 2 (identification with fire) was inversely associated with firesetting status when all other factors were controlled.
Table 6
Study 1 Incremental Validity Analyses: Logistic Regression of the Firesetting Questionnaire (FQ) and Five Factor Fire Scales (FFS)
Factor label
Measure
B
SE
Wald
P
e B
95% CI
Firesetting as normal
FQ F1
0.252
0.056
20.30
< 0.001
1.286
1.153, 1.435
 
FFS F5
0.076
0.047
2.58
0.108
1.079
0.983, 1.184
Identification with fire
FQ F2
− 0.207
0.063
10.81
0.001
0.813
0.719, 0.920
 
FFS F1
0.053
0.058
0.84
0.361
1.054
0.941, 1.180
Everyday (fire interest)
FQ F3
0.003
0.011
0.57
0.811
1.003
0.982, 1.023
 
FFS F4
0.033
0.058
0.34
0.562
1.034
0.924, 1.157
Fire safety
FQ F4
0.072
0.021
11.48
0.001
1.075
1.031, 1.121
 
FFS F3
0.012
0.053
0.05
0.829
1.012
0.910, 1.125
Pathological/Serious fire interest
FQ F5
− 0.088
0.132
0.44
0.506
0.916
0.707, 1.186
 
FFS F2
0.070
0.091
0.58
0.446
1.072
0.896, 1.282
Coping using fire
FQ F6
0.125
0.028
19.65
< 0.001
1.134
1.072, 1.198
Fire is a powerful messenger
FQ F7
− 0.011
0.012
0.81
0.368
0.989
0.967, 1.013
Fascination with fire paraphernalia
FQ F8
− 0.035
0.020
2.88
0.090
0.966
0.928, 1.005
Note: factors are residualized scores controlling for Impression Management score

Study 2

Method

Participants

A total of 141 participants were recruited from prison establishments and the community (49 imprisoned males holding a record of firesetting, 62 imprisoned males without a record of firesetting, 30 community male comparisons). To be eligible for the study, participants had to be male adults (i.e., ≥ 18 years) and to comprehend and speak English sufficiently to understand questionnaires. The imprisoned samples were recruited from one English prison establishment. Within the prison setting, participants experiencing active mania, psychosis, suicidal ideation, or at risk of hostage taking were excluded and no incentives were provided to partake in the study. Males holding a record of firesetting were selected from institutional file records indicating either a conviction for firesetting (i.e., arson) or prison firesetting activity (e.g., prison documented cell fires). Non-firesetting imprisoned males were selected to match imprisoned males with a documented firesetting history on age and wing as closely as possible. Each non-firesetting participant’s prison records were checked to ensure that they held no convictions or adjudications associated with deliberate firesetting. Although formal refusal rates were not possible to obtain from participating prisons, using our individual records we estimate that the participation rate was over 80%. Community participants were recruited from the same English county as the imprisoned participants using posters and flyers around a university campus and nearby City. These individuals were paid £10 for their participation and completed the measures under the same conditions as their imprisoned counterparts (i.e., items were read out loud to them in a private room). Analyses indicated demographic differences across the groups on almost every variable (see Table 7). Many of these differences were associated with the community sample who—relative to the prison samples—were highly educated, more likely to be in full time employment, and less likely to hold a clinical diagnosis.
Table 7
Study 2 Descriptive Statistics and Group Comparisons on Demographic, Diagnostic/Clinical, and Firesetting Variables
Measure
Community comparisons
(n = 30)
 
Prison comparisons
(n = 62)
 
Recorded firesetters
(n = 49)
χ2/F
φ/partial η22
M (SD)
% (n)
 
M (SD)
% (n)
 
M (SD)
% (n)
Demographic
          
 Age
23.9 (10.8)b
-
 
34.4 (8.5)a
-
 
33.3 (7.2)a
-
16.19***
0.19
 Employed
-
100.0 (30)
 
-
56.5 (35)
 
-
42.9 (21)
26.50***
− 0.43
 Post-secondary education
-
90.0 (27)
 
-
22.6 (14)
 
-
18.4 (9)
49.74***
− 0.59
 White
-
63.3 (19)
 
-
55.0 (33)
 
-
81.6 (40)
8.69*
0.25
 Single
-
63.3 (19)
 
-
41.0 (25)
 
-
32.7 (16)
7.31*
− 0.23
Diagnostic/clinical
          
 Any NSMH diagnosis
-
6.7 (2)
 
-
37.1 (23)
 
-
73.5 (36)
35.54***
0.50
 Personality disorder
-
0.0 (0)
 
-
9.7 (6)
 
-
36.7 (18)
22.00***
0.40
 Mood disorder
-
3.3 (1)
 
-
12.9 (8)
 
-
38.8 (19)
18.05***
0.36
 Anxiety disorder
-
6.7 (2)
 
-
8.1 (5)
 
-
26.5 (13)
9.44**
0.26
 Psychosis
-
0.0 (0)
 
-
1.6 (1)
 
-
10.2 (5)
6.65*
0.22
 PTSD
-
0.0 (0)
 
-
14.5 (9)
 
-
10.2 (5)
4.77
0.18
 Substance use disorder
-
3.3 (1)
 
-
43.5 (27)
 
-
77.1 (37)
40.74***
0.54
 Dual diagnosis
-
0.0 (0)
 
-
25.8 (16)
 
-
62.5 (30)
35.20***
0.50
 Full scale IQ
108.6 (13.3)b
-
 
83.0 (11.4)a
-
 
80.0 (13.1)a
-
56.27***
0.45
Firesetting history
          
 Any childhood firesetting
-
16.7 (5)
 
-
32.3 (20)
 
-
61.2 (30)
17.65***
0.17
 Total childhood firesetting
0.9 (3.7)b
-
 
3.5 (13.3)b
-
 
76.2 (310.4)a
-
23.62***
0.04
 Any adult firesetting
-
10.0 (3)
 
-
0.0 (0)
 
-
91.8 (45)
112.62***
0.77
 Total adult firesetting
0.4 (1.8)b
-
 
0.0 (0.0)b
-
 
34.1 (146.9)a
-
107.31***
0.03
 Lifetime fire total
1.3 (5.5)b
-
 
3.5 (13.3)b
-
 
110.3 (377.2)a
-
63.13***
0.45
Note: *** p < .001, **p < .01, * p < .05. φ is measure of effect size for categorical variables; partial η2 for normally distributed continuous variables and ε2 for continuous variables that were non-normally distributed. Means with different subscripts differ at the p = .05 level using Bonferroni’s test. A Kruskal-Wallis test was used for total childhood firesetting, total adult firesetting, and lifetime fire total due to the non-normal distribution of data for these variables. Any NSMH diagnosis refers to any non-specific mental health diagnosis

Measures and Procedure

All participants were tested individually in a private room and measures were read aloud to participants to aid comprehension. Demographic information was collected first using a questionnaire developed by the authors. This recorded information about age, employment, ethnicity, formal education, relationship status, mental health diagnoses, and offense history. In addition, it recorded self-reported childhood and adult deliberate firesetting not captured by the offense history and examined whether the participant had ever used fire to intentionally harm another individual. The Wechsler Abbreviated Scale of Intelligence-second edition (WASI-II; Wechsler 2011) was also administered to gain an estimation of full-scale IQ (FSIQ) using the two-subtest form. Participants were then administered the new firesetting questionnaire produced from the EFA and CFA in Study 1. Following data collection, we noticed that the Factor 7 item “I imagine that setting a fire would be a good way of ending your own life” was mistakenly replaced with an item ruled out in the Study 1 factor analysis. Thus, the number of bona fide items administered to Study 2 participants was 89. Item order was not randomized.

Analysis Plan

We adhered to the analysis strategy outlined in our Study 2 preregistered plan using Mplus 7.4 (Muthén & Muthén, 2015) and SPSS for Windows version 25.0 (IBM Corp., 2017) whilst also undertaking two additional analyses (correlations and MANCOVAs) to assess construct and discrimination ability respectively. First, we computed a correlation matrix of factor scores from the firesetting questionnaire as well as internal consistencies (Cronbach’s α) to measure the interrelatedness of item content within each domain and the questionnaire as a whole. Here, correlation magnitudes were interpreted using Cohen’s (1988) conventions of 0.10, 0.30, and 0.50 to represent small, medium, and large effects respectively. MANCOVA was used to compare the three criterion groups whilst controlling for selected continuous variables that differentiated the participant groups in Table 7 and which could, theoretically, be linked to firesetting behavior (i.e., age, FSIQ, and firesetting history). To do this we conducted a MANCOVA with the firesetting questionnaire factors and total score as the dependent variables and age and FSIQ as covariates. At the second step, we repeated this analysis using lifetime firesetting history as a third covariate to control for variation in firesetting history density. We then conducted simple contrasts; comparing each of the comparison groups to the individuals who had set fires and used Cohen’s d conventions of 0.20, 0.50, and 0.80 to aid our interpretations of small, medium, and large effects respectively.
Our remaining analyses—as an extension to our pre-registered analysis plan—were conducted on the aggregate sample given that some individuals in the “comparison” groups disclosed a history of firesetting in childhood, adulthood, or both. ROC curves were plotted to examine how well the overall questionnaire and each of its subscales differentiated according to the binary firesetting criteria of: any childhood firesetting, any adult firesetting, convicted for firesetting, and firesetting with intent to harm. AUC statistics were computed and interpreted per the Rice and Harris (2005) guidelines as previously noted. Finally, regression analyses were conducted to examine which firesetting questionnaire factors incrementally predicted firesetting whilst controlling for the other questionnaire factors as well as age and FSIQ. Firesetting history—both child and adult—was an over-dispersed count variable, ranging from one or a few fires to thousands. As such, negative binomial regression was conducted to examine the unique associations of firesetting questionnaire factor scores for childhood and adult counts of firesetting with the age and IQ controls. Negative binomial regression generates regression coefficients (B and eB). These represent the amount of change predicted in the count variable (in log units), per one unit change in the predictor, controlling for other predictors. A further logistic regression was conducted examining the same model predictors for binary firesetting status (i.e., convicted firesetting versus membership in the combined comparison groups). The regression coefficients (B and eB) in logistic regression are interpreted as the percent increase in the odds of a binary outcome (e.g., firesetting group membership) per one-unit change in a given predictor, controlling for all other predictors.

Results

Table 8 displays the correlations between the firesetting questionnaire’s subscales as well as internal consistency figures. The majority of associations are significant and of a moderate to large effect size. Yet, these factor correlations were not so large as to create a problem with multicollinearity. The only exception was fire safety which held some non-significant associations. Cronbach’s alphas generally ranged from questionable (0.65; firesetting as normal) to excellent (0.95; fire interest and fire is a powerful messenger) with total alpha being very high (0.97). Pathological fire interest generated a very low alpha of 0.55 which may have been attributable to this factor having only four items6.
Table 8
Study 2 Correlation Matrix and Internal Consistency of Fire Questionnaire Factor and Total Scores
Fire Questionnaire (FQ) measure
Firesetting as normal
Identification with fire
Fire interest
Fire safety
Pathological fire interest
Coping using fire
Fire is a powerful messenger
Fascination with fire paraphernalia
FQ total
Firesetting as normal
(0.65)
        
Identification with fire
0.41***
(0.87)
       
Fire interest
0.40***
0.44***
(0.95)
      
Fire safety
0.25**
0.09
0.22*
(0.85)
     
Pathological fire interest
0.22*
0.35***
0.49***
0.09
(0.55)
    
Coping using fire
0.47***
0.62***
0.74***
0.12
0.48***
(0.93)
   
Fire is a powerful messenger
0.48***
0.52***
0.50***
0.16
0.49***
0.72***
(0.95)
  
Fascination with fire paraphernalia
0.41***
0.30***
0.40***
0.00
0.25**
0.43***
0.31***
(0.86)
 
 FQ total
0.61***
0.65***
0.85***
0.34***
0.57***
0.88***
0.82***
0.54***
(0.97)
  Mean
13.5
13.7
52.1
29.8
7.1
20.4
36.8
21.6
195.1
  SD
3.9
5.5
17.3
7.5
2.5
8.7
15.3
7.0
48.5
  Items
5
8
21
9
4
12
20
10
89
Note: *** p < .001, **p < .01, * p < .05. Cronbach’s alpha in parentheses on the principal diagonal.

Discriminative Ability

Table 9 presents the results of the MANCOVA with group simple contrasts whilst controlling for the covariates of age and FSIQ or age, FSIQ, and firesetting history. When controlling for age and FSIQ, those holding a record of firesetting scored higher than both the prison and community comparisons on identification with fire, coping using fire, and fire is a powerful messenger with effect sizes that were broadly moderate in magnitude (about 0.50 standard deviations). Individuals holding a record of firesetting also scored higher than the prison comparisons on fire interest and the firesetting questionnaire total when both age and FSIQ were controlled for. When an additional third covariate was controlled for—firesetting history— those holding a record of firesetting scored higher than prison comparisons with moderate effects (d = 0.40-0.51) on pathological fire interest, coping using fire, fire is a powerful messenger, and the firesetting questionnaire total. Although differences remained from community comparisons upward of a third of a standard deviation on the three domains previously found significant, these were no longer significant after adding firesetting history as a covariate.
Table 9
Study 2 Fire Questionnaire MANCOVA with Group Simple Contrasts and Standardized Mean Difference (d) Controlling for Relevant Covariates
 
Group
 
MANCOVA group simple contrasts d (p-value)
Fire Questionnaire (FQ) measure
Community comparisons
 
Prison comparisons
 
Recorded firesetters
 
Covariates: age and IQ
 
Covariates: age, IQ, and firesetting history
 
M (SD)
 
M (SD)
 
M (SD)
 
Cc v. Fs
Oc v. Fs
 
Cc v. Fs
Oc v. Fs
Fire as normal
12.3 (3.4)
 
13.3 (3.8)
 
14.5 (4.1)
 
0.04 (0.871)
0.24 (0.222)
 
0.00 (0.995)
0.20 (0.306)
Identification with fire
11.6 (4.0)
 
13.2 (4.2)
 
15.6 (7.0)
 
0.56 (0.018)
0.43 (0.028)
 
0.36 (0.128)
0.24 (0.221)
Fire interest
60.9 (17.2)
 
46.2 (12.2)
 
54.2 (20.2)
 
0.01 (0.951)
0.52 (0.008)
 
-0.15 (0.523)
0.37 (0.051)
Fire safety
29.3 (7.6)
 
30.2 (7.6)
 
29.7 (7.3)
 
-0.17 (0.454)
-0.05 (0.805)
 
-0.19 (0.420)
-0.06 (0.745)
Pathological fire interest
7.5 (2.2)
 
6.5 (1.7)
 
7.8 (3.2)
 
0.25 (0.276)
0.55 (0.005)
 
0.10 (0.667)
0.42 (0.032)
Coping using fire
18.8 (7.6)
 
18.3 (5.2)
 
24.0 (11.4)
 
0.51 (0.030)
0.65 (0.001)
 
0.32 (0.168)
0.51 (0.009)
Fire is a powerful messenger
31.1 (12.4)
 
34.4 (11.7)
 
43.3 (18.6)
 
0.55 (0.021)
0.58 (0.003)
 
0.38 (0.104)
0.43 (0.028)
Fascination with fire paraphernalia
20.4 (7.9)
 
21.9 (7.0)
 
22.0 (6.6)
 
0.08 (0.744)
0.01 (0.970)
 
0.01 (0.984)
-0.07 (0.712)
 FQ total
191.9 (40.9)
 
184.0 (34.5)
 
211.0 (62.6)
 
0.32 (0.166)
0.56 (0.004)
 
0.14 (0.561)
0.40 (0.041)
Note: Community comparisons n = 30, Prison comparisons n = 62, Recorded firesetters n = 49. Reported group M (SD) are actual observed scores on the FQ and its subscales. Significant group contrasts after controlling for relevant covariates (d [p-value]) in bold font.
Table 10 illustrates the bivariate associations between the firesetting questionnaire factor and total scores with various firesetting criteria through ROC and correlational analyses. The firesetting questionnaire total score was significantly associated with all of the firesetting criteria with moderate to large effects. In terms of the individual factors, coping using fire and fire is a powerful messenger each had significant moderate to large associations with each firesetting criterion variable (0.36 to 0.76). Particularly strong associations were apparent with the criterion variable of having intent to harm someone with firesetting (0.74 and 0.76 respectively). In contrast, the individual factor of fire safety was not associated with any of the firesetting criterion variables better than chance. The remaining factors were somewhere in between—identification with fire and fire interest had moderate associations with variables indicative of early onset and long duration of firesetting. Identification with fire also predicted adult firesetting and fire interest predicted having set a fire with the deliberate intent to harm someone. The individual factor of firesetting as normal had significant moderate associations with both childhood and adult firesetting (0.69 and 0.63 respectively) whilst fascination with fire paraphernalia had significant associations only with childhood firesetting (0.66).
Table 10
Study 2 Bivariate Associations between Fire Questionnaire Scores with Firesetting Criteria
Fire Questionnaire (FQ) measure
Childhood firesetting
 
Adult firesetting
 
Fire conviction
 
Intent harm
 
Lifetime fires set
 
Age span fires set
AUC [95%CI]
 
AUC [95%CI]
 
AUC [95%CI]
 
AUC [95%CI]
 
r [95%CI]
 
r [95%CI]
Firesetting as normal
0.69***
[0.60, 0.78]
 
0.63*
[0.53, 0.73]
 
0.60
[0.47, 0.73]
 
0.65
[0.46, 0.85]
 
0.08
[-0.09, 0.24]
 
0.20
[-0.04, 0.41]
Identification with fire
0.64**
[0.55, 0.74]
 
0.63*
[0.53, 0.73]
 
0.64*
[0.50, 0.79]
 
0.64
[0.39, 0.89]
 
0.44***
[0.30, 0.56]
 
0.24*
[0.01, 0.45]
Fire interest
0.66***
[0.56, 0.76]
 
0.57
[0.47, 0.68]
 
0.57
[0.40, 0.74]
 
0.73*
[0.46, 0.99]
 
0.30***
[0.14, 0.44]
 
0.30*
[0.07, 0.50]
Fire safety
0.49
[0.39, 0.59]
 
0.48
[0.38, 0.58]
 
0.49
[0.35, 0.64]
 
0.49
[0.30, 0.69]
 
0.02
[-0.15, 0.19]
 
0.07
[-0.17, 0.30]
Pathological fire interest
0.67***
[0.58, 0.76]
 
0.60*
[0.50, 0.71]
 
0.64
[0.49, 0.78]
 
0.87***
[0.77, 0.96]
 
0.32***
[0.16, 0.46]
 
0.20
[-0.04, 0.41]
Coping using fire
0.68***
[0.59, 0.77]
 
0.65**
[0.54, 0.75]
 
0.65*
[0.50, 0.81]
 
0.74*
[0.51, 0.97]
 
0.42***
[0.27, 0.55]
 
0.36**
[0.14, 0.55]
Fire is a powerful messenger
0.72***
[0.63, 0.81]
 
0.69***
[0.59, 0.79]
 
0.66*
[0.51, 0.80]
 
0.76*
[0.58, 0.94]
 
0.36***
[0.21, 0.50]
 
0.43***
[0.22, 0.60]
Fascination with fire paraphernalia
0.66**
[0.56, 0.75]
 
0.57
[0.47, 0.67]
 
0.55
[0.41, 0.69]
 
0.51
[0.30, 0.71]
 
0.13
[-0.04, 0.29]
 
0.03
[-0.21, 0.26]
FQ total
0.71***
[0.62, 0.81]
 
0.66***
[0.55, 0.76]
 
0.65*
[0.48, 0.81]
 
0.73*
[0.48, 0.97]
 
0.39***
[0.24, 0.52]
 
0.37***
[0.15, 0.56]
Note: *** p < .001, **p < .01, * p < .05. n = 141 except for Pathological Fire Interest (n = 139), intent harm (n = 105), and age span fires set (n = 71).

Discussion

In this research, across two studies, we developed and validated a Firesetting Questionnaire to measure fire-related dynamic risk factors. In the first study, we presented community participants with pre-existing measures (i.e., the Fire Setting Scale; Gannon & Barrowcliffe, 2012 and the Five Factor Fire Scales; Ó Ciardha, Barnoux et al., 2015) alongside a set of new items designed to reflect latest available firesetting theory. Compared with the original Five Factor Fire Scales, the factor analyses of the Firesetting Questionnaire produced a stronger model fit suggesting that it represents a more adequate assessment of fire-specific constructs. Exploratory and confirmatory factor analyses showed that the Firesetting Questionnaire measures eight key constructs (i.e., firesetting as normal, identification with fire, fire interest, fire safety, pathological fire interest, coping using fire, fire is a powerful messenger, and fascination with fire paraphernalia) with acceptable convergent test item validity and acceptable to excellent internal consistencies (αs = 0.71 to 0.95; George & Mallery 2003). In terms of discriminative ability, the new Firesetting Questionnaire illustrated stronger performance than the Five Factor Fire Scales (Ó Ciardha, Barnoux et al., 2015) since only the Firesetting Questionnaire subscales of firesetting is normal, fire safety, and coping using fire uniquely predicted firesetting status when controlling for impression management. These findings broadly concur with our preregistered predictions. They suggest that both the Five Factor Fire Scales (Ó Ciardha, Barnoux et al., 2015) and the Firesetting Questionnaire have replicable factor structures. However, the findings regarding discriminative ability suggest that the Five Factor Fire Scales (Ó Ciardha, Barnoux et al., 2015) lack the item diversity required to adequately represent contemporary firesetting theory (Butler & Gannon, 2015; Gannon et al., 2022; Ó Ciardha & Gannon, 2012).
In the second study, we further explored the psychometric properties of the Firesetting Questionnaire using criterion groups drawn from a prison and the community. Generally, the new questionnaire exhibited good convergent validity and, with the exception of the firesetting as normal and pathological fire interest subscales, internal consistency was high (αs = 0.85 − 0.97). Men in prison who had a record of firesetting scored higher on various subscales relative to the criterion groups when controlling for age and FSIQ. When stricter measures were put in place, (i.e., controlling for firesetting history in addition), only the imprisoned men’s scores differed. In particular, imprisoned men who had a firesetting record scored higher on the pathological fire interest, coping using fire, and fire is a powerful messenger subscales in addition to the Firesetting Questionnaire total score. Since individuals in both the imprisoned and community groups disclosed some history of firesetting, ROC curves were plotted to assess the Firesetting Questionnaire’s association with firesetting criteria. The total score was moderately to strongly associated with the presence of childhood or adult firesetting, holding a firesetting conviction, and intending to harm someone when firesetting. In terms of individual subscales, coping using fire and fire as a powerful messenger showed the best associations with firesetting criteria and the fire safety subscale showed the poorest. Overall, the findings from Study 2 provide evidence to support the psychometric robustness of the Firesetting Questionnaire with an imprisoned sample. In fact, the subscales of coping using fire and fire is a powerful messenger—reflecting content not included in previous questionnaires—performed particularly well as discriminatory measures.
When examining the overall pattern of results across Studies 1 and 2, the internal validity of the overall Firesetting Questionnaire was consistently excellent (Study 1 α = 0.96, Study 2 α = 0.97) illustrating a high level of interrelatedness of overall test item content across both community and imprisoned samples of participants. The total score illustrated strong discrimination ability across both studies and was a robust predictor of firesetting in childhood and adulthood, any firesetting conviction, and intent to harm others with firesetting (Study 2). Taken together, these results suggest that the Firesetting Questionnaire as an overall measure can be used with both community and imprisoned samples and that this measure is likely to be useful for predicting firesetting behavior across the lifespan as well as firesetting characterized by intent to harm.
Across studies, there were four occasions when we deviated from our preregistration plan. On two occasions, we made minor alterations to our preregistration procedure since we felt these alterations made sense in the context of our findings (i.e., choosing to retain one outlier that did not impact the pattern of results and dropping EFA values loading < 0.40 for Study 1). On the other two occasions, we incorporated additional analyses to further explore construct and discriminative ability (Study 1 Binary regression, Study 2 Correlation and MANCOVA).

Firesetting Questionnaire Content

The factor structure of the Firesetting Questionnaire elucidated in Study 1 mirrored that of the existing Five Factor Fire Scales (Ó Ciardha, Barnoux et al., 2015) to some degree. Three of the Firesetting Questionnaire subscales (firesetting as normal, identification with fire, pathological fire interest) shared notable portions (4, 7, 4) of original item content from the Five Factor Fire Scales of firesetting as normal, identification with fire, and serious fire interest respectively (Ó Ciardha, Barnoux et al., 2015). Two of the Firesetting Questionnaire subscales (fire interest and fire safety) reflected the general concepts of the original subscales featured in the Five Factor Fire Scales (Ó Ciardha, Barnoux et al., 2015) using generally new question content. The incremental validity analyses conducted in Study 1 indicated that the Firesetting Questionnaire versions of the firesetting as normal, identification with fire, and fire safety subscales held discriminative ability that was not demonstrated by the equivalent factors of the Five Factor Fire Scales (Ó Ciardha, Barnoux et al., 2015).
Perhaps the most interesting outcomes, theoretically, related to the three new subscales (coping using fire, fire is a powerful messenger, and fascination with fire paraphernalia) elucidated by the Firesetting Questionnaire factor structure. The coping using fire subscale was comprised of 12 items reflecting an interest in fire misuse to cope with stress and improve affect. These items fit broadly with the theoretical construct of a fire coping script (Butler & Gannon, 2015; Gannon et al., 2012) in which fire is cognitively relied upon to cope with life events, problems, and associated negative affect (e.g., ‘I set fires to unwind’, ‘If I had a problem, setting a small fire would make me feel a lot better’). The fire is a powerful messenger subscale also fits broadly with the theoretical construct of an inappropriate fire script since it encapsulates cognitions around fire misuse being a powerful method of indicating distress, gaining attention, or sending a powerful message of revenge (e.g., ‘Fire is a great way to show your distress to others’, ‘Fire will get me attention’, ‘Setting a deliberate fire is a great way to get revenge’). This subscale appears to tap into two key scripts: the aggression-fire fusion script proposed by Gannon et al. (2012) and the fire is a powerful messenger script (Butler & Gannon, 2015). To our knowledge, both the coping using fire and fire is a powerful messenger subscales represent the first self-report measures developed to tap into the theoretical construct of inappropriate firesetting scripts proposed by Gannon and colleagues (Butler & Gannon, 2015; Gannon et al., 2012; Gannon et al., 2022).
The third new subscale to emerge examines fascination with fire paraphernalia (e.g., ‘I often find myself staring at a fire engine if I see one’). The emergence of this subscale suggests that fascination with fire and fire-related paraphernalia represent two distinct constructs that may require separate assessment both academically and clinically. Notably, previous measures have tended to combine these concepts (Murphy & Clare, 1996; Ó Ciardha, Barnoux et al., 2015).
When examining the performance of the Firesetting Questionnaire subscales across Studies 1 and 2, the data from our unapprehended sample suggest that viewing firesetting to be a relatively usual occurrence, perceived fire safety awareness, and a preference to use fire to cope emerged as key predictors of firesetting behavior. This suggests that individuals who have not been detected for their community firesetting behavior reside in neighborhoods in which fire misuse is prevalent, believe themselves to be knowledgeable about fire, and use fire to alleviate negative affect. Previous research examining unapprehended samples who have set deliberate fires has indicated that they are characterized by having family members who have set fires (Barrowcliffe & Gannon, 2015, 2016) as well as antisocial attitudes and associates (Barrowcliffe & Gannon, 2016). This suggests that social learning variables (Jackson et al. 1987) and attitudes supporting antisocial behavior (Gannon et al., 2012) may be important etiological factors in the sequelae of unapprehended firesetting. Given the unapprehended individuals who self-reported firesetting reported themselves to be proficient in fire safety, it may be that they have developed some level of proficiency at evading detection. Future research efforts might seek to examine expertise in this group (see Butler & Gannon, 2015, 2021) and in particular any methods used to evade detection.
By comparison, the data reported in Study 2 showed that holding an identification with fire, believing fire to be a powerful messenger, and coping using fire emerged as key associates of holding a firesetting conviction. This suggests that individuals who have been detected for their firesetting behavior view fire as a central aspect of their life and personal identity, use fire as a powerful method of indicating distress, gaining attention, or enacting revenge, and view fire as a way of alleviating negative affect. While using fire to cope appears to be a sentiment shared with individuals who remain unapprehended for their firesetting (Study 1), using fire as a means of grabbing attention is not. This latter feature may have led to the arrest of these individuals. To our knowledge, this is the first study to compare fire-related factors across apprehended and unapprehended samples of individuals who have set fires. Further research is required to elucidate the fire-related similarities and differences across these groups.

Firesetting Prevalence and Features

In Study 1, a key aim was to replicate Barrowcliffe and Gannon’s (2015) work on unapprehended firesetting. As predicted, using a 14-year minimum age cut-off, we found that approximately 10% of UK resident community adults self-reported having set a deliberate fire that had not been officially recorded. This is roughly in line with previous work conducted in the UK (i.e., Gannon & Barrowcliffe, 2012) and lower than the 18% reported by Barrowcliffe and Gannon (2016). The current study holds the largest sample of UK community participants (i.e., 1,402) used to examine the prevalence of unapprehended firesetting to date using a conservative age cut off designed to exclude fire play. We found few demographic differences between the firesetting and non-firesetting groups which was generally in keeping with Barrowcliffe and Gannon (2015). However, contrary to their study, we found that individuals who self-reported having set a deliberate fire were generally male, young, had received a mental health diagnosis, and were more likely to have a prior criminal history. Since just under half of our firesetting participants stated that having better fire safety knowledge would have prevented their fires, fire prevention efforts might be most successful if they are fire safety oriented and targeted towards youth mental health and justice services. Our examination of the features of the self-reported firesetting illustrated that the ages when these fires were set were broadly in line with the ages reported by Barrowcliffe and Gannon (2015) and the majority of our sample (76.7%) set fires with other individuals. Barrowcliffe and Gannon (2015, 2016) also reported that the majority of their self-reported fires were set in the company of others. Again, this supports the idea that antisocial associates represent a key factor in the firesetting self-reported by UK community participants. The firesetting group in our study, similarly to Barrowcliffe and Gannon (2015), reported varied motivations for their fire misuse. The most commonly cited motives of experimenting with fire, wanting to create excitement or loving fire, and boredom all reflect the most popular motivators reported by Barrowcliffe and Gannon (2015, 2016). This replication suggests that these motives are reliable drivers underpinning unapprehended community firesetting. Items most commonly set fire to by our firesetting participants were rubbish bins, and grass or shrubbery (cf. Barrowcliffe & Gannon, 2015, 2016) and very few of our firesetting participants perceived their fires as having been serious. These targets and the appraisals of participants regarding seriousness suggest that their fires were generally lower level and so may not have attracted the attention of authorities in order to secure an arrest or caution. Nevertheless, ten participants disclosed that they had set fire to what they believed to be an unoccupied building suggesting that the questions we asked regarding unapprehended firesetting captured serious offending behavior.

Limitations

A key limitation associated with questionnaire development studies is that the initial factor structure described typically requires further replication. In our research, we did not attempt to replicate the Firesetting Questionnaire’s factor structure in Study 2 due to the size of our specialist imprisoned sample. However, in Study 1, we divided our large sample in two which enabled us the opportunity to replicate our initial exploratory factor solution and refine questionnaire composition via confirmatory factor analysis. Consequently, we can be reasonably confident that the factor structure of the Firesetting Questionnaire is replicable. Nevertheless, we invite researchers to replicate the factor structure described in this paper using a larger sample of both unapprehended and apprehended individuals who have set fires.
Finally, the questionnaire items initially presented to participants in Study 1 were extensive and encompassed items designed to tap into broad fire supportive attitudes (e.g. fire is controllable; Gannon et al., 2012; Ó Ciardha & Gannon,2012), fire-specific social desirability (e.g., ‘Lighting a fire or a couple of candles can make a room look nicer’), and further inappropriate firesetting scripts (e.g., fire destroys evidence). Interestingly, none of these concepts were clearly elucidated when items were factor analyzed. It is possible, that our choice of sample (i.e., generally noncriminal community individuals) when developing the questionnaire may have generated concepts more applicable to unapprehended rather than apprehended individuals who have set fires. However, if this is the case, the results of Study 2 suggest that the questionnaire holds convincing associations with fire convictions. Furthermore, many individuals convicted of a firesetting offence tend to self-report other unapprehended incidents of firesetting (see Gannon et al., 2015). Finally, some of the individuals in the study initially chosen as comparison groups due to their non-firesetting status self-reported some history of firesetting behavior. Taken together, these findings suggest that the questionnaire developed in Study 1 is likely to produce valid and reliable measurement across firesetting groups. Nevertheless, there remains an argument to examine measurement of concepts such as fire attitudes and scripts in greater depth for apprehended populations.

Clinical Implications

Following further validation, the Firesetting Questionnaire shows promise as a clinical tool for therapists working with both apprehended and non-apprehended individuals who have set deliberate fires. Since 10% of the population identify themselves as having set a deliberate fire, firesetting history might reasonably be assessed at general intake for both prisons and psychiatric hospitals. The Firesetting Questionnaire could then be used to examine the possible drivers of such behavior and to put in place firesetting management plans or treatment. Similarly, for those individuals in which firesetting is clearly a behavioral issue, the Firesetting Questionnaire might be used to examine the key treatment needs that require targeting in any planned intervention and to inform appropriate risk assessment.

Conclusion

This research developed and evaluated a new measure named the Firesetting Questionnaire to examine fire-specific constructs relevant to fire misuse using both apprehended and unapprehended samples. Our analyses suggest that this new measure holds better coverage of theoretically informed fire-specific dynamic risk factors relative to the most commonly used contemporary measure (Ó Ciardha et al., 2015). It also showed superior discriminative ability in relation to firesetting behavior and was associated with varying firesetting criteria including any lifetime firesetting and firesetting convictions. The results suggest that the Firesetting Questionnaire has the potential to be a useful clinical tool for highlighting fire-specific treatment needs to inform clinical formulation and associated risk management. It might also be used to assess change following treatment which would help professionals to establish convincing evidence of ‘what works’ to reduce deliberate firesetting behavior.

Declarations

This study was registered with the Open Science Framework Repository (https://​osf.​io/​p4v2j/​). We are grateful to area psychologists, prison establishment staff, and our participants.

Conflict of interest

The authors declare that they have no conflict of interest.

Ethical Approval:

The research was approved by the University of Kent Ethics Committee and the National Research Committee (HMPPS). The views expressed are those of the authors and do not necessarily reflect those of HMPPS.
Open AccessThis article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article’s Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://​creativecommons.​org/​licenses/​by/​4.​0/​.

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Onze productaanbevelingen

BSL Psychologie Totaal

Met BSL Psychologie Totaal blijf je als professional steeds op de hoogte van de nieuwste ontwikkelingen binnen jouw vak. Met het online abonnement heb je toegang tot een groot aantal boeken, protocollen, vaktijdschriften en e-learnings op het gebied van psychologie en psychiatrie. Zo kun je op je gemak en wanneer het jou het beste uitkomt verdiepen in jouw vakgebied.

BSL Academy Accare GGZ collective

Bijlagen

Electronic Supplementary Material

Below is the link to the electronic supplementary material.
Voetnoten
1
Referred to as Ó Ciardha et al. (2014) in the preregistration due to online publication first.
 
2
We modernized one item that asked participants to think about watching an ordinary coal or wood fire by including gas fire in addition.
 
3
This minimum age of 14 is a result of the fact that this was the lowest age participants could report for firesetting.
 
4
The Five Factor Fire Safety Scale has 6 items. The item ‘If you’ve got problems, a small fire can help sort them out’ did not replicate in this CFA.
 
5
Analyses conducted without residualized factor scores did not meaningfully differ from those reported here.
 
6
We are confident that the low alpha for pathological fire interest is due to the low number of items because if you increase the number of items from 4 to 20, with a mean inter-item correlation of 0.247, item covariance of 0.213, and mean item variance of 0.900, this boosts the alpha to 0.86 using Cronbach’s formula (an increase from 4 items to 10 items brings the alpha to 0.76). One item has a low correlation with the other items in this small sample, which further attenuates the alpha, but this is to be expected when cross validating to a new (especially smaller sample).
 
Literatuur
go back to reference Fritzon, K., Doley, R., & Clark, F. (2013). What works in reducing arson-related offending. In L. A. Craig, L. Dixon, & T. A. Gannonred What works in offender rehabiliation: an evidence-based approach to assessment and treatment (pp. 255–270). Wiley-Blackwell. Fritzon, K., Doley, R., & Clark, F. (2013). What works in reducing arson-related offending. In L. A. Craig, L. Dixon, & T. A. Gannonred What works in offender rehabiliation: an evidence-based approach to assessment and treatment (pp. 255–270). Wiley-Blackwell.
go back to reference Gannon, T. A., Ó Ciardha, C., & Barnoux, M. (2011). The identification with fire questionnaire. Unpublished manuscript. Canterbury, UK: CORE-FP, School of Psychology, University of Kent. Gannon, T. A., Ó Ciardha, C., & Barnoux, M. (2011). The identification with fire questionnaire. Unpublished manuscript. Canterbury, UK: CORE-FP, School of Psychology, University of Kent.
go back to reference Gannon, T. A., Tyler, N., Ó Ciardha, C., & Alleyne, E. (2022). Adult deliberate firesetting: theory, Assessment and Treatment. Wiley-Blackwell. Gannon, T. A., Tyler, N., Ó Ciardha, C., & Alleyne, E. (2022). Adult deliberate firesetting: theory, Assessment and Treatment. Wiley-Blackwell.
go back to reference George, D., & Mallery, P. (2003). SPSS for windows step by step: a simple guide and reference 11.0 update (4th ed.). Allyn and Bacon. George, D., & Mallery, P. (2003). SPSS for windows step by step: a simple guide and reference 11.0 update (4th ed.). Allyn and Bacon.
go back to reference IBM Corp. (2017). IBM SPSS Statistics for Windows, Version 25.0. IBM Corp. IBM Corp. (2017). IBM SPSS Statistics for Windows, Version 25.0. IBM Corp.
go back to reference Johnston, K. L. (2022). Factors associated with un-apprehended deliberate fire setting in an Aotearoa New Zealand community sample. [Doctoral dissertation, Victoria University of Wellington] Johnston, K. L. (2022). Factors associated with un-apprehended deliberate fire setting in an Aotearoa New Zealand community sample. [Doctoral dissertation, Victoria University of Wellington]
go back to reference Marsh, H. W., Hau, K. T., & Wen, Z. (2004). In search of golden rules: comment on hypothesis-testing approaches to setting cutoff values for fit indices and dangers in overgeneralizing Hu and Bentler’s (1999) findings. Structural Equation Modeling: A Multidisciplinary Journal, 11, 320–341. https://doi.org/10.1207/s15328007sem1103_2.CrossRef Marsh, H. W., Hau, K. T., & Wen, Z. (2004). In search of golden rules: comment on hypothesis-testing approaches to setting cutoff values for fit indices and dangers in overgeneralizing Hu and Bentler’s (1999) findings. Structural Equation Modeling: A Multidisciplinary Journal, 11, 320–341. https://​doi.​org/​10.​1207/​s15328007sem1103​_​2.CrossRef
go back to reference Marsh, H. W., Lüdtke, O., Muthén, B., Asparouhov, T., Morin, A. J. S., Trautwein, U., & Nagengest, B. (2010). A new look at the big five factor structure through exploratory structural equation modelling. Psychological Assessment, 22, 471–491. https://doi.org/en10.1037/a0019227 Marsh, H. W., Lüdtke, O., Muthén, B., Asparouhov, T., Morin, A. J. S., Trautwein, U., & Nagengest, B. (2010). A new look at the big five factor structure through exploratory structural equation modelling. Psychological Assessment, 22, 471–491. https://​doi.​org/​en10.​1037/​a0019227
go back to reference Muckley, A. (1997). Firesetting: addressing offending behaviour. A resource and training manual. Redcar and Cleveland Psychological Service. Muckley, A. (1997). Firesetting: addressing offending behaviour. A resource and training manual. Redcar and Cleveland Psychological Service.
go back to reference Muthén, B. O., & Muthén, L. K. (2015). Mplus Version 7.4. Los Angeles, CA: Muthén & Muthén. Muthén, B. O., & Muthén, L. K. (2015). Mplus Version 7.4. Los Angeles, CA: Muthén & Muthén.
go back to reference Ó Ciardha, C., Barnoux, M. F. L., Alleyne, E. K. A., Tyler, N., Mozova, K., & Gannon, T. A. (2015). Multiple factors in the assessment of firesetters’ fire interest and attitudes. Legal and Criminological Psychology, 20(1), 37–47. https://doi.org/10.111/lcrp.12065.CrossRef Ó Ciardha, C., Barnoux, M. F. L., Alleyne, E. K. A., Tyler, N., Mozova, K., & Gannon, T. A. (2015). Multiple factors in the assessment of firesetters’ fire interest and attitudes. Legal and Criminological Psychology, 20(1), 37–47. https://​doi.​org/​10.​111/​lcrp.​12065.​CrossRef
go back to reference Okulitch, J. S., & Pinsonneault, I. (2002). The interdisciplinary approach to juvenile firesetting: a dialogue. In D. Kolko (Ed.), Handbook on firesetting in children and youth (pp. 57–74). Academic Press. Okulitch, J. S., & Pinsonneault, I. (2002). The interdisciplinary approach to juvenile firesetting: a dialogue. In D. Kolko (Ed.), Handbook on firesetting in children and youth (pp. 57–74). Academic Press.
go back to reference Paulhus, D. L. (1991). Measurement and control of response bias. In J. P. Robinson, P. R. Shaver, & L. S. Wrightsman (Eds.), Measures of personality and social psychological attitudes (pp. 17–59). Academic Press. Paulhus, D. L. (1991). Measurement and control of response bias. In J. P. Robinson, P. R. Shaver, & L. S. Wrightsman (Eds.), Measures of personality and social psychological attitudes (pp. 17–59). Academic Press.
go back to reference Paulhus, D. L. (1994). Balanced inventory of Desirable responding: reference manual for BIDR Version 6. Unpublished manuscript. Vancouver, Canada: University of British Columbia. Paulhus, D. L. (1994). Balanced inventory of Desirable responding: reference manual for BIDR Version 6. Unpublished manuscript. Vancouver, Canada: University of British Columbia.
go back to reference Tabachnick, B. G., & Fidell, L. S. (2007). Using Multivariate Statistics (5th ed.). Allyn and Bacon. Tabachnick, B. G., & Fidell, L. S. (2007). Using Multivariate Statistics (5th ed.). Allyn and Bacon.
go back to reference Wechsler, D. (2011). Wechsler Abbreviated Scale of Intelligence, Second Edition (WASI-II). NCS Pearson. Wechsler, D. (2011). Wechsler Abbreviated Scale of Intelligence, Second Edition (WASI-II). NCS Pearson.
Metagegevens
Titel
The Development and Validation of the Firesetting Questionnaire
Auteurs
Theresa A. Gannon
Mark E. Olver
Emma Alleyne
Helen Butler
Victoria Lister
Caoilte Ó Ciardha
Katie Sambrooks
Nichola Tyler
Publicatiedatum
16-12-2022
Uitgeverij
Springer US
Gepubliceerd in
Journal of Psychopathology and Behavioral Assessment / Uitgave 1/2023
Print ISSN: 0882-2689
Elektronisch ISSN: 1573-3505
DOI
https://doi.org/10.1007/s10862-022-10011-x

Andere artikelen Uitgave 1/2023

Journal of Psychopathology and Behavioral Assessment 1/2023 Naar de uitgave