Introduction
Low frustration tolerance represents one of the major categories of irrational beliefs within the Rational Emotive Behavior Therapy (REBT) framework (David et al.,
2005). It is defined as a demand that the reality should be as we want it to be (Harrington,
2005a,
b). People scoring on low frustration tolerance encounter difficulties detecting the threshold between desires and reality (Harrington,
2007). In contrast, people with good frustration tolerance are more willing to accept things as they are rather than demand that things should be different. Trip et al. (
2021) have shown that low frustration tolerance uniquely predicts unruly and disruptive behaviors as specific externalizing problems.
However, the REBT literature includes various beliefs in the low frustration tolerance category, such as instant gratification, intolerance of emotions, and problem avoidance (Dryden & Gordon,
1993). In this regard, Harrington (
2007) suggested that it would be helpful to approach frustration intolerance as a multidimensional construct because different cognitions related to low frustration tolerance led to different outcomes (e.g., intolerance to discomfort to depression, intolerance of emotional distress to anxiety, and intolerance of unfairness to anger).
In this regard, (Harrington,
2005b) introduced the Frustration Discomfort Scale (FDS) to measure a multidimensional frustration intolerance construct. The scale contains four facets of frustration intolerance: emotional intolerance, discomfort intolerance, achievement frustration, and entitlement. The emotional intolerance facet reflects reduced tolerance to experience emotional distress. The discomfort intolerance dimension deals with beliefs that life should be easy and free from hassle. The achievement frustration intolerance scale is linked to task-related frustration, whereas the entitlement scale refers to the demand for fairness and immediate gratification. Harrington (
2005a,
2007) argued that the multidimensional FDS construct has discriminant validity. For instance, discomfort intolerance was a positive predictor of procrastination, whereas emotional intolerance and achievement frustration were negative predictors. Likewise, emotional intolerance was associated with anxiety, discomfort intolerance was associated with depression, and entitlement was associated with anger. Regarding the big-five parallelisms, emotional intolerance is closely related to neuroticism, entitlement with low agreeableness, achievement frustration and discomfort intolerance with high/low conscientiousness.
The factorial structure of the Frustration Discomfort Scale has been investigated in various research that focused on validating the scale in other languages. So far, the instrument has been translated into Spanish on an Argentinian sample (Medrano et al.,
2018) and a Chilean sample (Ruiz-Ortega et al.,
2021), French (Chamayou et al.,
2016), Italian (Filippello et al.,
2014; Tripaldi et al.,
2018), Portuguese on a Brazilian sample (Silva & Faro,
2021), Serbian (Stanković & Vukosavljević-Gvozden,
2011), Turkish (Ozer et al.,
2012), and Urdu (Jibeen,
2013). However, the initial four-factor correlated solution has received mixed empirical support. Most translations reached a four-factor solution, but all of them required modifications (deviations) to obtain adequate or good indices of fit (i.e., CFI > 0.90; RMSEA < 0.06). These modifications varied in form. In some cases, suggestions were made towards dropping some items (i.e., Turkish sample, Argentinian sample). In other cases, different factorial solutions were suggested (e.g., one-factor in the French sample; two-factor in the Brazilian sample). Finally, in some cases, a second-order factor above the four factors or solutions that include correlations among item residuals was suggested to obtain good fit indices. Therefore, the FDS seems to have a less reliable factorial structure across various samples and languages.
The Present Study
The current study aimed to validate the Romanian version of the FDS on a teachers' sample. We selected teachers for convenience, as teachers were candidates to receive a subsequent REBT intervention to decrease teachers' frustration intolerance in school settings. Relying on a sample of teachers as a non-clinical sample has the advantage of departing from the often-used student samples in the FDS validation studies and the disadvantage of not being a representative sample from the general population. We examined the factorial structure of the FDS obtained on the Romanian sample of teachers. We also investigated the relationship between low frustration tolerance and its facets on the one hand and other irrational beliefs on the other hand. First, we looked at the relationship between the FDS score and the central irrational beliefs in the REBT framework: demandingness, self-downing, low frustration tolerance, and awfulizing. This investigation would support the discriminant validity of the FDS, particularly when we compare the association between its overall score with the ABS-2 low frustration tolerance scale and the association between the same FDS overall score with the ABS-2 self-downing scale. Most theoretical accounts highlight the distinction between self-distortions (i.e., self-downing) and reality distortions (i.e., frustration intolerance) (Harrington,
2005a).
Taking advantage of our sample characteristics (i.e., teachers), we also investigated how the FDS is associated with TIBS level of irrational beliefs. In addition, we expected that the FDS score would correlate more intensively with teachers' low frustration tolerance level than with teachers' level of self-downing. We also exploratory analyzed the interplay of the FDS overall score and its associated subscales with TIBS absolutistic demands towards others. The latter concept shares more features with the FDS entitlement scale than other frustration intolerance scales, such as discomfort or emotional intolerance.
Likewise, to the extent to which the FDS successfully distinguishes between entitlement and discomfort intolerance, we expect that the teacher's absolutistic demands on others will correlate more intensively with the FDS entitlement scale than discomfort intolerance. This exploratory endeavor will support the utility of addressing frustration intolerance as a multi-component construct.
Unconditional self-acceptance (Chamberlain & Haaga,
2001) has consistently been found to correlate negatively with irrational beliefs (Davies,
2006,
2008; Samfira & Sava,
2021). Therefore, in our approach to validate the Romanian version of the FDS, we expect a negative association between unconditional self-acceptance and the overall level of frustration intolerance.
Last but not least, we also examined the relationship between the frustration intolerance level and teachers’ style of pupil control. Custodial teachers (Willower et al.,
1967) impose a high demand on others and are more likely to become frustrated because students' behavior departs from their idealistic expectations. Teachers who adopt a custodial view of pupil control ideology endorse more dysfunctional beliefs, unrelenting standards, and schemas of entitlement (Samfira & Sava,
2021).
Likewise, to the extent to which the FDS successfully distinguishes between entitlement, on the one hand, and emotional intolerance and discomfort intolerance, on the other hand, we expect that a custodial pupil control ideology will correlate more intensively with the FDS entitlement and achievement frustration scales than with the emotional and the discomfort intolerance scales, to provide further support for the utility of addressing the frustration intolerance as a multi-component construct.
Results
Descriptive values for the instruments included in this study are presented in Table
1, whereas the correlation matrix among our variables of interest is presented in Table
2.
Table 1
Descriptive statistics for the instruments used in the current study (N = 308)
Frustration Discomfort Scale (FDS) | 64.01 | 23.59 | .97 | 28 |
Discomfort Intolerance (DI) | 15.17 | 5.61 | .87 | 7 |
Entitlement (E) | 17.00 | 6.65 | .88 | 7 |
Emotional Intolerance (EI) | 15.38 | 5.78 | .88 | 7 |
Achievement Intolerance (A) | 16.43 | 6.28 | .89 | 7 |
Teacher Irrational Beliefs Scale (TIBS) | 55.75 | 11.05 | .86 | 20 |
Absolutist demands on others | 22.19 | 4.22 | .76 | 6 |
Overall self-downing | 17.18 | 4.70 | .75 | 8 |
Low frustration tolerance (LFT) | 16.38 | 4.61 | .73 | 6 |
Attitudes and Beliefs Scale (ABS-2) | 88.94 | 33.45 | .93 | 72 |
Demandingness (DEM) | 27.28 | 8.28 | .74 | 18 |
Self-downing (SD) | 14.85 | 10.13 | .88 | 18 |
Low frustration tolerance (LFT) | 25.56 | 9.00 | .79 | 18 |
Awfulizing (AWF) | 24.62 | 9.26 | .81 | 18 |
Irrational ABS-2 Total Score (IRR) | | | | 36 |
Unconditional self-acceptance (USAQ) | 92.45 | 11.17 | .86 | 20 |
Pupil control ideology (PCI) | 54.94 | 9.59 | .80 | 20 |
Table 2
The correlation matrix for the instruments used in the current study (N = 308)
(1) FDS total score | – | .96 | .96 | .96 | .97 | .54 | .42 | .48 | .41 | .30 | .27 | .11 | .42 | .24 | .07 | − .19 | .23 |
(2) Discomfort FDS | | – | .89 | .93 | .91 | .50 | .39 | .47 | .37 | .27 | .24 | .11 | .39 | .22 | .06 | − .20 | .24 |
(3) Entitlement FDS | | | – | .91 | .94 | .53 | .42 | .47 | .40 | .29 | .26 | .11 | .41 | .24 | .08 | − .18 | .19 |
(4) Emotional FDS | | | | – | .92 | .53 | .39 | .48 | .42 | .30 | .27 | .13 | .41 | .25 | .05 | − .20 | .24 |
(5) Achievement FDS | | | | | – | .52 | .43 | .47 | .39 | .28 | .24 | .11 | .39 | .22 | .05 | − .16 | .22 |
(6) TIBS total score | | | | | | – | .75 | .82 | .87 | .50 | .48 | .26 | .56 | .46 | .15 | − .27 | .41 |
(7) Absolute demands TIBS | | | | | | | – | .37 | .51 | .23 | .31 | .00 | .30 | .20 | .23 | − .04 | .28 |
(8) Self-downing TIBS | | | | | | | | – | .60 | .51 | .42 | .33 | .56 | .47 | .07 | − .34 | .39 |
(9) Frustration intol. TBS | | | | | | | | | – | .47 | .44 | .27 | .51 | .45 | .08 | − .25 | .33 |
(10) ABS-2 total irrational | | | | | | | | | | – | .86 | .81 | .92 | .93 | − .05 | − .49 | .33 |
(11) Demandingness ABS2 | | | | | | | | | | | – | .54 | .77 | .74 | .09 | − .32 | .41 |
(12) Self-downing ABS2 | | | | | | | | | | | | – | .61 | .71 | − .23 | − .45 | .33 |
(13) Low frust. tol. ABS2 | | | | | | | | | | | | | – | .83 | .04 | − .40 | .42 |
(14) Awfulizing ABS2 | | | | | | | | | | | | | | – | − .08 | − .44 | .39 |
(15) ABS-2 total rational | | | | | | | | | | | | | | | – | .27 | − .05 |
(16) USAQ | | | | | | | | | | | | | | | | – | − .25 |
(17) PCI—Custodial ideology | | | | | | | | | | | | | | | | | – |
Confirmatory Factorial Analysis (CFA)
We employed a confirmatory factor analysis to examine the factorial structure of the Romanian version of the FDS. We used the Diagonally Weighted Least Square (DWLS) instead of the classical Maximum Likelihood (ML) to estimate the parameters in the CFA models, as DWLS is more appropriate for studies that use ordinal Likert-type items as the unit of analysis, particularly when the items depart from a normal distribution (Li,
2016). We compared three models following the results obtained in previous studies. Mainly, we compared Model 1, which refers to the original 4-factor solution proposed by Harrington (
2005b) that allows factors to correlate among each other, with Model 2, which refers to the one-factor solution supported by some FDS translations (i.e., the French version), as suggested by Chamayou et al. (
2016). Model 3 is a second-order model that combines the first two models, allowing both for a 4-factor solution that reunites in a single second-order factor.
We followed the literature recommendations in assessing models in terms of their goodness of fit (Bentler,
1990; Byrne,
1998). Thus, adequate models should have a Comparative Fit Index (CFI) higher than 0.90, a Root Mean Square Error of approximation (RMSEA), and a Standardized Root Mean Squared Residual (SRMR) below 0.08, but preferably lower than 0.05. Likewise, a ratio for χ
2 to the degrees of freedom of less than 2.00 indicates a good fit, whereas a value less than 3.00 suggests an acceptable fit (Table
3).
Table 3
The goodness of fit statistics for the three tested models using DWLS as the method of parameters estimation (N = 308)
Model 1 (4-correlated factors) | 399.86 | 344 | .998 | .023 (.010–.032) | .058 |
Model 2 (1-factor) | 408.52 | 350 | .998 | .023 (.011–.032) | .059 |
Model 3 (1 second-order factor) | 526.09 | 349 | .994 | .041 (.033–.048) | .067 |
The results suggest that all three models (4-factor, 1-factor, and the complex model containing one second-order factor and four first-order factors) fit data accurately. Of the three models, the 4-factor and the 1-factor model fit the data slightly better than the 1-second-order factor model, despite the 4-factor model being nested in the 1-second-order factor model). The two remaining competing models were quite similarly efficient in fitting the data. The 1-factor solution is more parsimonious than the 4-factor solution. Likewise, the factor loading for all 28 FDS items ranged from 0.53 to 0.81 in the 1-factor solution. However, we decided to explore whether the four-factor solution that differentiates among four subcomponents of frustration discomfort has discriminant validity when considering other relevant constructs.
Hypotheses Testing
In our H1, we expected a positive association between the FDS overall score and the overall level of irrational beliefs measured through ABS-2 (the global measure of irrational belief). The result was in line with our expectations, r (306) = 0.30, p < 0.001, two-tailed. In our H2, we hypothesized that the association between the FDS overall score and a concurrent ABS-2 low frustration tolerance scale—r (306) = 0.42, p < 0.001 is significantly higher than the correlation between the FDS overall score and the ABS-2 self-downing scale—r (306) = 0.11, p = 0.05. The comparison of these two correlation coefficients is in line with our hypothesis, z = 6.45, p < 0.001, the link of FDS to the ABS-2 low frustration tolerance scale being statistically significant stronger than the link of FDS to the ABS-2 self-downing scale.
Likewise, in our H3 hypothesis, we expected a positive association between the FDS overall score and the overall level of teachers’ specific irrational beliefs (TIBS). The result was in line with our expectations, r (306) = 0.54, p < 0.001, two-tailed. In our H4 hypothesis, we hypothesized that the association between the FDS overall score and a concurrent TIBS frustration intolerance scale—r (306) = 0.41, p < 0.001 is significantly higher than the correlation between the FDS overall score and the TIBS self-downing scale—r (306) = 0.48, p < 0.001. The comparison of these two correlation coefficients was not in line with our hypothesis, z = − 1.56, p = 0.06, the link of FDS to the TIBS frustration intolerance scale being similar in magnitude to the link of FDS to the TIBS self-downing scale.
In the H5 hypothesis, we expected a negative association between the FDS overall score and unconditional self-acceptance (USAQ). The result was in line with our expectations, r (306) = − 0.19, p < 0.001, two-tailed. Likewise, in the H6 hypothesis, we expected a positive association between the FDS overall score and the endorsement of a custodial pupil control ideology (PCI), and the obtained results supported this hypothesis—r (306) = 0.23, p < 0.001, two-tailed.
Post-hoc Analyses
Given that the CFA failed to differentiate whether a 1-factor or a 4-factor solution provides a better description of the factorial structure for the FDS scale, we also looked at whether the subcomponents of the FDS scale, namely—discomfort, entitlement, emotions, and achievements—provide distinctive patterns of correlations with the other included measures. Data based on comparing correlation coefficients failed to support the discriminant validity of using scores on the four components of FDS instead of the overall score. For instance, the four FDS subscales correlate similarly with the overall TIBS score, the correlations ranging from 0.50 to 0.53 (all z scores for comparison correlations having p values > 0.05). A similar situation was found when correlating each FDS subscale with the ABS-2 total score, correlation coefficients ranging from 0.27 to 0.30, or when comparing each FDS subscale with the USAQ, negative correlation coefficients ranging from -0.20 to -0.16 (all z scores for comparison correlations having p values > 0.05). However, these represent weak arguments in favor of a 1-factor solution, as there is no reason to expect different patterns of correlations between different FDS subscales and the overall irrational belief scales (ABS-2, TIBS) or unconditional self-acceptance (USAQ). On the other hand, the 1-factor solution seems more parsimonious than the 4-factor solution since we did not find discriminant validity in some exploratory analyses. Thus, TIBS absolute demands did not correlate significantly higher with the FDS entitlement scale (0.42) or with the FDS achievement scale (0.43) in comparison with the FDS emotional scale (0.39) or the FDS discomfort scale (0.39) (all z values for correlation coefficient comparisons being > 0.05). Similar null differences in the intensity of correlation coefficients were found when comparing the PCI score with each FDS facet, despite the reasonable assumption that the PCI score might be more linked with the FDS entitlement scale than with the FDS emotional scale.
To complicate things further, exploratory factor analysis on the existing dataset using a principal-factor extraction method indicated a 1-factor solution based on scree-plot inspection and a 3-factor solution based on eigenvalues higher than one. Likewise, employing a parallel analysis indicated a 2-factor solution. These results suggest we should rely on other criteria in selecting the number of factors than the specific EFA rule of thumbs.
Before moving to the discussion, we also ran additional posthoc analyses to explain the lack of support for the H4 (which stated that FDS correlates more strongly with the low frustration tolerance scale from TIBS than with the self-downing scale from TIBS). The null result says little about the quality of the FDS. This statement is based on a context in which we also observed that the ABS-2 low frustration tolerance scale correlates similarly or slightly lower with the TIBS frustration intolerance scale (0.51) than with the TIBS self-downing scale (0.56). At the same time, we noticed that the TIBS self-downing scale correlates less with the ABS-2 self-downing scale (0.33) and USAQ (− 0.34). These results suggest a construct validity issue of the TIBS self-downing scale, rather than an issue from the FDS side, as the TIBS self-downing seems to tap more on frustration intolerance than on self-worth.
Reliability Cronbach's alpha in this sample of teachers was 0.96 for the FDS overall score, indicating excellent internal consistency.
Discussion
The study aimed to validate a Romanian version of the FDS on a teacher sample. The FDS was developed as a multidimensional measure of frustration intolerance construct, as there were different facets involved, such as the urgency for immediate gratification or the intolerance of emotions. Our main aim was to assess the validity and reliability of the FDS and pay particular attention to the factorial structure of the scale, given that mixed results in this regard were obtained in previous similar studies that were conducted in other countries. Overall, both 1-factor and 4-factor solutions could adequately fit the data. However, the 1-factor solution is more parsimonious since the 4 FDS subscales need to provide additional discriminant validity. Likewise, based on the pattern of correlations with the ABS-2 scale, the most common instrument for measuring irrational beliefs, our results support the specificity perspective of the FDS in focusing on frustration intolerance mainly. The FDS correlates in the expected directions with other relevant measures. It correlates positively with TIBS (the level of irrational beliefs of teachers) and PCI (more likely to become frustrated when pupils misbehave), and it correlates negatively, to a smaller extent, with USAQ (less prone to unconditional self-acceptance). Such findings align with the general perspective of frustration intolerance as being related to a difficulty in distinguishing between reality and a wish.
On the other hand, we needed more support for the relevance of distinguishing different facets of frustration intolerance. Theoretically, it might be relevant in distinguishing, for instance, between immediate gratification needs (a typical problem for externalizing issues) and the higher level of discomfort when experiencing frustration as an emotion. Such differentiation failed to be relevant when we linked them to other constructs (i.e., different types of irrational beliefs).
The factorial structure of the Romanian version of the FDS obtained on a non-clinical sample provided good fit indices when employing an appropriate method of parameter estimation such as DWLS. Notably, all items had high factor loadings in the extracted factor(s), both for the 4-factor and the 1-factor solutions. The factorial structure of the Romanian version translation is in line with some translations of the original FDS, such as the French translation. However, unlike those instances, the factorial structure for the Romanian version based on CFA found similar support for the original FDS 4-factor solution as for the 1-factor solution.
The study presents several limitations. The most important one is that all analyses were conducted on a non-clinical sample. It skewed the entire distribution, as the average score on FDS was 2.28 on a 5-point Likert scale from 1 to 5. We hope that providing the FDS scale for the Romanian-speaking community will facilitate further research on the frustration intolerance construct and its significance in non-clinical and clinical settings. It might be the case that selecting clinical populations (e.g., narcissistic personality disorders vs. obsessive–compulsive personality disorders) would provide a different story on the utility of treating frustration intolerance as a multidimensional construct. Similarly, future studies that would include depression, anger, anxiety, or procrastination measures, as Harrington (
2005a,
2007) did. Such constructs might provide more discriminant validity for treating FDS as a multidimensional construct. The type of sample (clinical vs. non-clinical) likely plays a crucial role in determining the factorial structure. In the original study (Harrington,
2005b), clinical participants represented more than 75% of the total sample. Although irrational beliefs are considered to be also present in the general population, they will be more pronounced in a clinical sample. For instance, the average total FDS score in our sample of teachers was 64.01 (SD of 23.59), whereas the average total FDS score in Harrington’s (
2005b) study was 90.75 (SD of 20.70). Participants from a non-clinical sample are less likely to endorse FDS items (e.g.,
I can’t bear to feel I am losing my mind) than participants from a clinical sample. This response style will attenuate the chance of distinguishing among different FDS dimensions, as it will underestimate the true intercorrelations among the items. Unfortunately, almost all previous studies shared this limitation, as they were conducted on student samples such as the Italian (Filippello et al.,
2014; Tripaldi et al.,
2018), Turkish (Ozer et al.,
2012), Serbian (Stanković & Vukosavljević-Gvozden,
2011), Brazilian (Silva & Faro,
2021), French (Chamayou et al.,
2016), and Pakistani/Urdu (Jibeen,
2013), or general non-clinical populations in the Italian (Tripaldi et al.,
2018), and Chilean studies (Ruiz-Ortega et al.,
2021). Therefore, it is highly recommended that future attempts to translate and validate the factorial structure of the FDS should be conducted on a clinical sample or on a mixed sample with at least 50% of participants originating from a clinical sample, a case in which the factorial structure invariance could also be addressed.
In addition to distinguishing between clinical and non-clinical populations, the particularity of our sample (teachers) could have led to additional problems as the content/wording of frustration intolerance beliefs in a stressful classroom setting might be different from the frustration intolerance beliefs in a clinical setting (see DiGiuseppe et al. (
2020), for an extended discussion on the content versus process in organizing irrational beliefs). The current study also focuses only on teachers, which was unbalanced regarding gender, as most were women.
Therefore, the instrument's psychometric properties could be tested on other samples. Likewise, future studies should also assess the temporal stability and sensitivity to treatment effects of the FDS scale, as the cross-sectional approach that we have used preclude us from seeing how reliable the FDS results are from a temporal perspective.
Despite these limitations that made us consider our endeavor a preliminary validation study of the Romanian version, the FDS scale has good psychometric properties. It will allow researchers and practitioners to assess and identify individuals scoring high on frustration intolerance, helping mental health specialists provide a tailored intervention by considering the level of frustration intolerance in the target group. For instance, teachers who scored high on FDS overall scores were selected as potential recipients of an REBT group intervention in a subsequent intervention study meant to decrease teachers’ frustration intolerance in school settings.
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.