Skip to main content
main-content
Top

Tip

Swipe om te navigeren naar een ander artikel

01-04-2007 | Uitgave 3/2007 Open Access

Quality of Life Research 3/2007

Reliability and validity of the Infant and Toddler Quality of Life Questionnaire (ITQOL) in a general population and respiratory disease sample

Tijdschrift:
Quality of Life Research > Uitgave 3/2007
Auteurs:
Hein Raat, Jeanne M. Landgraf, Rianne Oostenbrink, Henriëtte A. Moll, Marie-Louise Essink-Bot

Introduction

Health-related quality of life, complementary to clinical and developmental measures and mortality, has become an essential indicator of outcome in clinical evaluation studies [1], community health studies [2], and will find its way into medical practice [3, 4]. In pediatrics, reliable and validated measures are available to describe health status and health-related quality of life of children comprehensively [5]. However, few were designed to measure health of pre-school children; most are intended for school-age children [5, 6]. Challenges with measurement in pre-school children include finding ways to accommodate for rapid changes in children's abilities and roles over time, and wide ranges for normative growth and development [7]. Furthermore, a rating by proxy, often a parent, is indispensable for this age group. It is difficult to assess the adequacy of such proxy ratings that may be confounded by various factors [8].
We evaluated the Infant and Toddler Quality of Life Questionnaire (ITQOL), the only available generic ‘profile measure’ (i.e. with 10 multi-item and 2 single-item scales) for health status and health-related quality of life that was designed for children as young as 2 months up to 5 years old [9, 10]. This study is the first methodological evaluation of the ITQOL that is based on evaluations with regard to infants (< 1 year old) as well as toddlers (1–5 years old) in both a random general population sample and a clinical sample. Regarding the clinical sample in this study, children being treated for a respiratory disease were selected since this is the most prevalent chronic condition in the age group of pre-school children, and since a negative impact on health-related quality of life because of respiratory symptoms was expected [11, 12].
The ITQOL, developed by Landgraf, adopts the World Health Organization's definition of health as a state of complete physical, mental and social wellbeing and not merely the absence of disease, and incorporates the results of a review of child health literature and developmental guidelines used by pediatricians, and the feed-back of parents during pilot testing [9]. Next to physical and psychosocial aspects of child health it covers the impact of child health problems or handicaps on family life; it is to be completed by the parents [9, 10]. The ITQOL is conceptually similar to and has overlapping items and scales with the Child Health Questionnaire (CHQ), which is among the most widely used pediatric health status measures, and has been cross-culturally validated into 21 languages (32 countries) [1319].
Other generic measures for pre-school children are: the one-dimensional Functional Status II-Revised (FSIIR; 0–16 years old) [20], a ‘preferencebased measure’ (suitable for economic evaluations) called Health Status Classification System for Pre-School Children (HSCS-PS; 2–5 years old) [21, 22], and two other ‘health profile measures’, i.e. the Pediatric Quality of Life Inventory (PedsQl; 2–18 years old) [23], and the TNO-AZL Pre-school Children Quality of Life Questionnaire (TAPQOL; 1–5 years old) [24]. Of these instruments we chose the TAPQOL to evaluate the concurrent validity of the ITQOL, as it is also a ‘health profile measure’, and as the age range that is covered by the TAPQOL (1–5 years) is closest to the one covered by the ITQOL (2 months-5 years) [24].
The study objectives were to assess in a random general population sample and in a clinical sample of children with respiratory disease:
(1)
The feasibility of the ITQOL as a proxy measure of child health and health-related quality of life (indicators: response rates, completion times, perceived difficulty by parents, missing and non-unique answers, presence of floor and ceiling effects);
 
(2)
The reliability of the ITQOL-scales (internal consistency and test-retest reliability);
 
(3)
The validity of the ITQOL as judged by comparisons of specific ITQOL scale ratings with specific TAPQOL scale ratings of the child's health (concurrent validity) as well as by the ability to discriminate between subgroups with/without self-reported chronic conditions, with high/low medical consumption and with/without doctor-diagnosed respiratory illness/asthma (discriminative validity).
 

Methods

Study populations and data collection

General population sample

In 2002, by means of the SPSS random number generator, a random sample of 500 out of 9022 children aged 2 months-4 years in the general population of six municipalities allocated to the service area of ‘Carinova Salland’ (single regional provider of Well-Child Care for the 0–4 year olds) were mailed a questionnaire. The parents themselves decided if either the father or the mother should complete the questionnaire. Up to two reminders were sent; no incentives applied. After two weeks, the same questionnaire was mailed again to assess test-retest reliability in a random subgroup of 158 parents who had returned the first questionnaire, by applying random numbers generated by SPSS.

Respiratory illness sample

January 2000 to July 2001, at Erasmus University Medical Center Rotterdam and HAGA Hospital, The Hague, the Netherlands, patients were retrieved by diagnosis asthma or other disease of trachea/bronchus (ICD-9 coding system 493 and 519.1, respectively) or the reason for encounter ‘wheezing/cough’ as registered by the prospective problem oriented patient classification system [25]. Eligible patients were maximally 5 years old, visiting the pediatric outpatient or emergency department with recurrent lower respiratory complaints during at least 3 months within the past year and being treated with bronchodilators or corticosteroids as documented in the patient record [26]. Parents of all eligible patients were asked to participate (n = 230), and 217 agreed and the questionnaire was sent. After 10 days and 2 months, reminding letters were sent, the third reminder was by telephone. After 2 weeks, all parents who returned the questionnaire were mailed the same questionnaire again to assess test-retest reliability.

Infant and Toddler Quality of Life Questionnaire

The ITQOL consists of 103 items (10 multi-item scales and 2 single-item scales; see Table 1) that generally refer to the situation during the past 4 weeks. It was translated into Dutch according to international guidelines, including three independent forward and two backward translations [13, 27]. Per scale, the items that have 4, 5 or 6 response options, were summed up with equal weight per item (some recoded and/or recalibrated) and transformed into a 0 (worst possible score) to 100 (best possible score) scale [9, 10, 13, 28]. ITQOL-scales General behavior and Getting along, and Change in health are only relevant for children aged one year and older [9].
Table 1
ITQOL-scales, number of items per scale and score interpretationa
Scale
Number of items
Description low score
Description high score
Physical functioning (PF)
10
Child is considerably limited in performing physical activities such as eating, sleeping, grasping, and playing due to health problems
Child performs all types of physical activities such as eating, sleeping, grasping, and playing without limitations due to health problems
Growth and development (GD)
10
Parent is very dissatisfied with development (physical growth, motor, language, cognitive), habits (eating, feeding, sleeping) and overall temperament
Parent is very satisfied with development (physical growth, motor, language, cognitive), habits (eating, feeding, sleeping) and overall temperament
Bodily pain (BP)
3
Child has extremely severe, frequent and limiting bodily pain/discomfort
Child has no pain or limitations due to pain/discomfort
Temperament and moods (TM)
18
Child very often has certain moods and tempera-ments, such as sleeping/eating dimculties, crankiness, fussiness unresponsiveness and lack of playfulness and alertness
Child never has certain moods and temperaments, such as sleeping/eating dimculties, crankiness, fussiness unresponsiveness and lack of playfulness and alertness
General behavior (BE)
13
Parent believes child's behavior is poor and likely to get worse
Parent believes child's behavior is excellent and will continue as such
Getting along (GA)
15
Child very often exhibits behavioral problems, such as not following directions, hitting, biting others, throwing tantrums, and being easily distracted, while positive behavior, such as ability to cooperate, to appear sorry, and to adjust to new situations is seldom shown
Child never exhibits behavioral problems, such as not following directions, hitting, biting others, throwing tantrums, and being easily distracted, while positive behavior, such as ability to cooperate, to appear sorry, and to adjust to new situations is frequently shown
General health perceptions (GH)
12
Parent believes child's health is poor and likely to get worse
Parent believes child's health is excellent and will continue as such
Parental impact: emotional (PE)
7
Parent experiences a great deal of emotional worry/concern as a result of child's physical and/or psychosocial health and/or growth and development
Parent doesn't experience feelings of emotional worry/concern as a result of child's physical and/or psychosocial health and/or growth and development
Parental impact: time (PT) Family activities (FA)
7
Parent experiences a lot of limitations in time avail-able for personal needs due to child's physical and/or psychosocial health and/or growth and development
Parent doesn't experience limitations in time avail-able for personal needs due to child's physical and/or psychosocial health and/or growth and development
Family activities (FA)
6
The child's health and/or growth and development very often limits and interrupts family activities or is a source of family tension
The child's health and/or growth and development never limits and interrupts family activities or is a source of family tension
Family cohesion (FC)
1
Family's ability to get along is rated as ‘poor’
Family's ability to get along is rated as ‘excellent’
Change in health (CH)
1
Child's health is much worse now than 1 year ago
Child's health is much better now than 1 year ago
a Reproduced with permission from the principal author Landgraf [9, p. 16] and Landgraf et al. [13, pp. 38–39].

TNO-AZL Pre-school Children Quality of Life Questionnaire (TAPQOL)

The TAPQOL, which is in Dutch originally, consists of 43 items divided over 12 multi-item scales that cover physical, social, cognitive and emotional functioning domains (see Table 5) [24]. TAPQOL-scales Social functioning, Motor functioning and Communication are only relevant for children aged 1.5 years and older [24].
Table 5
Concurrent validity of the ITQOL assessed by Pearson-r correlation coefficients between ITQOL scale scores and scale scores of related (‘parallel’) vs. unrelated (‘non-parallel’) TAPQOL scales in the general population sample (n = 257–410) and in the clinical sample of children with respiratory illness (n = 106–138)a
TAPQOL-scales
Population
Sleeping
Appetite
Lung problems
Stomach problems
Skin problems
Motor functioning
Problem behavior
Social functioning
Communicatior
Positive mood
Anxiety
Liveliness
Physical
General population sample
0.07
−0.06
0.12b
0.08
0.01
0.06
0.00
0.00
0.11
0.07
0.05
0.09
functioning
Respiratory illness
−0.00
0.03
0.09
0.11
0.03
0.11
0.12
0.35c
0.16
0.14
0.08
0.14
Growth/
General population sample
0.28b
0.24c
0.15c
0.18c
0.09
0.17c
0.26c
0.18c
0.30c
0.15c
0.23c
0.02
development
Respiratory illness
0.27c
0.30c
0.15
0.20b
0.05
0.36c
0.24c
0.22b
0.42c
0.20c
0.23c
0.24c
Bodily pain
General population sample
0.47c
0.25c
0.31c
0.31c
0.25c
0.22c
0.20c
0.07
0.14b
0.25c
0.13cc
0.08
 
Respiratory illness
0.34c
0.25c
0.37c
0.37c
0.14
0.06
0.28c
0.17
0.20b
0.20b
0.24c
0.21b
Temperament/
General population sample
0.36c
0.39c
0.19c
0.29c
0.10c
0.18c
0.4
0.19c
0.25c
0.3f
0.40 a
0.16b
moods
Respiratory illness
0.39c
0.46c
0.33c
0.43c
0.18b
0.27c
0.62 c
0.48c
0.42c
0.46 a
0.52 c
0.39c
General behavior
General population sample
0.15c
0.10
−0.00
0.16c
−0.03
0.19c
0.53 c
0.12b
0.17c
0.17c
0.23c
0.08
 
Respiratory illness
0.21b
0.08
0.13
0.21b
0.10
0.15
0.55 c
0.36c
0.23b
0.37c
0.19b
0.20b
Getting along
General population sample
0.28c
0.15c
0.13b
0.17c
0.02
0.12b
0.45 c
0.26 c
0.24c
0.23c
0.31c
0.19c
 
Respiratory illness
0.33c
0.20b
0.32c
0.29c
0.21c
0.14
0.63 c
0.57 c
0.38c
0.48c
0.43c
0.21b
General health
General population sample
0.35c
0.25c
0.37c
0.22c
0.20c
0.15b
0.20c
0.13b
0.20c
0.18c
0.19c
0.12b
 
Respiratory illness
0.37c
0.50c
0.33c
0.38c
0.03
0.37c
0.36c
0.21b
0.15
0.16
0.29c
0.33c
Parental-emotional
General population sample
0.40c
0.26c
0.14c
0.27c
0.20c
0.27c
0.35c
0.15b
0.21c
0.31c
0.28c
0.10b
 
Respiratory illness
0.32c
0.39c
0.41c
0.43c
0.09
0.22b
0.50c
0.51c
0.32c
0.48c
0.43c
0.37c
Parental-time
General population sample
0.37c
0.22c
0.20c
0.25c
0.07
0.24c
0.30c
0.19c
0.17c
0.26c
0.23c
0.09
 
Respiratory illness
0.34c
0.30c
0.34c
0.31c
0.14
0.24b
0.49c
0.36c
0.26c
0.40c
0.32c
0.21b
Family activities
General population sample
0.27c
0.32c
0.19c
0.23c
0.10
0.22c
0.29c
0.10
0.21c
0.26c
0.18c
0.15c
 
Respiratory illness
na
na
na
na
na
na
na
na
na
na
na
na
Family cohesion
General population sample
0.03
0.14c
0.04
0.15c
−0.02
0.06
0.15c
0.02
0.03
0.08
0.14c
0.01
 
Respiratory illness
0.15
0.04
0.02
0.12
0.09
0.03
0.35c
0.18
0.01
0.21b
0.24c
0.12
Change i. health
General population sample
−0.09
0.11b
0.11b
0.01
−0.10
0.11
−0.01
−0.07
-0.10
0.14c
−0.03
0.07
 
Respiratory illness
0.27c
0.08
0.39c
0.16
0.14
0.11
0.26c
0.14
0.25c
0.18b
0.11
0.06
a Correlations with predefined related (‘parallel’) TAPQOL-scales are in bold italies; other (spurious) correlations are in standard font.
bp < 0.05.
cp < 0.01.
na: Not available (ITQOL-scale Family activities was not fielded in the population of children with respiratory illness).

Other data

In addition, the questionnaires consisted of items on standard socio-demographic variables, the presence of parent-reported current chronic conditions, and presence of wheezing and/or dyspnea and use of asthma medication during the preceding four weeks as defined in the ISAAC epidemiological measurement instrument [29, 30], and number of visits to the family physician during the past 12 months related to health problems of the child. Furthermore the questionnaire consisted of an item on the time needed to complete the ITQOL questionnaire and an item on the perceived difficulty of the ITQOL questionnaire.

Analysis

Only questionnaires concerning children, of whom at least one of the parents was born in a Dutch speaking country, were considered eligible for analysis; in other cases it is questionable whether the respondents had adequate mastery of the Dutch language (questionnaires were in Dutch).

Feasibility

We evaluated the response rates, ITQOL-questionnaire completion times, and perceived difficulty by the parents, and presence of missing and/or non-unique answers. We assessed mean scale scores and score distributions and presence of floor and ceiling effects (> 25% of the respondents have the minimal and/or maximal score). Additionally, mean scores per gender/age subgroup in the general population sample were evaluated.

Reliability

In both samples, overall and in gender/age subgroups, Cronbach's α was used to evaluate the internal consistency of scales; ≥0.70 is considered adequate [31]. We assessed whether (on average) Pearson-r correlation coefficients between the items and their own scale score (without the item under consideration) were higher than the correlation coefficients between these items and any other scale, to evaluate whether the ITQOL-multiitem scales represent separate domains; the average Pearson-r correlation coefficients were calculated by applying Fisher's z transformations [32]. Additionally, in both samples, we assessed scaling success in terms of the percentage of (corrected) item-total correlations with the own scale being higher than the corresponding item-other scale correlations (not including the single-item scale Change in health) [13]. In both samples, test-retest reliability of the ITQOL-scales was, at the individual level, assessed by test-retest Intraclass Correlation Coefficients (ICCs) [33]; ≥0.70 is considered adequate [34]. At the group level, test-retest reliability was assessed by two-sided paired-samples t tests, and by effect sizes: d = meant2 − meant1)/SDt1; 0:20 ≤ d<0.50 is considered small, 0:50 ≤ d<0.80 moderate, and d ≥ 0.80 large [35].

Concurrent validity

In both the general population sample and in the clinical sample, we evaluated whether specific ITQOL-scales correlated better with their assumed ‘parallel’ TAPQOL scales (see below) than with any other scale, as measured by Pearson-r correlation coefficients; scales are assumed to be ‘parallel’ if they pertain to domains that are considered identical. We hypothesized relatively high correlation coefficients between the following (‘parallel’) ITQOL-scale/TAPQOL-scale (in italics) pairs: Physical functioning-Motor functioning; Temperament/moods-Problem behavior/Positive mood/Anxiety; General behavior-Problem behavior; Getting along-Problem behavior/Social functioning.

Discriminative validity

In both the general population sample and in the clinical sample separately, we evaluated the ability of the ITQOL to discriminate between subgroups of children with no parent-reported chronic conditions (excluding asthma in the clinical sample) and subgroups with ≥2 parent-reported chronic conditions. Similarly, in the general population sample (respectively clinical sample), the ITQOL-scores in the subgroup with 0 (respectively ≤3) physician-visits during the past 12 months were compared with those in the subgroup with ≥4 (respectively ≥8) visits (Table 6).
Table 6
Discriminative ability of the ITQOL between subgroups differing in number of reported chronic conditions and physician visits within the general population sample and within the clinical sample; and between a subgroup of the clinical sample (with asthma) and a gender/age matched subgroup of the general population sample (no asthma)
ITQOL-scales
Number of chronic conditions per child
Number of visits to physician last year
 
0 n = 240 mean (SD)
≥ 2 n = 57 mean (SD)
p-value (t test)a
Effect size d b
0 n = 105 mean (SD)
≥ 4 n = 67 mean (SD)
p-value (t test)a
Effect size d b
General population sample
Physical functioning
98 (9)
95(8)
0.02
0.37c
98 (11)
94 (13)
0.08
0.27c
Growth and development
88 (10)
84 (12)
0.04
0.31c
88 (11)
83 (12)
0.01
0.43c
Bodily pain
88 (13)
75 (20)
0.00
0.63d
91 (11)
73 (20)
0.00
0.85e
Temperament/moods
78 (10)
73 (10)
0.00
0.50d
80(9)
73 (13)
0.00
0.52d
General behavior
73 (12)
73 (14)
0.71
−0.06
73 (14)
71 (12)
0.32
0.18
Getting along
72(9)
70(8)
0.25
0.20c
72 (10)
70 (9)
0.26
0.21c
General health
84 (11)
64 (15)
0.00
1.30e
86 (11)
64 (17)
0.00
1.30e
Parental-emotional
93 (10)
87 (15)
0.00
0.42c
95(7)
88 (14)
0.00
0.53d
Parental-time
94 (10)
89 (12)
0.01
0.40c
95(8)
87 (15)
0.00
0.52d
Family activities
88 (12)
80 (17)
0.00
0.49c
89(11)
80 (17)
0.00
0.53d
Family cohesion
76 (19)
75 (18)
0.66
0.07
75 (20)
75 (16)
0.81
−0.04
Change in health
54 (13)
57 (25)
0.34
−0.14
53 (14)
60 (25)
0.08
−0.25c
 
0 n = 39 mean (SD)
≥ 2 n = 49 mean (SD)
p-value (t test)a
Effect size d b
≤ 3 n = 43 mean (SD)
≥ 8 n = 39 mean (SD)
p-value (t test})a
Effect size d b
Clinical sample (respiratory illness)
Physical functioning
89 (18)
87 (14)
0.49
0.18
86 (27)
85 (18)
0.81
0.07
Growth and development
87 (12)
77 (15)
0.00
0.63d
87 (11)
78 (15)
0.00
0.64d
Bodily pain
85 (16)
71 (21)
0.00
0.65d
83 (17)
75 (20)
0.04
0.42c
Temperament/moods
77 (13)
68 (13)
0.00
0.69d
77 (12)
67 (13)
0.00
0.76d
General behavior
74 (15)
74 (14)
0.91
0.03
76 (13)
70 (15)
0.08
0.40c
Getting along
75 (10)
71 (11)
0.07
0.40c
75(9)
68 (10)
0.01
0.64d
General health
63 (19)
49 (18)
0.00
0.77d
67 (15)
43 (17)
0.00
1.39e
Parental-emotional
91 (11)
82 (16)
0.00
0.59d
90 (12)
83 (15)
0.00
0.51d
Parental-time
89 (16)
84 (22)
0.18
0.26c
90 (15)
80 (22)
0.02
0.47c
Family activities
na
na
na
na
na
na
na
na
Family cohesion
74 (22)
74 (22)
0.92
0.02
74 (25)
73 (22)
0.74
0.08
Change in health
71 (22)
63 (23)
0.11
0.35c
74 (24)
66 (25)
0.18
0.31c
ITQOL-scales
Subgroup with asthma (of clinical sample) vs. gender/age matched subgroup without asthma (of general population sample)
 
General population subgroup n = 188 mean (SD)
Asthma subgroup n = 94 mean (SD)
p-value (t test)a
Effect size d b
Subgroup of the clinical sample (with asthma) vs. subgroup of the general population sample (no asthma)
Physical functioning
98 (9)
83 (23)
0.00
0.63d
Growth and development
86 (11)
82 (14)
0.01
0.32c
Bodily pain
85 (15)
77 (18)
0.00
0.47c
Temperament/moods
77 (11)
71 (13)
0.00
0.50d
General behavior
72 (13)
72 (14)
0.95
0.01
Getting along
71(9)
71(9)
0.73
0.05
General health
82 (12)
54 (19)
0.00
1.49e
Parental-emotional
92 (11)
85 (14)
0.00
0.50d
Parental-time
93 (12)
83 (19)
0.00
0.54d
Family activities
87 (13)
na
na
na
Family cohesion
76 (18)
73 (20)
0.20
0.16
Change in health
53 (15)
70 (24)
0.00
−0.68d
a Two-sided independent-samples t test.
b Difference of the means divided by SD in the subgroup with a condition [35].
c Indicates a small effect (0.2 ≤ d < 0.5) [35].
d Indicates a medium effect (0.5 ≤ d < 0.8) [35].
e Indicates a large effect (d ≥ 0.8) [35].
na: Not available (Family activities scale was not fielded in the sample of children with respiratory illness).
Additionally, we compared the ITQOL-scores in a subgroup of the clinical sample (n = 94; only children of whom the parents confirmed the presence of asthma) with ITQOL-scores in a gender/age-matched subgroup of the general population sample (n = 188; only children of whom the parents denied the presence of asthma); each clinical subgroup-child was matched to two general population-children with the same gender/age (6 months classes).
If the ITQOL has adequate discriminative validity, we hypothesize that relatively low ITQOL-scores will occur in subgroups with relatively many conditions and/or visits. Differences were evaluated by independent-samples t tests and by effect sizes (d) that were defined as d = [Mean (no conditions) − Mean (with condition)_=SD in the conditions-subgroup [35].
All analyses were done in SPSS, Version 11.0. The Medical Ethical Review Board of Erasmus MC — University Medical Center Rotterdam approved this study.

Findings

General population sample

In the general population sample, response was 83.0%; five questionnaires (1.2%) were not eligible for analysis (non-Dutch families). Response at the retest was 75.3% (one not eligible); 115 retest-questionnaires could be matched to a test-questionnaire (same child and respondent). Mean respondent age was 33.1 years (SD 7.1); 97% were mothers (Table 2). The children ranged from 3 to 46 months of age (mean 24.6; SD 13.8); 50% were girls; 20% of the children had parent-reported current asthma-like respiratory illness (Table 2).
Table 2
Characteristics of the study groups (general population sample n = 410; clinical simple of children with respiratory disease n = 138)
Variable
General population sample
Clinical sample (respiratory disease)
 
Mean (SD) or Range
n
% of Participants
Mean (SD) or Range
n
% of Participants
Demographic characteristics Parents
Respondent age (years)
Mean (SD)
33.1 (7.0)
  
33.9 (7.3)
  
Range
21–46
  
22–46
  
Respondent gender
Women
 
396
96.6
 
121
87.7
Respondent born in the Netherlands
Yes
 
403
98.3
 
120
87.0
Respondent educational level
Elementary school
 
8
2.0
 
4
2.9
Secondary education
 
332
80.9
 
88
63.8
Higher education/university
 
70
17.1
 
46
33.3
Respondent employment
Employed
 
223
54.4
 
79
57.2
Homemaker
 
148
36.1
 
41
29.7
Unemployed/disabled
 
39
9.5
 
18
13.0
Parents sharing household
Yes
 
401
97.8
 
121
87.7
Demographic characteristics Children
Age (months)
Mean (SD)
24.0 (12.3)
  
34.4 (16.4)
  
Range
3-46
  
5–65
  
Gender
Girls
 
203
49.5
 
56
40.6
Born in the Netherlands
Yes
 
406
99.0
 
134
97.1
Respiratory disease characteristics Children
Parent-reported current asthma
Yes
 
82
20.0
 
127
92.0
Wheezing (≥ 1 period or attack during past 4 weeks)
Yes
 
66
16.1
 
49
35.5
Dyspnea (≥ 1 period or attack during past 4 weeks)
Yes
 
60
14.6
 
79
57.2
Use of any asthma medication during past 4 weeks
Yes
 
58
14.1
 
90
65.2
Use of inhalation steroids during past 4 weeks
Yes
 
25
6.1
 
76
55.1
Other chronic conditions Children
Allergies
Yes
 
26
6.3
 
52
37.7
Eczema
Yes
 
58
14.1
 
45
32.6
Problems with hearing
Yes
 
43
10.5
 
31
22.5
Problems with seeing
Yes
 
7
1.7
 
3
2.2
Frequent stomachaches
Yes
 
16
3.9
 
24
17.4
Any other parent-reported chronic condition
Yes
 
21
5.1
 
10
7.2
One hundred and one ITQOL-items had <2.0% missing answers; maximum was 6.2% (scale Getting along, item ‘Appears sorry after having misbehaved’); ITQOL-items had <0.75% non-unique answers. Mean reported ITQOL-completion time was 14 minutes (range 2–60; SD 7.2). Four percent of the respondents considered the ITQOL-questionnaire to be difficult/very difficult; 46% neither difficult nor easy; 50% easy/very easy.

Clinical sample

In the clinical sample, mailed questionnaire response was 79.7%; 35 questionnaires (20.2%) were not eligible for analysis (non-Dutch families); retest-response was 82.6%. We could match 114 retest-questionnaires to a test-questionnaire (same child and respondent). Mean respondent age was 33.9 years (SD 7.3); 88% were mothers (Table 2). The children ranged from 5 to 65 months of age (mean 34.5; SD 16.4); 41% were girls; 92% of parents confirmed the presence of asthma (see Table 2 for more information).

ITQOL score distributions

Floor effects were absent (see Methods). In the general population sample four, and in the clinical sample three ITQOL-scales showed a ceiling effect (see Methods) (Table 3). In the general population sample, two ITQOL-scales (Getting along, Parental-emotional) showed statistically significant different scores between boys/girls (p < 0.05); six scales between age-subgroups (p < 0.05) (see Annex A).
Table 3
Score-distributions and psychometric properties of ITQOL-scales in the general population sample (n = 410) and in the clinical sample of children with respiratory illness (n = 138)
ITQOL-scales
Population
Mean (SD)
Range
% Mina
% Maxa
25th %tile
50th %tile
75th %tile
Cronbach's αc
Average item-own scale correlationb
Average item-other scale correlation
% Scaling success6
Physical
General population sample
97.2 (9.8)
13–100
0
79
100
100
100
0.92
0.78
0.04
100% (100)
functioning
Respiratory illness
85.9 (21.6)
0–100
2
28
85
93
100
0.94
0.81
0.17
100% (90)
Growth and
General population sample
86.5 (10.6)
55–100
0
16
78
88
95
0.84
0.56
0.19
100% (100)
development
Respiratory illness
82.6 (13.3)
50–100
0
11
73
85
93
0.82
0.53
0.21
99% (90)
Bodily pain
General population sample
83.8 (16.8)
8–100
0
35
75
83
100
0.87
0.76
0.24
100% (30)
 
Respiratory illness
78.5 (18.6)
17–100
0
23
75
83
92
0.84
0.71
0.24
100% (27)
Temperament/moods
General population sample
77.2 (10.5)
33–99
0
0
71
78
85
0.85
0.46
0.20
96% (180)
 
Respiratory illness
72.0 (12.9)
38–100
0
2
65
74
81
0.88
0.54
0.31
97% (162)
General behavior
General population sample
72.8 (12.7)
29–100
0
1
64
74
82
0.82
0.48
0.18
100% (130)
 
Respiratory illness
73.7 (14.0)
41–100
0
1
64
75
83
0.82
0.48
0.24
93% (117)
Getting along
General population sample
71.4(8.8)
32–96
0
0
67
72
77
0.73
0.36
0.17
94% (150)
 
Respiratory illness
72.3 (9.8)
43–93
0
0
65
73
80
0.72
0.36
0.22
79% (135)
General health
General population sample
79.0 (14.5)
15–100
0
2
72
81
90
0.79
0.47
0.18
100% (120)
 
Respiratory illness
56.2 (19.2)
15–100
0
1
42
55
70
0.82
0.51
0.24
98% (108)
Parental-emotional
General population sample
92.1 (10.5)
18–100
0
35
89
96
100
0.76
0.52
0.22
96% (70)
 
Respiratory illness
86.6 (13.8)
36–100
0
17
82
89
96
0.79
0.55
0.31
100% (63)
Parental-time
General population sample
93.0(11.0)
29–100
0
49
91
95
100
0.76
0.53
0.21
99% (70)
 
Respiratory illness
86.8 (17.7)
10–100
0
41
81
95
100
0.83
0.62
0.28
100% (63)
Family activities
General population sample
86.2(13.5)
25–100
0
24
79
88
96
0.79
0.55
0.23
100% (60)
 
Respiratory illness
na
na
na
na
na
na
na
na
na
na
na
Family cohesion
General population sample
75.3 (18.8)
0–100
1
21
60
85
85
na
na
0.15
na
 
Respiratory illness
72.9 (21.2)
0–100
1
23
60
60
85
na
na
0.24
na
Change in healthd
General population sample
56.1 (18.4)
0–100
1
11
50
50
50
na
na
0.03
na
 
Respiratory illness
70.9 (23.8)
25–100
0
31
50
75
100
na
na
0.16
na
a % of respondents with the highest, respectively lowest possible ITQOL scale score (ceiling/floor).
b Each item was correlated with the applicable scale excluding the item under consideration from the scale score.
c Average α of the ITQOL-multi-item scales 0.81 (general population sample), respectively 0.83 (sample children with respiratory illness).
d Score of 50 indicates child's health rating to be about the same now as 1 year ago; 0 much worse now than 1 year ago; 100 much better now than 1 year ago [9, 13].
e Percentage (corrected) item-own scale correlations being higher than corresponding item-other-scale correlations (number of item-other scale correlations per scale).
na: Not available (Family activities scale was not fielded in the sample of children with respiratory illness)/not applicable (single-item scales).

Internal consistency of ITQOL-scales

All ITQOL-multi-item scales showed adequate internal consistency in both samples (αs > 0.70) (Table 3). In gender/age-subgroups of the general population sample and of the clinical sample (Annex A), generally the internal consistencies of the ITQOL-scales were adequate, however some subgroup-αs were moderate (0.50–0.70), and one a concerning a very small subgroup (n = 13) was only 0.13.
In both samples, all ITQOL-multi-item scales showed on average higher (corrected) item-own scale correlation coefficients than item-other-scale correlation coefficients, and the percentage scaling success was above 90% for all scales in both samples except for one ITQOL-scale (Getting along) in the clinical sample, which supports that the majority of ITQOL multi-item scales represent separate domains (Table 3).

Test-retest reliability

In the general population sample, four ITQOL-scales showed adequate (ICC≥ 0.70; p < 0.01) and six ITQOL-scales showed moderate test-retest reliability (ICC 0.50–0.70; p < 0.01); only one out of twelve ITQOL-scales had a mean retest score that was statistically significantly different from the mean test score (p < 0.05), but the effect size was small (d = 0.20) (Table 4). Almost identical results with regard to test-retest reliability of the ITQOL-scales were found in the clinical population sample (Table 4).
Table 4
Test-retest reliability of the ITQOL in a random subgroup of the general population sample (n = 115) and in the clinical sample of children with respiratory illness (n = 114)
ITQOL-scales (test-retest)
Population
Test n = 115/114 mean (SD)
Retest n = 115/114 mean (SD)
p-value (Paired-samples t test)a
Effect size (d)b
Intra class correlation coeflicients
Physical functioning
General population sample
97 (11)
97 (12)
0.36
−0.02
0.69c
 
Respiratory illness
87 (20)
92 (16)
0.00
0.22d
0.68c
Growth and development
General population sample
86 (11)
84 (11)
0.01
−0.20d
0.67c
 
Respiratory illness
82 (14)
81 (12)
0.90
−0.01
0.77c
Bodily pain
General population sample
82 (18)
84 (17)
0.35
0.10
0.42c
 
Respiratory illness
79 (19)
78 (18)
0.50
−0.08
0.35c
Temperament and moods
General population sample
76 (13)
78 (12)
0.21
0.11
0.58c
 
Respiratory illness
72 (12)
74 (12)
0.09
0.14
0.68c
General behavior
General population sample
71 (14)
72 (13)
0.21
0.09
0.82c
 
Respiratory illness
73 (14)
72 (16)
0.44
−0.05
0.78c
Getting along
General population sample
71 (9)
72 (9)
0.19
0.11
0.74c
 
Respiratory illness
72 (10)
72 (11)
0.87
0.03
0.80c
General health
General population sample
79 (14)
80 (14)
0.17
0.09
0.77c
 
Respiratory illness
56 (19)
57 (18)
0.13
0.09
0.80c
Parental-emotional
General population sample
92 (11)
93 (9)
0.08
0.12
0.62c
 
Respiratory illness
87 (13)
88 (12)
0.25
0.10
0.59c
Parental-time
General population sample
92 (14)
92 (12)
0.69
0.03
0.50c
 
Respiratory illness
88 (16)
87 (16)
0.46
−0.04
0.57c
Family activities
General population sample
85 (15)
87 (14)
0.24
0.10
0.56c
 
Respiratory illness
na
na
na
na
na
Family cohesion
General population sample
77 (18)
76 (18)
0.59
−0.04
0.71c
 
Respiratory illness
73 (21)
76 (20)
0.18
0.14
0.55c
Change in healthe
General population sample
54 (18)
54 (17)
0.91
0.01
0.01
 
Respiratory illness
70 (24)
71 (23)
0.63
0.03
0.65c
a Paired-samples t tests for differences between the scale scores at the test and at the retest.
b Difference of the means divided by SD at the first measurement [35].
cp < 0.01.
d Indicates a small effect (0.2 ≤ d < 0.5) [35].
e Score of 50 indicates child's health rating to be about the same now as 1 year ago; 0 much worse now than 1 year ago; 100 much better now than 1 year ago [9, 13].

Concurrent validity

Generally, the hypothesized pattern of correlation coefficients between ITQOL- and TAPQOL-scales was present, except for ITQOL-scale Physical functioning that did not correlate well with TAPQOL-Motor functioning (Table 5). In the clinical sample, there were less ‘violations’ of the hypothesized pattern of correlation coefficients (7 ‘violations’; see Methods) than in the general population sample (11 ‘violations’) (Table 5).

Discriminative validity

As hypothesized, per comparison between subgroups, five to eight ITQOL-scales resulted in statistically significant lower scores in the subgroups with relatively many medical conditions, respectively physician-visits compared to the subgroups with relatively few conditions and/or visits (p < 0.05); the largest effect sizes of score-differences between contrasted subgroups (d ≥ 0.80) were found for the ITQOL-scales General health perceptions and Bodily pain (Table 6).

Discussion

In this first evaluation of the ITQOL among children as young as 3 months up to 5 ½ years in a random general population sample and a clinical sample of children with respiratory illness, we established the feasibility of this measure in an unsupported setting (mailed questionnaire). Our study supports the internal consistency, the concurrent and discriminative validity of the ITQOL-scales and provides (general population) reference/norm scores for clinical studies. The results give rise to some concerns about ceiling effects and test-retest reliability of scales, requiring further investigation (see below).

Limitations

The ITQOL was designed for children aged 2 months up to 5 years old. The only currently available ITQOL evaluation concerns Canadian 3–4 year old children from the general population and a follow-up of Neonatal Intensive Care [10]. Our general population sample did not include 5 year olds, since 48 months is the maximum age of children attending the Well-Child Care organization that sampled the data. Furthermore, we did invite parents of children aged 2 month old, but the youngest children in the study were reported to be 3 months old, at the time the questionnaires were completed. It turned out that the youngest eligible patients in the respiratory disease sample were 5 months old. We recommend additional ITQOL evaluations, especially in very young children (2 months-1 year). Since the vast majority of respondents in the actual samples were mothers, the current results can only be generalized to settings with comparable proportions mothers as respondents.
Another limitation of the study is that we compared ITQOL scores with TAPQOL scores, although the TAPQOL was developed and validated for children at least 1 year old. However, in the general population sample of this study, the TAPQOL proved to have adequate psychometric properties in the youngest subgroup (3–12 months) as well [36].
In our study, we did not assess whether parents as proxies gave adequate ratings; the child's health-related quality of life scores may be affected by parent-related characteristics next to child-related, especially child-health-related characteristics [6, 8]. We propose evaluating the impact of parentrelated characteristics, including ratings of parents’ own health, in proportion to the impact of child and child-health-related characteristics on ITQOL scores in future studies.

Feasibility

Despite its length (103 items), the current ITQOL was well accepted by parents in our study, similar to the Canadian evaluation [10]. However, in order to limit respondent burden when the ITQOL is applied in clinical studies, we strongly recommend developing and evaluating a short ITQOL version.

Score distributions

Five ITQOL-scales showed a ceiling effect to some degree in either the general population sample or the clinical sample, or both. Physical functioning showed the most profound ceiling [10]. Ceiling effects were less manifest (but still present) in the clinical sample than in the general population sample. Ceiling effects are a common phenomenon, but restrict the use of a measure to detect changes and to describe health beyond the average in relatively healthy populations.
In the general population sample, mean ITQOL-scale scores showed some statistically significant differences between gender/age subgroups. We recommend repeated studies, preferably with larger samples, to assess subgroup differences. This will facilitate additional analyses to evaluate to what extent differential item functioning (DIF) explains such gender/age subgroup differences, and/or to what extent those differences reflect ‘reality’ [37]. In any case, we recommend the use of gender/age specific reference values when comparisons are being made between scores in specific clinical subgroups and general population (reference) scores.

Reliability, validity and responsiveness to change

Studies in large, varied samples are needed for additional assessments of the internal consistency of ITQOL-scales in gender/age subgroups, specifically regarding the very young (< 1 year old). Furthermore, we advice future studies with larger sample sizes to conduct confirmatory factor analysis using structural equation modelling to establish factorial validity of the ITQOL scales. ITQOL test-retest reliability was acceptable for the majority of scales in both samples, but given a low test-retest reliability of some scales and some score differences between test and retest scores, we recommend further assessments in varied populations.
This study supported the concurrent and discriminative validity of the ITQOL in a crosssectional design, but responsiveness to change respectively longitudinal construct validity of the ITQOL has not been evaluated yet. We recommend doing so in future studies, in particular in the framework of clinical trials, in the course of which attention should be given to the optimal choice of the time specification of ITQOL items (‘during the past 4 weeks’, or ‘past week’, etcetera) in applications concerning fluctuating symptoms, as may be the case in respiratory disease.

Conclusions

Until now, the ITQOL is the only available multidimensional quality of life measure developed for children as young as 2 months up to 5 years old. This study supported the evidence that the ITQOL is a feasible instrument with adequate psychometric properties. The study provided reference ITQOL scores for gender/age subgroups. We recommend repeated evaluations of the ITQOL in varied populations, especially among very young children, including repeated assessments of test-retest characteristics and evaluations of responsiveness to change. We recommend developing and evaluating a shortened ITQOL version.

Acknowledgements

Carinova-Salland, Ommen, The Netherlands, Well-Child Care provider was responsible for the data collection in the general population sample. The physicians of the pediatric outpatient clinics of Erasmus University Medical Center Rotterdam and HAGA Hospital The Hague, The Netherlands were responsible for the data collection regarding the clinical sample (respiratory disease). We are grateful to the physicians, nurses, and assistants of Carinova-Salland, especially Margot P.H.M. Kobussen, RN, MNSc, and Margot Baardse, MD, and the pediatricians of Erasmus University Medical Center and HAGA Hospital, especially M. Nuijsink, MD, for facilitating this project. We thank E.M. Jansingh-Piepers, MD, Ilse Oonk, MA, Ghazaleh Sehat, Gert-Jan de Bruijn, MA, Ineke Vogel, MA and Gerard Borsboom, MA for help with the organization, data collection, data entry and statistical support.
This study was funded by the Netherlands Organization for Health Research and Development (ZonMw Grant #22000128).

Annex A

Mean scores of the ITQOL-scales and internal consistency of ITQOL-scales per age subgroup (<1, 1–2, 2–3, and 3–4 years old) and per gender subgroup in the general population sample and in the clinical sample of children with respiratory illness
1. Mean scores in age and gender subgroups of the general population sample
ITQOL-scales
Population
<1 Year n = 92 mean (SD)
1–2Years n = 116 mean (SD)
2–3 Years n = 114 mean (SD)
3–4 Years n = 85 mean (SD)
Boys n = 206 mean (SD)
Girls n = 203 mean (SD)
Physical functioning
General population sample
93.8 (15.0)b
98.1 (5.4)
97.5 (11.4)
98.7 (2.9)b
97.0 (10.9)
97.4 (8.6)
Growth and development
General population sample
88.8 (10.4)a
85.8 (10.9)
85.9 (10.3)
86.0 (10.8)
85.7 (11.0)
87.4 (10.2)
Bodily pain
General population sample
84.2 (16.7)
79.0 (17.6)b
85.1 (15.4)
87.9 (16.3)a
84.2 (16.8)
83.5 (16.8)
Temperament/moods
General population sample
81.1 (10.4)b
76.5 (10.7)
75.3 (10.7)a
76.8 (9.5)
77.7 (10.6)
76.7 (10.5)
General behavior
General population sample
na
74.7 (12.2)
70.9 (13.5)
72.8 (12.2)
71.8 (14.0)
73.9 (11.0)
Getting along
General population sample
na
71.7 (8.4)
70.5 (9.5)
72.1 (8.4)
70.3 (9.2)a
72.6 (8.2)a
General health
General population sample
81.1 (13.3)
77.5 (15.2)
79.4 (14.0)
78.7 (15.5)
78.4 (13.9)
79.7 (15.1)
Parental-emotional
General population sample
94.2 (8.9)a
92.6 (10.9)
91.3 (10.7)
90.1 (11.0)
91.0 (11.1)a
93.3 (9.7)a
Parental-time
General population sample
93.4 (8.1)
92.5 (11.4)
92.8 (10.6)
93.3 (13.5)
92.5 (12.3)
93.5 (9.4)
Family activities
General population sample
86.7 (13.5)
86.0 (13.5)
85.6 (14.0)
86.4 (13.3)
85.7 (13.7)
86.8 (13.4)
Family cohesion
General population sample
79.6 (19.2)a
76.1 (18.4)
73.6 (18.7)
72.3 (18.7)
74.2 (19.7)
76.5 (17.9)
Change in health
General population sample
na
57.4 (18.4)
54.6 (17.5)
55.9 (18.4)
56.9 (19.2)
55.3 (17.5)
2. Cronbach’s αs in age and gender subgroups of the general population and clinical sample
ITQOL-scales
Population
<1 year n = 92/13 Cronbach’s α
1– years n = 116/30 Cronbach’s α
2– years n = 114/33 Cronbach’s α
3– years n = 85/29 Cronbach’s α
Boys n = 206/82 Cronbach’s α
Girls n = 203/56 Cronbach’s α
Physical functioning
General population sample
nc
0.55
0.96
0.41
0.93
0.92
Respiratory illness
nc
0.98
0.88
0.95
0.93
0.95
Growth and development
General population sample
0.85
0.86
0.83
0.82
0.86
0.83
Respiratory illness
0.82
0.77
0.81
0.85
0.83
0.80
Bodily pain
General population sample
0.89
0.86
0.85
0.88
0.89
0.86
Respiratory illness
0.62
0.72
0.92
0.83
0.84
0.81
Temperament/moods
General population sample
0.86
0.86
0.84
0.81
0.85
0.84
Respiratory illness
0.89
0.93
0.87
0.89
0.86
0.91
General behavior
General population sample
na
0.86
0.85
0.81
0.87
0.73
Respiratory illness
na
0.83
0.82
0.77
0.80
0.85
Getting along
General population sample
na
0.70
0.79
0.72
0.76
0.69
Respiratory illness
na
0.75
0.69
0.68
0.73
0.70
General health
General population sample
0.75
0.81
0.79
0.80
0.77
0.81
Respiratory illness
0.88
0.88
0.81
0.82
0.81
0.84
Parental-emotional
General population sample
0.73
0.82
0.77
0.71
0.77
0.76
Respiratory illness
0.13
0.89
0.68
0.81
0.77
0.82
Parental-time
General population sample
0.50
0.78
0.76
0.86
0.80
0.68
Respiratory illness
0.60
0.89
0.76
0.78
0.83
0.83
Family activities
General population sample
0.79
0.79
0.84
0.77
0.79
0.80
Respiratory illness
na
na
na
na
na
na
ap <0.05 (Two-sided independent-samples t test of given age group vs. other three age groups combined, respectively boys vs. girls).
bp <0.01 (Two-sided independent-samples t test of given age group vs. other three age groups combined, respectively boys vs. girls).
na: Not applicable/not available (scales apply to children of 1 year and older; Family activities scale was not fielded in this sample of children).
nc: Could not be calculated (too many items had zero variance).

Onze productaanbevelingen

BSL Podotherapeut Totaal

Binnen de bundel kunt u gebruik maken van boeken, tijdschriften, e-learnings, web-tv's en uitlegvideo's. BSL Podotherapeut Totaal is overal toegankelijk; via uw PC, tablet of smartphone.

Literatuur
Over dit artikel

Andere artikelen Uitgave 3/2007

Quality of Life Research 3/2007 Naar de uitgave