SPECIAL ARTICLECalibration and Validation of the Youth Activity Profile: The FLASHE Study
Introduction
A variety of measures have been used to assess physical activity (PA) levels in youth but they each have inherent advantages and disadvantages.1 Methods found to be the most accurate also tend to be the most expensive or complicated to use.2 Therefore, this interplay among accuracy, feasibility, and scope of the measure typically determines the selection of the most appropriate tool for a given research application.3, 4, 5
Questionnaires measuring PA are known to be susceptible to a variety of sources of error, yet they provide key advantages for many types of PA research.6, 7, 8 Questionnaires are particularly well suited for large-scale applications at the national or community level because they provide detailed profiles of activity behavior while capturing important contextual information (e.g., type, location). A vast array of PA questionnaires is available in the literature for assessing youth; however, only a few have been found to have acceptable measurement properties.7, 9 This can be partially explained by the combination of the unique patterns of youth activity10 and also the limitations in the design of the instruments as well as the lack of context-related cues to facilitate accurate recall.11 For example, a review from Biddle and colleagues9 identified only three questionnaires of PA (of 89 total) as having potential for refinement and use in large-scale applications, and two of these (i.e., the Youth Risk Behavior Surveillance Survey and Physical Activity Questionnaire for Children/Adolescents) include reference to context in their design (i.e., context-related items). A limitation of these two instruments though is that neither can be readily converted into meaningful outcome measures. The Physical Activity Questionnaire for Children/Adolescents, for example, uses a simple 5-point scale with narrative choices ranging from rarely to often to capture levels of activity in different settings. The items capture useful information about PA levels but cannot be used to estimate time spent in moderate to vigorous PA (MVPA) or adherence to public health guidelines.
The authors developed the Youth Activity Profile (YAP) to specifically address these limitations. A unique advantage of the YAP is that it was designed to facilitate calibration of both reported PA and sedentary behavior (SB) into more-accurate and -useable estimates. The calibration of SB is a unique feature of the YAP, considering that the availability of related measures for youth populations are still quite limited.12, 13 Calibration is a standard step in the process used to obtain meaningful information from accelerometry-based activity monitors and it offers the same potential for improving the accuracy and utility of report-based measures. Through calibration, a crude estimate from a report-based measure such as the YAP can be re-scaled to replicate estimates of PA behavior obtained by more objective monitor-based methods.5, 8, 14, 15 Calibration of report-based measures is especially important for surveillance work and other large-scale applications because it helps to minimize the large disparities that have commonly been observed when comparing estimates with monitor-based measures.16, 17 The calibration approach has been tested with the YAP and demonstrated that predicted values and accelerometer estimates of MVPA were correlated by 0.19–0.75 (depending on the period of the day) and were deemed equivalent at the 10%–30% level. However, this study was done with a sample of 291 youth from Midwest U.S.18, 19; therefore, additional work is needed to determine if the YAP calibration approach holds in a different sample and independently of the activity monitor/measurement methodology used.
The present study addresses this need by evaluating the predictive utility of the YAP algorithms in a sample of adolescents involved in the National Cancer Institute’s Family Life, Activity, Sun, Health, and Eating (FLASHE) study. The authors specifically calibrated the YAP against wrist-worn ActiGraph measures of MVPA and SB and validated the algorithms in an independent sample also enrolled in FLASHE.
Section snippets
Study Design and Participants
The FLASHE study (http://cancercontrol.cancer.gov/brp/hbrb/flashe.html) was a cross-sectional national study focused on assessing diet and PA behaviors (and their correlates) among adolescent children (aged 12–17 years). The calibration/validation of the YAP was conducted in a randomly selected subsample of adolescents in FLASHE (n=628). Participants were asked to wear an ActiGraph GT3X+ on the dominant wrist for 7 full days (waking hours and sleep) and complete (self-administered) the YAP via
Results
The results are described separately for the calibration and validation phase, and for each of the key segments of the week: school, out of school, and weekend.
Discussion
This study examined the utility of a streamlined calibration method for re-scaling the YAP to match objective data from wrist-worn ActiGraph data. The value of the present calibration is that the YAP estimates are designed to correspond with wrist-worn ActiGraph data that are used within segments of the FLASHE sample. The YAP and the proposed calibration algorithms can be implemented in other national or community projects where it is unfeasible to collect objective data to assess youth PA
Acknowledgments
This article is part of a theme issue supported by the National Institutes of Health. The findings and conclusions in this article are those of the author(s) and do not necessarily represent the official position of the National Institutes of Health. Leslie A. Lytle, Ph.D. and Louise C. Mâsse, Ph.D. served as Guest Editors of the theme issue.
The Family Life, Activity, Sun, Health, and Eating (FLASHE) study was funded by the National Cancer Institute under contract number HHSN261201200039I
References (42)
- et al.
The current state of physical activity assessment tools
Prog Cardiovasc Dis
(2015) - et al.
A cognitive model of children's reporting of food intake
Am J Clin Nutr
(1994) - et al.
Physical activity in U.S.: adults compliance with the Physical Activity Guidelines for Americans
Am J Prev Med
(2011) - et al.
The FLASHE study: survey development, dyadic perspectives, and participants characteristics
Am J Prev Med
(2017) - et al.
Recruitment, enrollment, and response of parent–adolescent dyads in the FLASHE study
Am J Prev Med
(2017) - et al.
Equating accelerometer estimates among youth: the Rosetta Stone 2
J Sci Med Sport
(2016) - et al.
Equating accelerometer estimates of moderate-to-vigorous physical activity: in search of the Rosetta Stone
J Sci Med Sport
(2011) - et al.
Surveillance of youth physical activity and sedentary behavior with wrist accelerometers
Am J Prev Med
(2017) - et al.
Intra-individual variation and estimates of usual physical activity
Ann Epidemiol
(1999) - et al.
Blood pressure, stroke, and coronary heart disease. Part 1, Prolonged differences in blood pressure: prospective observational studies corrected for the regression dilution bias
Lancet
(1990)
Sources of variance in 24-hour dietary recall data: implications for nutrition study design and interpretation
Am J Clin Nutr
Statistical methods for estimating usual intake of nutrients and foods: a review of the theory
J Am Diet Assoc
Assessment of physical activity in youth
J Appl Physiol
Guide to the assessment of physical activity: clinical and research applications: a scientific statement from the American Heart Association
Circulation
Framework for physical activity as a complex and multidimensional behavior
J Phys Act Health
Reported physical activity and sedentary behavior: why do you ask?
J Phys Act Health
Physical activity by self-report: a brief history and future issues
J Phys Act Health
Physical activity questionnaires for youth: a systematic review of measurement properties
Sports Med
Modeling errors in physical activity recall data
J Phys Act Health
An assessment of self-reported physical activity instruments in young people for population surveillance: Project ALPHA
Int J Behav Nutr Phys Act
Measurement issues in the assessment of physical activity in children
Res Q Exerc Sport
Cited by (70)
The availability between recreational facilities and physical activity of US adolescents
2024, Preventive Medicine ReportsExploring differences in adolescent BMI and obesity-related behaviors by urban, suburban, and rural status
2022, Preventive Medicine ReportsCitation Excerpt :Physical activity was evaluated for minutes of activity per day at school, out of school, and on weekends; each variable is expressed in minutes as a composite score and indicates the Youth Activity Profile (YAP) predicted time per day spent in moderate-to-vigorous physical activity (MVPA) (National Cancer Institute, October, 2017). The YAP was designed to estimate minutes of MVPA and sedentary behaviors and was calibrated and validated in adolescents of the FLASHE study (National Cancer Institute, October, 2017; Saint-Maurice et al., 2017). The YAP has been identified as a quality measure to characterize both MVPA and sedentary behaviors in adolescents (National Cancer Institute, October, 2017; Saint-Maurice et al., 2017).
The role of motivation on physical activity and screen time behaviors among parent-adolescent dyads: The FLASHE study
2021, Preventive MedicineCitation Excerpt :The Youth Activity Profile (YAP) self-report survey was utilized to assess PA of the adolescent participants. The YAP is a 15-item questionnaire that assesses activity patterns both during and out of school the previous week (Saint-Maurice and Welk, 2014) and has been validated against accelerometry for these analyses (Saint-Maurice et al., 2017). For the current study, PA was represented as a continuous variable derived as the total predicted (calibrated with accelerometry) minutes of physical activity (in school, out of school, and weekend).
The Association Between Neighborhood Public Transportation Usage and Youth Physical Activity
2021, American Journal of Preventive MedicineActive living environments mediate rural and non-rural differences in physical activity, active transportation, and screen time among adolescents
2021, Preventive Medicine ReportsCitation Excerpt :Although included and excluded dyads had similar demographic characteristics, rural adolescents were more likely to be excluded making it possible this, combined with the relatively low response rate of the survey, could have resulted in a sample that does not represent all adolescents living in rural areas. The fact that all adolescents in the study reported 60 min or more of daily MVPA is concerning, although other commonly used self-report measures have similarly been found to overestimate MVPA when validated by accelerometer (Saint-Maurice et al., 2017). However, this study was designed to compare MVPA rather than provide estimates of prevalence.
Early morning physical activity is associated with healthier white matter microstructure and happier children: the ActiveBrains project
2024, European Child and Adolescent Psychiatry
This article is part of a theme section titled The Family Life, Activity, Sun, Health, and Eating (FLASHE) Study: Insights Into Cancer-Prevention Behaviors Among Parent–Adolescent Dyads.