Next Article in Journal
Patterns of Active Travel and Physical Activity among Adolescents in Israel
Next Article in Special Issue
Towards Co-Design in Delivering Assistive Technology Interventions: Reconsidering Roles for Consumers, Allied Health Practitioners, and the Support Workforce
Previous Article in Journal
Advancements in Monitoring Water Quality Based on Various Sensing Methods: A Systematic Review
Previous Article in Special Issue
What Does It Take to Get Somebody Back to Work after Severe Acquired Brain Injury? Service Actions within the Vocational Intervention Program (VIP 2.0)
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Review

An Evaluation of the Overall Utility of Measures of Functioning Suitable for School-Aged Children on the Autism Spectrum: A Scoping Review

by
Maya Hayden-Evans
1,2,3,*,
Benjamin Milbourn
1,2,3,
Emily D’Arcy
1,2,3,
Angela Chamberlain
1,2,3,
Bahareh Afsharnejad
1,
Kiah Evans
1,2,3,4,
Andrew J. O. Whitehouse
2,3,5,
Sven Bölte
1,6,7 and
Sonya Girdler
1,3,4,6
1
Curtin Autism Research Group, School of Allied Health, Curtin University, Perth 6102, Australia
2
Telethon Kids Institute, University of Western Australia, Perth 6009, Australia
3
Autism CRC, Long Pocket, Brisbane 4850, Australia
4
School of Allied Health, University of Western Australia, Perth 6009, Australia
5
School of Psychological Science, University of Western Australia, Perth 6009, Australia
6
Center of Neurodevelopmental Disorders (KIND), Centre for Psychiatry Research, Department of Women’s and Children’s Health, Karolinska Institutet & Stockholm Health Care Services, Region Stockholm, 104 31 Stockholm, Sweden
7
Child and Adolescent Psychiatry, Stockholm Health Care Services, Region Stockholm, 104 31 Stockholm, Sweden
*
Author to whom correspondence should be addressed.
Int. J. Environ. Res. Public Health 2022, 19(21), 14114; https://doi.org/10.3390/ijerph192114114
Submission received: 30 September 2022 / Revised: 25 October 2022 / Accepted: 25 October 2022 / Published: 28 October 2022

Abstract

:
A diagnosis of an autism spectrum condition (autism) provides limited information regarding an individual’s level of functioning, information key in determining support and funding needs. Using the framework introduced by Arksey and O’Malley, this scoping review aimed to identify measures of functioning suitable for school-aged children on the autism spectrum and evaluate their overall utility, including content validity against the International Classification of Functioning, Disability and Health (ICF) and the ICF Core Sets for Autism. The overall utility of the 13 included tools was determined using the Outcome Measures Rating Form (OMRF), with the Adaptive Behavior Assessment System (ABAS-3) receiving the highest overall utility rating. Content validity of the tools in relation to the ICF and ICF Core Sets for Autism varied, with few assessment tools including any items linking to Environmental Factors of the ICF. The ABAS-3 had the greatest total number of codes linking to the Comprehensive ICF Core Set for Autism while the Vineland Adaptive Behavior Scales (Vineland-3) had the greatest number of unique codes linking to both the Comprehensive ICF Core Set for Autism and the Brief ICF Core Set for Autism (6–16 years). Measuring functioning of school-aged children on the spectrum can be challenging, however, it is important to accurately capture their abilities to ensure equitable and individualised access to funding and supports.

1. Introduction

Autism spectrum conditions (hereinafter autism, aligning with the preferred language of the autistic community [1]) encompass a range of persistent neurodevelopmental outcomes, primarily characterised by altered social communication and social interaction behaviours, along with the presence of restricted or repetitive behaviours or interests [2,3]. According to these diagnostic criteria outlined in both the latest version of the Diagnostic and Statistical Manual of Mental Disorders [3] and the International Classification of Diseases [2], these traits must also have a considerable impact on an individual’s ability to function in educational, family, occupational, personal, social and/or other important domains and contexts [2,3]. Restrictions within these contexts can result in reduced social outcomes for children on the autism spectrum when compared to their peers [4]. Globally, the rate of autism diagnoses is increasing, with an estimated rate of at least 1 in 100 children diagnosed with autism [5,6], with the highest prevalence of autism seen among school-aged children [6,7].
During the school years, children spend a significant amount of time with their peers and are heavily influenced by their interactions with others. For young people on the spectrum, establishing and maintaining peer support networks may be hindered by their social and communication challenges [4], limiting their ability to develop the skills required to successfully navigate important developmental stages. In addition, school-aged children are driven to acquire complex competencies and develop independence across various areas of functioning, integrating their sense of self [8]. Given that impaired functioning is associated with an autism diagnosis, it is important to ensure that children on the spectrum are provided with sufficient supports to maximise their potential during their development.
In 2013, the Australian Government launched the National Disability Insurance Scheme (NDIS) following an inquiry into the previous disability support system, identifying the need for systemic change to improve outcomes for people with disabilities, including autism [9]. Delivered by the National Disability Insurance Agency (NDIA), the NDIS aspires to increase independence and promote social and economic engagement of individuals with significant and permanent disability by funding reasonable and necessary supports and services [10]. A substantial portion (65%) of children aged between seven and 14 who are currently accessing the NDIS are diagnosed with autism [11]. However, diagnosis alone provides limited information regarding an individual’s functioning and support needs which can vary significantly between individuals [12]. Therefore, the Australian guideline on autism assessment and diagnosis recommends that individuals on the spectrum receive a comprehensive needs assessment, including an assessment of functioning, to determine the level of support they require to participate effectively in their daily lives [13]. This approach aligns with other international guidelines that recommend assessment of functioning, including strengths, skills, impairments and needs, occurs across multiple contexts such as at home and at school [14,15,16].
Functioning, as it relates to health, is defined by the World Health Organization (WHO) [17] as “an umbrella term for body functions, body structures, activities and participation. It denotes the positive aspects of the interaction between an individual (with a health condition) and that individual’s contextual factors (environmental and personal factors)” (p. 8). The WHO’s framework for measuring health and disability, known as the International Classification of Functioning, Disability and Health (ICF), is a biopsychosocial model that can be used to organise information relating to functioning and disability [17]. Although useful for classifying information across the categories of Body Functions, Activities and Participation, and Environmental Factors, the comprehensiveness of the framework limits it’s utility in clinical settings [18]. However, recent publications suggest that the ICF can be used as a framework to guide the diagnostic and assessment process, in capturing the holistic nature of functioning and accounting for variability across contexts [13,19].
Despite recognising the importance of assessing functioning associated with autism, there is to date no universally accepted measure designed to assess the unique functional strengths and challenges of children on the spectrum [20]. At an individual level, understanding functioning is essential to planning and providing supports. The school years are a critical period of development, during which children are expected to comply with the demands and expectations of the classroom environment as well as in variable social contexts [21]. A benefit of the ICF is that it takes into account the unique environmental factors impacting a child’s functioning [17]. As highlighted by Bronfenbrenner’s bioecological theory, children develop and function across multiple contexts or ‘systems’, ranging from their immediate environments (microsystems) through to the broader contexts of society and culture (macrosystems) [21]. Understanding the functional impacts of autism across contexts is key in ensuring children have adequate opportunities to challenge themselves and develop their own identities. More broadly, understanding the functioning of individuals on the spectrum is important in developing and managing models of service delivery, allocating funding, and measuring support needs at a population level.
Previous research investigating the psychometric properties of measures has focused on younger children, up to the age of six [22], likely due to the emphasis on early assessment and intervention in autism. Other reviews of measures applicable for school-aged children on the spectrum focus on screening [23,24] and diagnostic measures [25]. However, given the shift towards assessing functioning alongside or within the diagnostic assessment process, there is a need to understand the utility of measures of functioning across age groups.
The Outcome Measures Rating Form (OMRF) [26] is a tool for evaluating the overall utility of outcome measures. The OMRF documents the focus of the measure, clinical utility, scale construction, standardisation, reliability, and validity. The overall utility of a measure is determined according to ease of availability, quality of psychometric properties, and level of clinical utility [26]. Clinical utility has been further conceptualised as consisting of four main components: (1) appropriate, including effectiveness and relevance; (2) accessible, including resource implications and procurement; (3) practicable, including functionality, suitability, and training or knowledge required; and (4) acceptable, from the perspective of clinicians, clients and society [27]. The COnsensus-based Standards for the selection of health Measurement INstruments (COSMIN) is an initiative aiming to improve the selection of health measurement instruments by facilitating evaluation of their content and measurement properties [28]. The COSMIN refers to three main quality domains: (1) reliability; (2) validity; and (3) responsiveness.
Content validity refers to how accurately the content of an instrument reflects the construct it intends to measure [29]. Validity is often measured indirectly using methods such as Rasch, factor analysis, or Item Response Theory; however, these methods alone may be limited in determining an instrument’s true validity [30]. Derived from the extensive ICF framework and developed using a rigorous, multi-phase research process with international data collection, the ICF Core Sets for Autism have established content validity and are well placed in providing a reference point in determining the content validity of existing measures evaluating the functioning in this population [31,32].
This review aimed to evaluate the overall utility of existing assessment of functioning measures suitable for assessing school-aged children on the spectrum. Research objectives included: identifying appropriate tools, investigating the components of overall utility using the OMRF [26] and determining their content validity against the ICF Core Sets for Autism [20]. This review provides a unique contribution to the current body of literature investigating measures of functioning in autism, summarising their overall utility, as well as providing new evidence highlighting their content validity for school-aged children on the spectrum. This review is expected to provide both an overview of the measures currently available to assess functioning in this age group, and guide clinicians when evaluating the suitability of existing measures for use with school-aged children, ranging between six and 16 years, on the spectrum.

2. Materials and Methods

2.1. Study Design

Scoping reviews can be used to explore a topic and synthesise the findings of existing research, identifying gaps in the current literature [33]. This review adopted the scoping review framework introduced by Arksey and O’Malley [33] and later refined by Levac et al. [34] and Daudt et al. [35]. The Preferred Reporting Items for Systematic reviews and Meta-Analyses extension for Scoping Reviews (PRISMA-ScR) is a checklist that was developed based on these existing frameworks to provide further clarity in reporting requirements of scoping reviews [36]. The scoping review framework and PRISMA-ScR were initially utilised to identify existing measures of functioning for school-aged children on the spectrum, then to evaluate their overall utility based on relevant research articles. This review undertook the following steps: (1) identifying the research question; (2) identifying relevant measures and studies; (3) selecting studies; (4) charting the data (including a methodological assessment of quality); and (5) collating, summarising, and reporting the results [33,34,35,36].

2.2. Identifying Relevant Tools and Studies

Scoping search strategies typically involve searching multiple sources, including both published and grey literature, to obtain a broad overview of relevant existing literature [34]. Since functioning is a broad concept that can be broken down into individual (e.g., body functions, body structures, activities) and contextual components (e.g., personal and environmental factors), the literature search was conducted in two phases: (1) search for relevant measures of functioning; and (2) search for studies evaluating the utility of those measures.

2.2.1. Phase One

Measures were initially identified via internet searches, including Google, websites of major publishers (e.g., Pearson and Acer), reference books, catalogues of measures, and consultation with clinicians involved in assessing the functioning of individuals with neurodevelopmental conditions (Figure 1). Measures were eligible for inclusion in the review if they were: (1) available in English; (2) reflected at least six of the nine chapters included in the Activities and Participation domain of the ICF, to ensure inclusion of measures broadly assessing functioning; (3) were appropriate for use with individuals aged between six and 16 years, including measures that assessed either all or part of that range; and, (4) were published between January 2000 and June 2022. This timeframe was selected to ensure only the most recent versions of measures were included, aligning with current evidence-based practices. Measures were excluded if they: (1) only measured functioning in a specific population outside of neurodevelopmental conditions; (2) primarily measured impairment associated with a specific health condition (i.e., diagnostic tools); (3) had been superseded by a more recent version; or, 4) were no longer available online and/or in print. A shortlist of relevant measures was determined by two reviewers, guided by these criteria.

2.2.2. Phase Two

Targeted literature searches were conducted to identify articles reporting on aspects of overall utility, further defined in Table 1, of each measure identified in Phase One. The electronic databases ProQuest, Embase, CINAHL, and Scopus were used to search the literature for relevant articles published in English since 2000 (Figure 2). Search terms were grouped in relation to aspects of overall utility and the title of the measures, and searched for in the title or abstract of relevant resources. Combinations of search terms were truncated, exploded and adjusted with the assistance of a faculty librarian to meet the requirements of individual databases. Measure-specific search terms are included in Appendix A. Where applicable, the manuals of relevant measures were retrieved.

2.3. Selecting Studies

An iterative approach was utilised to ensure transparency and rigour of the scoping review process [34]. The inclusion and exclusion criteria were refined throughout the study selection process as familiarity with the research topic increased [33]. Studies were included if they reported on one or more aspects of overall utility of an included measure, and were peer-reviewed and available in full text. Studies were excluded if they only reported on the utility of an existing measure’s cultural adaptation.

2.4. Charting the Data

Data were extracted from the selected articles by two separate reviewers in line with the Arksey and O’Malley [33] framework. A data extraction table was developed and used to ensure a uniform data extraction process. Data from each of the articles were extracted in relation to the purpose of the study, study population, participant age, and methodological quality. Two reviewers independently evaluated the quality of the articles included in the review using the QualSyst checklists for assessing the quality of studies [37]. The QualSyst tool includes a 14-item checklist for evaluating quantitative studies and a 10-item checklist for evaluating qualitative studies. Each study was allocated a score represented as a percentage of 100 and a corresponding label indicating the study’s quality. As outlined by Kmet, Cook and Lee [37] in the user manual, a score of more than 80% indicates a strong study, 70–80% indicates good quality, 50–69% is adequate, and less than 50% indicates the study was of poor quality. Any inconsistencies in scores between the reviewers were resolved via discussion until total agreement was reached.
Two reviewers independently completed the OMRF [26] for each measure, taking into consideration the results of the targeted literature searches and the information included in the measures’ manuals, to evaluate their overall utility. Following this, any discrepancies between the two reviewers were discussed until consensus was reached. Using the OMRF [26], overall utility is assigned a descriptive rating, ranging from poor to excellent. An overall poor rating indicates poor clinical utility, the measure is not easily available, and has poor reliability and validity. An overall adequate rating indicates adequate to excellent clinical utility, the measure is easily available and has adequate to excellent reliability and validity. An overall excellent rating indicates adequate to excellent clinical utility, measure is easily available and has excellent reliability and validity.
In order to further determine the content validity of the included measures, specifically for autistic populations, meaningful concepts of each question or item included in the measure were independently linked by two reviewers to the ICF following the methodological rules outlined by Cieza et al. [38]. Using this methodology, items were first linked to the comprehensive ICF coding framework and later to specific ICF Core Sets for Autism, including the Comprehensive ICF Core Set and the Brief ICF Core Set for Autism (6–16 years) [20]. This process involved identifying the meaningful concepts in each item and linking these, as well as any examples, to the ICF. Meaningful concepts that were able to be linked to the ICF are referred to from this point forward as ‘codes’. Meaningful concepts that were determined ‘non-definable’ or ‘not covered’ in the ICF are not reported here. Consensus meetings were arranged to discuss any differences in the linking until total agreement was reached. Where the reviewers were unable to agree completely on a particular code for a meaningful concept, a third external reviewer experienced in ICF linking was consulted.

2.5. Collating, Summarising and Reporting the Results

PRISMA flow diagrams were developed and used to demonstrate the search process for Phases One and Two of this study. Key data extracted from the included articles were summarised and tabulated, including assessment tool characteristics, ICF Activities and Participation chapters covered, QualSyst ratings, and individual aspects of, as well as overall, utility. Descriptive statistics explaining the included measures’ coverage of both the comprehensive ICF Core Set for Autism and the Brief ICF Core Set for Autism (6–16 years) are also presented. A narrative synthesis of the available data was also conducted to summarise and highlight the key findings of the review.

3. Results

3.1. Identifying and Selecting Relevant Measures and Studies

Phase One identified 119 potential measures thorough searches of multiple sources. After applying the eligibility criteria listed above, 13 of these measures were deemed eligible for inclusion in the review. Targeted literature searches conducted in Phase Two returned a total of 106 abstracts. Once duplicates had been removed, 86 abstracts remained to be screened, and a total of 47 full-text articles were assessed for eligibility. The overall utility of the 13 eligible measures were assessed using a total of 35 original research articles, and two assessment manuals. The majority of articles investigating the utility of the measures were published by the authors of the measures themselves and no articles meeting the eligibility criteria were identified for either the Adaptive Behavior Assessment System (ABAS-3) or the Vineland Adaptive Behavior Scales (Vineland-3).

3.2. Measures of Functioning

An overview of the measures of functioning eligible for inclusion in this review, including a key for the abbreviations used in this section, is presented in Table 2.
Four of the measures (ABAS-3, AusTOMs-OT, LIFE-H and Vineland-3) have a broad age range and can be used to assess functioning of individuals across the lifespan. The COPM is suitable for anyone aged over eight years. The remainder of the measures were intended to assess child and youth populations under the age of 21 (CAPE/PAC, PEM-CY, PEDI-CAT and PEDI-CAT ASD, PEGS, and SCOPE), and one measure can be used for individuals aged between 4 and 6 years (CPQ). Measures were predominantly developed in Canada (COPM, CAPE/PAC, LIFE-H, PEM-CY, and PEGS) and the USA (ABAS-3, PEDI-CAT, PEDI-CAT ASD, SCOPE and Vineland-3).
Six of the measures were designed to be administered as self- or proxy-report questionnaires (ABAS-3, CPQ, LIFE-H, PEM-CY, PEGS, and ROPP). Similarly, the PEDI-CAT and PEDI-CAT ASD are administered as proxy-report computer adaptive tests. Three of the measures were intended to be completed by a health professional either as an interview (COPM) or by rating an individual’s functioning following interaction with them (AusTOMs-OT and SCOPE). The CAPE-PAC and Vineland-3 have a variety of administration options, meaning they can be completed as an interview or proxy-report questionnaire.
The number of ICF Activity and Participation chapters covered by each included measure ranged between six and nine, with an average of eight chapters being covered. All measures included at least one question relating to the chapters of Domestic Life and Major Life Areas. The ICF chapters with the lowest representation across the measures of functioning were General Tasks and Demands and Communication, with only nine of the 13 measures including a question linking to these chapters. The following measures included at least one question linking to each of the nine chapters of the Activities and Participation domain of the ICF: ABAS-3, LIFE-H, PEDI-CAT, PEDI-CAT ASD, and Vineland-3.

3.3. Methodological Quality

The methodological quality of the studies reporting on the psychometric properties of the measures included in the review are presented in Table 3. The quality of the studies, scored by two independent reviewers using the QualSyst checklists developed by Kmet, Cook and Lee [37] ranged between adequate (60%) and strong (100%).

3.4. Psychometric Properties

An overview of the psychometric properties available for each measure and an assessment of their overall utility is presented in Table 4. Overall utility ratings ranged from poor to excellent, with the ABAS-3 receiving the highest overall rating and the CAPE-PAC receiving the lowest overall rating on the OMRF. Information regarding at least one type of reliability and validity was available for all measures. Responsiveness was the least reported property, with this information only available for five of the 13 assessments.
General content validity of the measures ranged from adequate to excellent, however, none of the measures included in this review were developed with the specific intention of assessing functioning of individuals on the spectrum. The ‘Activities and Participation’ domain of the ICF was most commonly assessed by the measures, with all measures including codes linking to a chapter of this domain, ranging between 21% and 100% of total codes. Three assessments tools (CAPE-PAC, COPM and CPQ) solely assessed functioning classified as Activities and Participation. Coverage of the Body Function domain ranged between 0% and 79% of total codes, with the AusTOMs-OT having the greatest number of codes linking to chapters of this domain. Environmental Factors were assessed less frequently, ranging between 0% and 42% of total codes. Only four measures included codes linking to Environmental Factors (ABAS-3, PEM-CY, ROPP and SCOPE). More information regarding the distribution of codes across the domains and chapters of the ICF is included in Table 5.
Coverage of the comprehensive ICF Core Set for Autism ranged between 49% and 95%, with the ABAS-3 having the greatest total number of codes linking to this core set. Coverage of the Brief ICF Core Set for Autism (6–16 years) ranged between 35% and 73%, with the CAPE-PAC having the greatest total number of linked codes. However, all of these codes were linked to the Activities and Participation domain of the ICF. The percentages of total codes linking to the ICF Core Sets for Autism, both the Comprehensive and Brief (6–16 years), are presented in Table 6 for all included measures.
The percentages of unique codes linking to the comprehensive ICF Core Set for Autism and the Brief ICF Core Set (6–16 years) were also determined and are presented in Table 7. Overall, coverage of the Comprehensive ICF Core Set for Autism ranged between 11% and 61%, with the Vineland-3 having the greatest percentage of unique codes linking to this core set. Coverage of items relevant to the Brief ICF Core Set for Autism (6–16 years) was less, ranging between 5% and 58%, with the Vineland-3 again having the highest percentage of unique codes linking to this core set.

4. Discussion

This scoping review aimed to identify existing measures of functioning suitable for use with school-aged children on the spectrum and evaluate the quality of their psychometric properties, specifically content validity. The results of this review identify the limitations of current measures of functioning, highlighting the variability in content validity of these measures for school-aged children on the spectrum, and providing further evidence that, at present, a suite of measures is required to effectively assess functioning of school-aged children on the spectrum. Existing measures focus almost exclusively on functioning in relation to activity participation without exploring the impact of body functions or environmental factors on an individual’s ability to function. This review also emphasised other inconsistencies across existing measures of functioning, both in their overall utility, and their methods of administration.
In addition to the presence of key features such as repetitive and inflexible behaviour patterns and difficulties during social interactions, a diagnosis of autism requires that these features significantly impact an individual’s ability to function across a range of contexts, including at home, work and/or school [84]. Although impaired functioning is inherent to a diagnosis of autism, the methods of obtaining and interpreting this information remains unclear. The findings of this review indicate that there is no single measure that adequately covers all areas of functioning in which a school-aged child on the spectrum may experience difficulties, with environmental factors being particularly underrepresented in the assessment tools reviewed. These results are supported by the information outlined in current guidelines for assessing and diagnosing autism, highlighting the importance of obtaining information from multiple sources to build an accurate and comprehensive picture of how well a person is able to function in their everyday life, which includes multiple environmental contexts [13,16,85].
Developed following a rigorous process endorsed by the WHO, the ICF Core Sets provide an appropriate framework for organising information relating to functioning, and are also considered a suitable basis for development of tools to comprehensively measure functioning in particular populations [18]. The ICF Core Sets for other conditions, including hearing loss [86], spinal cord injuries [87] and cancer [88], have been operationalised through the development of outcome measures designed to assess functioning or intervention efficacy [86,87,88]. In their original form, the ICF Core Sets provide a standard for evaluating functioning in particular health conditions. However, the development of measures based on the ICF Core Sets can improve their clinical utility and promote the progression of more holistic, biopsychosocial approaches to measuring functioning.
Overall utility of measures of functioning included in this review varied significantly, ranging from poor to excellent according to the OMRF standards. The ABAS-3 received the highest overall OMRF rating, however, when evaluating the content validity of the ABAS-3 against the ICF Core Sets for Autism, it covered less than half of the items considered most relevant for individuals on the spectrum. Despite receiving a lower overall OMRF rating, the Vineland-3 covered a higher percentage of the items included in the ICF Core Sets for Autism. This suggests that although assessment of functioning tools may be considered psychometrically sound, their content validity may vary depending on the population they are being used to assess. This aligns with the findings of a similar evaluation of the content validity of measures suitable for use with younger children suspected of neurodevelopmental conditions [89]. It is important for clinicians to be aware of the suitability of these measures of functioning for specific populations, as this may influence their decision to select one tool over another. The COSMIN initiative aims to support this process by providing methodological guidelines to assist clinicians in selecting the appropriate assessment tool for their purpose [90]. In recent years, further work has been conducted to update earlier COSMIN guidelines, providing greater clarity around the selection of tools based on content validity [91]. Poor content validity can influence other psychometric properties, reducing the quality of overall reliability, validity and responsiveness, suggesting that establishing content validity should be prioritised before other psychometric properties [91]. A factor to consider in the interpretation of the results presented in this review is that full assessment item banks were coded to the ICF. Some assessments, such as the Vineland-3, use basal and ceiling thresholds to determine which items are presented for scoring [50], meaning that not all items included in the full item bank are presented during an assessment, potentially reducing the content validity of an assessment in clinical application. Similarly, the PEDI-CAT and PEDI-CAT ASD are administered via Computer Adaptive Test, presenting users with questions based on their previous responses and therefore not including all items evaluated in this review [67].
The method of administration varied among the measures of functioning included in this review, with the majority being clinician-administered or proxy-report. There are very limited options available for children to self-report, providing their own perspectives and priorities for functioning. Since autism is a complex condition influenced by a variety of internal and external factors, using a variety of assessments to obtain information from multiple perspectives can again help to provide a more holistic understanding of an individual’s functional challenges and abilities [13]. In isolation, a clinician’s perspective may not adequately reflect the functional impact of autism in a home or school environment, and proxy-reporting caregivers may not have adequate knowledge or understanding to effectively report impacts on functioning that may be better observed by a clinician in a standardised environment [92,93]. It is important to also consider the context in which functioning is being assessed and the supports that may or may not be in place during the assessment [93]. There is inconsistency in the current measures regarding the ways in which functioning is assessed; some tools consider the person’s abilities with supports in place (e.g., PEDI-CAT/PEDI-CAT ASD) while others do not (e.g., ABAS-3 and Vineland-3). Inconsistencies such as these can lead to confusion regarding an individual’s true functioning and support needs, which may be better assessed by measures specifically developed to explore these needs [94]. Across measures included in this review there is limited consideration of the impact of cultural factors on functioning, with the majority of these assessments being developed and tested in Canada or the USA. In addition, there is a paucity of research investigating the utility of these tools outside of the teams who developed them. A previous review of adaptive behaviour scales by Floyd and colleagues [93] evaluated the psychometric evidence for a variety of scales, including earlier versions of the Vineland and ABAS, however, only considered the evidence available in the manuals of these tools. Similarly, during this review, no recently published peer-reviewed articles reporting on aspects of overall utility of either the Vineland-3 or ABAS-3 were identified, only the information provided by the publishers in the user manual.
Historically, the biomedical model of health and disability has concentrated on impairment, attributing disability to a particular health condition, with interventions focussed on preventing or treating the condition with the goal of ‘normalising’ functioning [95]. In contrast, the social model of disability views disability as a consequence of social, environmental and attitudinal barriers, secondary to the condition itself [96]. More recently, autism and other neurodevelopmental conditions have been conceptualised under the neurodiversity paradigm, which aligns in some regards with the social model of disability, considering disability to be the consequence of external rather than internal factors [97]. The neurodiversity paradigm re-frames the differences seen in neurodiverse individuals as strengths that may be used to support interventions and positively influence functioning [19]. As views of neurodiversity continue to evolve, so too does the need for measurement tools to accurately reflect the current contexts in which individuals on the spectrum live and function [19]. Researchers are beginning to acknowledge the importance of involving consumers in the research process, increasingly using methods of co-production to incorporate the views of the target population [98].
The authors acknowledge that there are limitations to this review. The inclusion criteria specified that only studies published in English were eligible for inclusion, which may account for the lack of cultural diversity represented among the measures and studies. In addition, only articles investigating elements of overall utility of the most recent version of the measure were considered which may influence the availability of psychometric information for measures where this has been established in earlier versions. Finally, although a comprehensive approach was taken to ensure a broad search of the literature, it is possible that these methods may not have captured every available article reporting on the overall utility of the included measures.

5. Conclusions

This review contributes to the existing literature by providing a useful summary of the psychometric properties of measures of functioning that can be used by researchers and clinicians to facilitate the selection of suitable measures for assessing functioning of school-aged children on the autism spectrum. Effectively assessing functioning of school-aged children on the spectrum is increasingly important in both the Australian and international contexts given the shift towards disability support systems allocating funding based on level of functioning and support needs. For individuals on the spectrum, functioning can vary significantly, highlighting the need for reliable and valid methods of assessment that are capable of identifying the unique strengths and challenges of this population. There are a number of factors which should be considered when selecting a measure of functioning, including the purpose of the assessment, the population it is assessing, and the complete range of psychometric properties, including content validity. This review not only synthesises the properties of existing measures, but adds a comprehensive evaluation of the content validity of these measures for use with school-aged children on the spectrum. Further research in this area is required to ensure measures of functioning align with contemporary views of disability and are developed in collaboration with those most likely to benefit from them. Future research may seek to develop and evaluate holistic assessment of functioning tools based on the ICF Core Sets for Autism, with input from individuals on the spectrum and their families.

Author Contributions

Conceptualization, A.J.O.W., B.A., B.M., K.E., M.H.-E. and S.G.; methodology, B.M., E.D., K.E., M.H.-E. and S.G.; formal analysis, A.C., E.D. and M.H.-E.; resources, A.J.O.W., B.M., K.E. and S.G.; data curation, A.C., E.D. and M.H.-E.; writing—original draft preparation, M.H.-E.; writing—review and editing, A.C., A.J.O.W., B.A., B.M., E.D., K.E., M.H.-E., S.B. and S.G.; supervision, B.A., B.M., K.E., S.B. and S.G.; project administration, A.C., A.J.O.W., B.M., K.E., M.H.-E. and S.G.; funding acquisition, A.J.O.W., B.M., K.E., M.H.-E., S.B. and S.G. All authors have read and agreed to the published version of the manuscript.

Funding

The authors acknowledge the financial support of the National Disability Insurance Agency (NDIA) (project number 0.012) and Autism CRC (project numbers 3.061 and 0.012), established and supported under the Australian Government’s Cooperative Research Centre Program. A.J.O.W. is supported by an Investigator Grant from the National Health and Medical Research Council (grant no. 1173896).

Institutional Review Board Statement

Not applicable.

Informed Consent Statement

Not applicable.

Data Availability Statement

The data presented in this study are not publicly available.

Acknowledgments

The authors wish to acknowledge the research assistance of Sasha Johnston, Julia Tang and Kerry Wallace.

Conflicts of Interest

The authors declare no direct conflict of interest related to this article. S.B. declares no direct conflict of interest related to this article. S.B. reports grants from the Swedish Research Council, the Swedish Research Council for Health, Working Life and Welfare, FORMAS, VINNOVA, Trygg Hansa, Stiftelsen Clas Groschinskys Minnesfond, Stiftelsen Sunnerdahls Handikappfond, and Promobilia for his research on the ICF. S.B. discloses that he has in the last 3 years acted as an author, consultant or lecturer for Medice and Roche. He receives royalties for textbooks and diagnostic tools from Hogrefe, and Liber. S.B. is shareholder in SB Education/Psychological Consulting AB and NeuroSupportSolutions International AB. The funders had no role in the design of this study; in the collection, analyses, or interpretation of data; in the writing of the manuscript, or in the decision to publish the results. The Autism CRC reviewed the manuscript prior to publication to ensure that it aligned with their Language and Terminology Guide.

Appendix A

Table A1. Search Terms Used to Identify Relevant Articles.
Table A1. Search Terms Used to Identify Relevant Articles.
Search terms relating to psychometric properties
(psychometric * OR validity OR “predictive validity” OR “internal validity” OR “face validity” OR “external validity” OR “discriminant validity” OR “criterion related validity” OR “concurrent validity” OR “construct validity” OR “content validity” OR “validation study” OR reliability OR “reliability and validity” OR “test–retest reliability” OR “intrarater reliability” OR “interrater reliability” OR psychometric* OR reliabil* OR valid* OR sensitivity OR specificit* OR bias OR reproducib* OR feasib* OR “clinical utility” OR usability OR appropriate* OR accessib* OR practiab* OR acceptab*)
AND
Assessment specific terms
Adaptive Behavior Assessment System
(“adaptive behavior assessment system” or “ABAS”)
Australian Therapy Outcome Measures for Occupational Therapy
(“Australian Therapy Outcome Measures for Occupational Therapy” or “AusTOMs-OT” or “AusTOMS OT”)
Canadian Occupational Performance Measure
(“Canadian Occupational Performance Measure” OR COPM)
Children’s Assessment of Participation and Enjoyment and Preferences for Activities of Children (CAPE-PAC)
(“Children’s assessment of participation and enjoyment” or CAPE or “Enjoyment and preferences for activities of children” or “CAPE-PAC”)
Children’s Participation Questionnaire
(“Children’s participation questionnaire” or CPQ)
Life Habits Assessment
(“Life habits assessment” or “LIFE H” or “LIFE-H”)
PEM-CY
(pem-cy OR “participation and environment measure” OR “participation and environment measure children and youth”)
PEDI-CAT/PEDI-CAT (ASD)
(pedicat OR “pedicat asd” OR pedi-cat OR “pediatric evaluation of disability inventory computer adaptive test”)
Perceived Efficacy and Goal Setting
(“Perceived efficacy and goal setting” or PEGS)
Rating of Perceived Participation
(“Rating of perceived participation” or ROPP)
Short Child Occupational Profile
(“Short child occupational profile” or SCOPE)
Vineland-3
(vineland OR vineland-3 OR “vineland three” OR “vineland III” OR “vineland 3” OR vineland-III OR “vineland third edition”
* Indicates a truncation wildcard, used to search for variations of the core word

References

  1. Monk, R.; Whitehouse, A.J.; Waddington, H. The use of language in autism research. Trends Neurosci. 2022, 45, 791–793. [Google Scholar] [CrossRef] [PubMed]
  2. World Health Organisation. ICD-11 for Mortality and Morbidity Statistics; World Health Organisation: Geneva, Switzerland, 2018. [Google Scholar]
  3. American Psychiatric Association. Diagnostic and Statistical Manual of Mental Disorders: DSM-5-TR, 5th ed.; American Psychiatric Association Publishing: Washington, DC, USA, 2022. [Google Scholar]
  4. Kasari, C.; Locke, J.; Gulsrud, A.; Rotheram-Fuller, E. Social Networks and Friendships at School: Comparing Children with and Without ASD. J. Autism Dev. Disord. 2011, 41, 533–544. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  5. Zeidan, J.; Fombonne, E.; Scorah, J.; Ibrahim, A.; Durkin, M.S.; Saxena, S.; Yusuf, A.; Shih, A.; Elsabbagh, M. Global prevalence of autism: A systematic review update. Autism Res. 2022, 15, 778–790. [Google Scholar] [CrossRef] [PubMed]
  6. Li, Q.; Li, Y.; Liu, B.; Chen, Q.; Xing, X.; Xu, G.; Yang, W. Prevalence of Autism Spectrum Disorder Among Children and Adolescents in the United States from 2019 to 2020. JAMA Pediatr. 2022, 176, 934–945. [Google Scholar] [CrossRef]
  7. Australian Bureau of Statistics. Disability, Ageing and Carers, Australia: Summary of Findings; Australian Bureau of Statistics: Canberra, Australia, 2019.
  8. Maree, J.G. The psychosocial development theory of Erik Erikson: Critical overview. Early Child Dev. Care 2021, 191, 1107–1121. [Google Scholar] [CrossRef]
  9. Australian Government Productivity Commission. Disability Care and Support (54); Commonwealth of Australia: Canberra, Australia, 2011.
  10. National Disability Insurance Agency. What Is the NDIS? Available online: https://www.ndis.gov.au/understanding/what-ndis (accessed on 24 August 2022).
  11. National Disability Insurance Agency. In Young People in the NDIS; National Disability Insurance Agency: Canberra, Australia, 2020.
  12. Levy, A.; Perry, A. Outcomes in adolescents and adults with autism: A review of the literature. Res. Autism Spectr. Disord. 2011, 5, 1271–1282. [Google Scholar] [CrossRef]
  13. Whitehouse, A.; Evans, K.; Eapen, V.; Wray, J. A National Guideline for the Assessment and Diagnosis of Autism Spectrum Disorders in Australia; National Disability Insurance Agency: Canberra, Australia, 2018.
  14. National Institute for Health and Care Excellence. Autism Spectrum Disorder in under 19s: Recognition, Referral and Diagnosis; National Institute for Health and Care Excellence: London, UK, 2011.
  15. Ministries of Health and Education. New Zealand Autism Spectrum Disorder Guideline; Ministry of Health: Wellington, New Zealand, 2016.
  16. Hyman, S.L.; Levy, S.E.; Myers, S.M. Identification, Evaluation, and Management of Children with Autism Spectrum Disorder. Pediatrics 2020, 145, e20193447. [Google Scholar] [CrossRef] [Green Version]
  17. World Health Organisation. How to Use the ICF: A Practical Manual for Using the International Classification of Functioning, Disability and Health (ICF); World Health Organisation: Geneva, Switzerland, 2013. [Google Scholar]
  18. de Schipper, E.; Mahdi, S.; de Vries, P.; Granlund, M.; Holtmann, M.; Karande, S.; Almodayfer, O.; Shulman, C.; Tonge, B.; Wong, V.V.; et al. Functioning and disability in autism spectrum disorder: A worldwide survey of experts. Autism Res. 2016, 9, 959–969. [Google Scholar] [CrossRef] [Green Version]
  19. Bölte, S.; Lawson, W.B.; Marschik, P.B.; Girdler, S. Reconciling the seemingly irreconcilable: The WHO’s ICF system integrates biological and psychosocial environmental determinants of autism and ADHD: The International Classification of Functioning (ICF) allows to model opposed biomedical and neurodiverse views of autism and ADHD within one framework. BioEssays 2021, 43, 2000254. [Google Scholar] [CrossRef]
  20. Bölte, S.; Mahdi, S.; De Vries, P.J.; Granlund, M.; Robison, J.E.; Shulman, C.; Swedo, S.; Tonge, B.; Wong, V.; Zwaigenbaum, L.; et al. The Gestalt of functioning in autism spectrum disorder: Results of the international conference to develop final consensus International Classification of Functioning, Disability and Health core sets. Autism 2019, 23, 449–467. [Google Scholar] [CrossRef]
  21. Tudge, J.R.H.; Mercon-Vargas, E.A.; Liang, Y.; Payir, A. The importance of Urie Bronfenbrenner’s bioecological theory for early childhood education. In Theories of Early Childhood Education: Developmental, Behaviorist, and Critical; Cohen, L.E., Waite-Stupiansky, S., Eds.; Taylor and Francis: Florence, Italy, 2017; pp. 45–57. [Google Scholar]
  22. McConachie, H.; Parr, J.R.; Glod, M.; Hanratty, J.; Livingstone, N.; Oono, I.P.; Robalino, S.; Baird, G.; Beresford, B.; Charman, T.; et al. Systematic review of tools to measure outcomes for young children with autism spectrum disorder. Health Technol. Assess. 2015, 19, 1–506. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  23. Hirota, T.; So, R.; Kim, Y.S.; Leventhal, B.; Epstein, R.A. A systematic review of screening tools in non-young children and adults for autism spectrum disorder. Res. Dev. Disabil. 2018, 80, 1–12. [Google Scholar] [CrossRef] [PubMed]
  24. Thabtah, F.; Peebles, D. Early Autism Screening: A Comprehensive Review. Int. J. Environ. Res. Public Health 2019, 16, 3502. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  25. Falkmer, T.; Anderson, K.; Falkmer, M.; Horlin, C. Diagnostic procedures in autism spectrum disorders: A systematic literature review. Eur. Child Adolesc. Psychiatry 2013, 22, 329–340. [Google Scholar] [CrossRef] [PubMed]
  26. CanChild. Outcome Measures Rating Form; McMaster University: Hamilton, ON, Canada, 2004. [Google Scholar]
  27. Smart, A. A multi-dimensional model of clinical utility. Int. J. Qual. Health Care 2006, 18, 377–382. [Google Scholar] [CrossRef] [PubMed]
  28. Mokkink, L.B.; Prinsen, C.A.C.; Patrick, D.L.; Alonso, J.; Bouter, L.M.; de Vet, H.C.W.; Terwee, C.B. COSMIN methodology for systematic reviews of Patient-Reported Outcome Measures (PROMs): User Manual. Qual. Life Res. 2018, 27, 1147–1157. [Google Scholar] [CrossRef] [Green Version]
  29. Mokkink, L.B.; Terwee, C.B.; Patrick, D.L.; Alonso, J.; Stratford, P.W.; Knol, D.L.; Bouter, L.M.; de Vet, H.C. COSMIN Checklist Manual; EMGO Institute for Health and Care Research: Amsterdam, The Netherlands, 2012. [Google Scholar]
  30. Connell, J.; Carlton, J.; Grundy, A.; Buck, E.T.; Keetharuth, A.D.; Ricketts, T.; Barkham, M.; Robotham, D.; Rose, D.; Brazier, J. The importance of content and face validity in instrument development: Lessons learnt from service users when developing the Recovering Quality of Life measure (ReQoL). Qual. Life Res. 2018, 27, 1893–1902. [Google Scholar] [CrossRef] [Green Version]
  31. Bölte, S.; de Schipper, E.; Robison, J.E.; Wong, V.C.; Selb, M.; Singhal, N.; de Vries, P.J.; Zwaigenbaum, L. Classification of Functioning and Impairment: The Development of ICF Core Sets for Autism Spectrum Disorder. Autism Res. 2014, 7, 167–172. [Google Scholar] [CrossRef]
  32. Mahdi, S.; Viljoen, M.; Yee, T.; Selb, M.; Singhal, N.; Almodayfer, O.; Granlund, M.; De Vries, P.J.; Zwaigenbaum, L.; Bölte, S. An international qualitative study of functioning in autism spectrum disorder using the World Health Organization international classification of functioning, disability and health framework. Autism Res. 2018, 11, 463–475. [Google Scholar] [CrossRef] [Green Version]
  33. Arksey, H.; O’Malley, L. Scoping studies: Towards a methodological framework. Int. J. Soc. Res. Methodol. 2005, 8, 19–32. [Google Scholar] [CrossRef]
  34. Levac, D.; Colquhoun, H.; O’Brien, K.K.; Levac, D.; Colquhoun, H.; O’Brien, K.K. Scoping studies: Advancing the methodology. Implement. Sci. 2010, 5, 69. [Google Scholar] [CrossRef] [Green Version]
  35. Daudt, H.M.L.; Van Mossel, C.; Scott, S.J. Enhancing the scoping study methodology: A large, inter-professional team’s experience with Arksey and O’Malley’s framework. BMC Med. Res. Methodol. 2013, 13, 48. [Google Scholar] [CrossRef] [Green Version]
  36. McGowan, J.; Straus, S.; Moher, D.; Langlois, E.V.; O’Brien, K.K.; Horsley, T.; Aldcroft, A.; Zarin, W.; Garitty, C.M.; Hempel, S.; et al. Reporting scoping reviews—PRISMA ScR extension. J. Clin. Epidemiol. 2020, 123, 177–179. [Google Scholar] [CrossRef] [PubMed]
  37. Kmet, L.M.; Cook, L.S.; Lee, R.C. Standard Quality Assessment Criteria for Evaluating Primary Research Papers from a Variety of Fields; Alberta Heritage Foundation for Medical Research: Edmonton, AB, Canada, 2004.
  38. Cieza, A.; Fayed, N.; Bickenbach, J.; Prodinger, B. Refinements of the ICF Linking Rules to strengthen their potential for establishing comparability of health information. Disabil. Rehabil. 2019, 41, 574–583. [Google Scholar] [CrossRef]
  39. Harrison, P.; Oakland, T. Adaptive Behavior Assessment System, 3rd ed.; Western Psychological Services: Washington, DC, USA, 2015. [Google Scholar]
  40. Unsworth, C.; Duncombe, D. AusTOMs for Occupational Therapy; LaTrobe University: Melbourne, Australia, 2004. [Google Scholar]
  41. Law, M.; Baptiste, S.; Carswell, A.; McColl, M.A.; Polatajko, H.; Pollock, N. Canadian Occupational Performance Measure, 5th ed.; Canadian Association of Occupational Therapists: Ottawa, ON, Canada, 2000. [Google Scholar]
  42. King, G.; Law, M.; King, S.; Hurley, P.; Hanna, S.; Kertoy, M.; Rosenbaum, P.; Young, N. Children’s Assessment of Participation and Enjoyment (CAPE) and Preferences for Activities of Children (PAC); Harcourt Assessment Inc.: San Antonio, TX, USA, 2004. [Google Scholar]
  43. Rosenberg, L.; Jarus, T.; Bart, O. Development and initial validation of the Children Participation Questionnaire (CPQ). Disabil. Rehabil. 2010, 32, 1633–1644. [Google Scholar] [CrossRef]
  44. Coster, W.; Law, M.; Bedell, G. Participation and Environment Measure for Children and Youth (PEM-CY); Boston University: Boston, MA, USA, 2010. [Google Scholar]
  45. Haley, S.M.; Coster, W.; Dumas, H.; Fragala-Pinkham, M.; Moed, R. PEDI-CAT: Development, Standardisation an Administration Manual; CRECare LLC: Boston, MA, USA, 2012. [Google Scholar]
  46. Haley, S.M.; Coster, W.; Dumas, H.; Fragala-Pinkham, M.; Moed, R.; Kramer, J.; Ni, P.; Feng, T.; Kao, Y.C.; Ludlow, L.H. Pediatric Evaluation of Disability Inventory: Development, Standardisation and Aministration Manual; (Version 1.4.3); Boston University: Boston, MA, USA, 2019. [Google Scholar]
  47. Missiuna, C.; Pollock, N.; Law, M. PEGS, The Perceived Efficacy and Goal Setting System; Harcourt Assessment: San Antonio, TX, USA, 2004. [Google Scholar]
  48. Sandström, M.; Lundin-Olsson, L. Development and evaluation of a new questionnaire for rating perceived participation1. Clin. Rehabil. 2007, 21, 833–845. [Google Scholar] [CrossRef]
  49. Bowyer, P.; Kramer, J.; PLoSzaj, A.; Ross, M.; Schwartz, O.; Kielhofner, G.; Kramer, K. A Users Manual for the Short Child Occupational Profile (SCOPE) Version 2.2. The Model of Human Occupation Clearinghouse; University of Illinois: Chicago, IL, USA, 2008. [Google Scholar]
  50. Sparrow, S.; Cicchetti, D.; Saulnier, C. Vineland Adaptive Behavior Scales, 3rd ed.; Pearson: San Antonio, TX, USA, 2016. [Google Scholar]
  51. Scott, F.; Unsworth, C.A.; Fricke, J.; Taylor, N. Reliability of the Australian Therapy Outcome Measures for Occupational Therapy Self-care scale. Aust. Occup. Ther. J. 2006, 53, 265–276. [Google Scholar] [CrossRef]
  52. Unsworth, C.A. Measuring outcomes using the Australian therapy outcome measures for occupational therapy (AusTOMs-OT): Data description and tool sensitivity. Br. J. Occup. Ther. 2005, 68, 354–366. [Google Scholar] [CrossRef]
  53. Unsworth, C.A.; Coulson, M.; Swinton, L.; Cole, H.; Sarigiannis, M. Determination of the minimal clinically important difference on the Australian Therapy Outcome Measures for Occupational Therapy (AusTOMs—OT). Disabil. Rehabil. 2015, 37, 997–1003. [Google Scholar] [CrossRef] [PubMed]
  54. Unsworth, C.A.; Timmer, A.; Wales, K. Reliability of the Australian Therapy Outcome Measures for Occupational Therapy (AusTOMs-OT). Aust. Occup. Ther. J. 2018, 65, 376–386. [Google Scholar] [CrossRef] [PubMed]
  55. Unsworth, C.A.; Duckett, S.J.; Duncombe, D.; Perry, A.; Skeat, J.; Taylor, N. Validity of the AusTOM scales: A comparison of the AusTOMs and EuroQol-5D. Health Qual. Life Outcomes 2004, 2, 64. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  56. Brown, T.; Thyer, L. The convergent validity of the Children’s Leisure Assessment Scale (CLASS) and Children’s Assessment of Participation and Enjoyment and Preferences for Activities of Children (CAPE/PAC). Scand. J. Occup. Ther. 2019, 27, 349–363. [Google Scholar] [CrossRef] [PubMed]
  57. King, G.A.; Law, M.; King, S.; Hurley, P.; Hanna, S.; Kertoy, M.; Rosenbaum, P. Measuring children’s participation in recreation and leisure activities: Construct validation of the CAPE and PAC. Child Care, Health Dev. 2007, 33, 28–39. [Google Scholar] [CrossRef] [PubMed]
  58. Potvin, M.-C.; Snider, L.; Prelock, P.; Kehayia, E.; Wood-Dauphinee, S. Children’s Assessment of Participation and Enjoyment/Preference for Activities of Children: Psychometric Properties in a Population with High-Functioning Autism. Am. J. Occup. Ther. 2013, 67, 209–217. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  59. Eyssen, I.C.J.M.; Beelen, A.; Dedding, C.; Cardol, M.; Dekker, J. The reproducibility of the Canadian Occupational Performance Measure. Clin. Rehabil. 2005, 19, 888–894. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  60. McColl, M.A.; Paterson, M.; Davies, D.; Doubt, L.; Law, M. Validity and Community Utility of the Canadian Occupational Performance Measure. Can. J. Occup. Ther. 2000, 67, 22–30. [Google Scholar] [CrossRef]
  61. Tuntland, H.; Aaslund, M.K.; Langeland, E.; Espehaug, B.; Kjeken, I. Psychometric properties of the Canadian Occupational Performance Measure in home-dwelling older adults. J. Multidiscip. Health 2016, 9, 411–423. [Google Scholar] [CrossRef] [Green Version]
  62. Verkerk, G.J.Q.; Wolf, M.J.M.A.G.; Louwers, A.M.; Meester-Delver, A.; Nollet, F. The reproducibility and validity of the Canadian Occupational Performance Measure in parents of children with disabilities. Clin. Rehabil. 2006, 20, 980–988. [Google Scholar] [CrossRef]
  63. Cusick, A.; Lannin, N.; Lowe, K. Adapting the Canadian Occupational Performance Measure for use in a paediatric clinical trial. Disabil. Rehabil. 2007, 29, 761–766. [Google Scholar] [CrossRef]
  64. Noreau, L.; Desrosiers, J.; Robichaud, L.; Fougeyrollas, P.; Rochette, A.; Viscogliosi, C. Measuring social participation: Reliability of the LIFE-H in older adults with disabilities. Disabil. Rehabil. 2004, 26, 346–352. [Google Scholar] [CrossRef]
  65. Noreau, L.; Lepage, C.; Boissiere, L.; Picard, R.; Fougeyrollas, P.; Mathieu, J.; Desmarais, G.; Nadeau, L. Measuring participation in children with disabilities using the Assessment of Life Habits. Dev. Med. Child Neurol. 2007, 49, 666–671. [Google Scholar] [CrossRef] [PubMed]
  66. Dumas, H.M.; Fragala-Pinkham, M.A. Concurrent validity and reliability of the pediatric evaluation of disability inventory-computer adaptive test mobility domain. Pediatr. Phys. Ther. 2012, 24, 171–176; discussion 176. [Google Scholar] [CrossRef] [PubMed]
  67. Dumas, H.M.; Fragala-Pinkham, M.A.; Haley, S.M.; Ni, P.; Coster, W.; Kramer, J.M.; Kao, Y.-C.; Moed, R.; Ludlow, L.H. Computer adaptive test performance in children with and without disabilities: Prospective field study of the PEDI-CAT. Disabil. Rehabil. 2012, 34, 393–401. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  68. Dumas, H.M.; Fragala-Pinkham, M.A.; Rosen, E.L.; O’Brien, J.E. Construct validity of the pediatric evaluation of disability inventory computer adaptive test (PEDI-CAT) in children with medical complexity. Disabil. Rehabil. 2017, 39, 2446–2451. [Google Scholar] [CrossRef] [PubMed]
  69. Haley, S.M.; Coster, W.J.; Dumas, H.M.; Fragala-Pinkham, M.A.; Kramer, J.; Ni, P.; Tian, F.; Kao, Y.-C.; Moed, R.; Ludlow, L.H. Accuracy and precision of the Pediatric Evaluation of Disability Inventory computer-adaptive tests (PEDI-CAT). Dev. Med. Child Neurol. 2011, 53, 1100–1106. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  70. Shore, B.J.; Allar, B.G.; Miller, P.E.; Matheney, T.H.; Snyder, B.D.; Fragala-Pinkham, M. Measuring the Reliability and Construct Validity of the Pediatric Evaluation of Disability Inventory–Computer Adaptive Test (PEDI-CAT) in Children with Cerebral Palsy. Arch. Phys. Med. Rehabil. 2019, 100, 45–51. [Google Scholar] [CrossRef] [PubMed]
  71. Shore, B.J.; Allar, B.G.; Miller, P.E.; Matheney, T.H.; Snyder, B.D.; Fragala-Pinkham, M.A. Evaluating the Discriminant Validity of the Pediatric Evaluation of Disability Inventory: Computer Adaptive Test in Children with Cerebral Palsy. Phys. Ther. 2017, 97, 669–676. [Google Scholar] [CrossRef]
  72. Coster, W.J.; Kramer, J.M.; Tian, F.; Dooley, M.; Liljenquist, K.; Kao, Y.-C.; Ni, P. Evaluating the appropriateness of a new computer-administered measure of adaptive function for children and youth with autism spectrum disorders. Autism 2016, 20, 14–25. [Google Scholar] [CrossRef] [Green Version]
  73. Kramer, J.M.; Coster, W.J.; Kao, Y.-C.; Snow, A.; Orsmond, G.I. A New Approach to the Measurement of Adaptive Behavior: Development of the PEDI-CAT for Children and Youth with Autism Spectrum Disorders. Phys. Occup. Ther. Pediatr. 2012, 32, 34–47. [Google Scholar] [CrossRef] [Green Version]
  74. Kramer, J.M.; Liljenquist, K.; Coster, W.J. Validity, reliability, and usability of the Pediatric Evaluation of Disability Inventory-Computer Adaptive Test for autism spectrum disorders. Dev. Med. Child Neurol. 2015, 58, 255–261. [Google Scholar] [CrossRef]
  75. Missiuna, C.; Pollock, N. Perceived Efficacy and Goal Setting in Young Children. Can. J. Occup. Ther. 2000, 67, 101–109. [Google Scholar] [CrossRef] [PubMed]
  76. Missiuna, C.; Pollock, N.; Law, M.; Walter, S.; Cavey, N. Examination of the Perceived Efficacy and Goal Setting System (PEGS) With Children with Disabilities, Their Parents, and Teachers. Am. J. Occup. Ther. 2006, 60, 204–214. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  77. Coster, W.; Bedell, G.; Law, M.; Khetani, M.A.; Teplicky, R.; Liljenquist, K.; Gleason, K.; Kao, Y.-C. Psychometric evaluation of the Participation and Environment Measure for Children and Youth. Dev. Med. Child Neurol. 2011, 53, 1030–1037. [Google Scholar] [CrossRef]
  78. Coster, W.; Law, M.; Bedell, G.; Khetani, M.; Cousins, M.; Teplicky, R. Development of the participation and environment measure for children and youth: Conceptual basis. Disabil. Rehabil. 2012, 34, 238–246. [Google Scholar] [CrossRef] [PubMed]
  79. Khetani, M.; Marley, J.; Baker, M.; Albrecht, E.; Bedell, G.; Coster, W.; Anaby, D.; Law, M. Validity of the Participation and Environment Measure for Children and Youth (PEM-CY) for Health Impact Assessment (HIA) in sustainable development projects. Disabil. Health J. 2014, 7, 226–235. [Google Scholar] [CrossRef] [PubMed]
  80. Noonan, V.K.; Kopec, J.A.; Noreau, L.; Singer, J.; Chan, A.; Mâsse, L.C.; Dvorak, M.F. Comparing the content of participation instruments using the International Classification of Functioning, Disability and Health. Health Qual. Life Outcomes 2009, 7, 93. [Google Scholar] [CrossRef] [Green Version]
  81. Bowyer, P.L.; Kramer, J.; Kielhofner, G.; Maziero-Barbosa, V.; Girolami, G. Measurement Properties of the Short Child Occupational Profile (SCOPE). Phys. Occup. Ther. Pediatr. 2007, 27, 67–85. [Google Scholar] [CrossRef]
  82. Kramer, J.; Bowyer, P.; Maziero-Barbosa, V.; Kielhofner, G.; O’Brien, J. Examining Rater Behavior on a Revised Version of the Short Child Occupational Profile (SCOPE). OTJR Occup. Particip. Health 2009, 29, 88–96. [Google Scholar] [CrossRef]
  83. Bowyer, P.; Lee, J.; Kramer, J.; Taylor, R.R.; Kielhofner, G. Determining the Clinical Utility of the Short Child Occupational Profile (SCOPE). Br. J. Occup. Ther. 2012, 75, 19–28. [Google Scholar] [CrossRef]
  84. World Health Organization. ICD-11 for Mortality and Morbidity Statistics: 6A02 Autism Spectrum Disorder. Available online: https://icd.who.int/browse11/l-m/en#/http%253a%252f%252fid.who.int%252ficd%252fentity%252f437815624 (accessed on 25 September 2022).
  85. Autism Spectrum Disorder in under 19s: Recognition, Referral and Diagnosis. Available online: https://www.nice.org.uk/guidance/cg128 (accessed on 25 September 2022).
  86. van Leeuwen, L.M.; Pronk, M.; Merkus, P.; Goverts, S.T.; Terwee, C.B.; Kramer, S.E. Operationalization of the Brief ICF Core Set for Hearing Loss: An ICF-Based e-Intake Tool in Clinical Otology and Audiology Practice. Ear Heart 2020, 41, 1533–1544. [Google Scholar] [CrossRef]
  87. Coelho, J.N.; de Almeida, C.; Vianna, P.C.; Dalto, V.F.; Castro, F.F.S.; Rabeh, S.A.N.; Riberto, M. Development of an ICF Core Set Based Instrument for Individuals with Non-traumatic Spinal Cord Injury. Int. J. Phys. Med. Rehabil. 2017, 5, 2. [Google Scholar] [CrossRef] [Green Version]
  88. Yang, E.J.; Shin, E.-K.; Shin, H.-I.; Lim, J.-Y. Psychometric properties of scale constructed from the International Classification of Functioning, Disability and Health (ICF) core set for breast cancer based on Rasch analysis. Support. Care Cancer 2014, 22, 2839–2849. [Google Scholar] [CrossRef] [PubMed]
  89. D’Arcy, E.; Wallace, K.; Chamberlain, A.; Evans, K.; Milbourn, B.; Bölte, S.; Whitehouse, A.J.; Girdler, S. Content validation of common measures of functioning for young children against the International Classification of Functioning, Disability and Health and Code and Core Sets relevant to neurodevelopmental conditions. Autism 2022, 26, 928–939. [Google Scholar] [CrossRef]
  90. Mokkink, L.B.; Prinsen, C.A.C.; Bouter, L.M.; de Vet, H.C.W.; Terwee, C.B. The COnsensus-based Standards for the selection of health Measurement INstruments (COSMIN) and how to select an outcome measurement instrument. Braz. J. Phys. Ther. 2016, 20, 105–113. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  91. Terwee, C.B.; Prinsen, C.A.C.; Chiarotto, A.; Westerman, M.J.; Patrick, D.L.; Alonso, J.; Bouter, L.M.; de Vet, H.C.W.; Mokkink, L.B. COSMIN methodology for evaluating the content validity of patient-reported outcome measures: A Delphi study. Qual. Life Res. 2018, 27, 1159–1170. [Google Scholar] [CrossRef] [Green Version]
  92. Goldstein, S. Assessment of Autism Spectrum Disorders; Guilford Publications: New York, NY, USA, 2012. [Google Scholar]
  93. Floyd, R.G.; Shands, E.I.; Alfonso, V.C.; Phillips, J.F.; Autry, B.K.; Mosteller, J.A.; Skinner, M.; Irby, S. A Systematic Review and Psychometric Evaluation of Adaptive Behavior Scales and Recommendations for Practice. J. Appl. Sch. Psychol. 2015, 31, 83–113. [Google Scholar] [CrossRef]
  94. Arnold, S.R.C.; Riches, V.C.; Stancliffe, R.J. Does a Measure of Support Needs Predict Funding Need Better Than a Measure of Adaptive and Maladaptive Behavior? Am. J. Intellect. Dev. Disabil. 2015, 120, 375–394. [Google Scholar] [CrossRef]
  95. Smart, J.F.; Smart, D.W. Models of Disability: Implications for the Counseling Profession. J. Couns. Dev. 2006, 84, 29–40. [Google Scholar] [CrossRef]
  96. Dirth, T.P.; Branscombe, N.R. Disability Models Affect Disability Policy Support through Awareness of Structural Discrimination: Models of Disability. J. Soc. Issues 2017, 73, 413–442. [Google Scholar] [CrossRef]
  97. Pellicano, E.; Houting, J.D. Annual Research Review: Shifting from ‘normal science’ to neurodiversity in autism science. J. Child Psychol. Psychiatry 2022, 63, 381–396. [Google Scholar] [CrossRef]
  98. Cargo, M.; Mercer, S.L. The Value and Challenges of Participatory Research: Strengthening Its Practice. Annu. Rev. Public Health 2008, 29, 325–350. [Google Scholar] [CrossRef] [PubMed]
Figure 1. Phase One, study identification and screening process.
Figure 1. Phase One, study identification and screening process.
Ijerph 19 14114 g001
Figure 2. Phase Two, measures of functioning identification and screening process.
Figure 2. Phase Two, measures of functioning identification and screening process.
Ijerph 19 14114 g002
Table 1. The COnsensus-based Standards for the selection of health Measurement INstruments (COSMIN) definitions of domains and psychometric properties [28] (Note. Adapted from: “COSMIN methodology for systematic reviews of Patient-Reported Outcome Measures (PROMs)” by Mokkink, L.B.; Terwee, C.B.; Patrick, D.L.; Alonso, J.; Stratford, P.W.; Knol, D.L.; Bouter, L.M.; de Vet, H.C., 2012, Amsterdam Public Health Research Institute: BT Amsterdam, p. 11–12 (https://cosmin.nl/wp-content/uploads/COSMIN-syst-review-for-PROMs-manual_version-1_feb-2018.pdf)).
Table 1. The COnsensus-based Standards for the selection of health Measurement INstruments (COSMIN) definitions of domains and psychometric properties [28] (Note. Adapted from: “COSMIN methodology for systematic reviews of Patient-Reported Outcome Measures (PROMs)” by Mokkink, L.B.; Terwee, C.B.; Patrick, D.L.; Alonso, J.; Stratford, P.W.; Knol, D.L.; Bouter, L.M.; de Vet, H.C., 2012, Amsterdam Public Health Research Institute: BT Amsterdam, p. 11–12 (https://cosmin.nl/wp-content/uploads/COSMIN-syst-review-for-PROMs-manual_version-1_feb-2018.pdf)).
TermDefinition
ReliabilityThe Consistency with Which a Measure Produces the Same Results.
Internal consistencyThe level of correlation between items.
Reliability
-
Test–retest
-
Inter-rater
-
Intra-rater
The level of discrepancy in measurements resulting from actual differences between individuals.
Measurement error
-
Test–retest
-
Inter-rater
-
Intra-rater
Systematic and random errors that are not a consequence of actual changes in the construct being assessed.
ValidityThe level at which a measure actually evaluates the construct(s) it is intended to measure.
Content validity
-
Face validity
How accurately the content of a measure reflects the construct being evaluated.
Construct validity
-
Structural validity
-
Hypotheses testing
-
Cross-cultural validity
The level of accuracy with which the measure evaluates what it is intended to.
Criterion validity
-
Concurrent validity
-
Predictive validity
The accuracy with which the scores of a measure adequately reflect the ‘gold standard’.
ResponsivenessHow accurately a measure is able to detect change over time in the construct being evaluated.
ResponsivenessThe relationship between unobservable traits and how they present.
Table 2. Characteristics of included measures of functioning.
Table 2. Characteristics of included measures of functioning.
MeasureAbbreviationYearAuthorsFormatNumber of ItemsAge Range
(Years)
Adaptive Behavior Assessment System (3rd Edition)
USA
ABAS-32015Harrison & Oakland [39]Self- or proxy-report questionnaireParent-form
(0–5 years) = 241
0–89
Parent-form
(5–21 years) = 232
Assessment of Life Habits
Canada
LIFE-H2014Noreau, Fougeyrollas & VincentSelf- or proxy-report questionnaireLong-form = 242Any
Short-form = 77
Australian Therapy Outcome Measures for Occupational Therapy
(3rd Edition)
Australia
AusTOMs-OT2004Unsworth & Dunscombe [40]Occupational therapist-rated scales12Any
Canadian Occupational Performance Measure
Canada
COPM2000Law, Baptiste, Carswell, McColl, Polatjko & Pollock [41]Interview by occupational therapist98+
Children’s Assessment of Participation and Enjoyment and Preferences for Activities of ChildrenCAPE/PAC2005G. King, Law, S. King, Hurley, Rosenbaum, Hanna, Kertoy & Young [42]Interview by health professional or self-reportTotal = 1106–21
CAPE = 55
PAC = 55
Children’s Participation Questionnaire
Israel
CPQ2010Rosenberg, Jarus & Bart [43]Proxy-report questionnaire444–6
Participation and Environment Measure for Children and Youth
Canada
PEM-CY2010Coster, Law & Bedell [44]Proxy-report questionnaire455–17
Pediatric Evaluation of Disability Inventory—Computer Adaptive Test
USA
PEDI-CAT2012Haley, Coster, Dumas, Fragala-Pinkham & Moed [45]Proxy-report computer adaptive testItem bank = 2760–21
Content-balanced version ≤ 30 items)
Speedy version ≤ 15 items
Pediatric Evaluation of Disability Inventory—Computer Adaptive Test (Autism Spectrum Disorder)
USA
PEDI-CAT ASD2019Haley, Coster, Dumas, Fragala-Pinkham, Moed, Kramer, Ni, Feng, Kao & Ludlow [46]Proxy-report computer adaptive test3010–21
Perceived Efficacy and Goal Setting System
Canada
PEGS2004Missiuna, Pollock & Law [47]Child self-report and parallel proxy-report questionnaires245–9
Rating of Perceived Participation
Sweden
ROPP2007Sandström & Lundin-Olsson [48]Self-report questionnaire22Unspecified
Short Child Occupational Profile
USA
SCOPE2008Bowyer, Kramer, Ploszaj, Ross, Schwartz, Kielhofner & Kramer [49]Occupational therapist-rated performance measure250–21
Vineland Adaptive Behavior Scales
(3rd Edition)
USA
Vineland-32016Sparrow, Cicchetti & Saulnier [50]Interview by health professional; proxy-report form (available for parent/caregiver or teacher)Comprehensive interview/parent-form = 5020–90
Comprehensive teacher-form = 333
Domain interview = 195
Domain parent-form = 180
Domain teacher-form = 149
Table 3. Descriptions and QualSyst ratings of studies evaluating the psychometric properties of included measures of functioning.
Table 3. Descriptions and QualSyst ratings of studies evaluating the psychometric properties of included measures of functioning.
Measure 1ReferenceStudy PurposeStudy PopulationAge 2
(Years)
QualSyst Score
ABAS-3Harrison & Oakland, 2015 [39]To describe the psychometric properties of the ABAS-3 based on standardised and clinical samples.n = 265 children and adults from standardisation sampleR: 0–84
Children
R: 0–18
M: 4.6 (SD 4.7)
N/A
Clinical group: Autism
Sample 1: n = 51 pre-school aged children
Autism Sample 1
R: 24–71 months
M: 54 months (SD 11.2)
Sample 2: n = 37 school-aged childrenAutism Sample 2
R: 5–20
M: 10.6 (SD 4.0)
AusTOMsScott, Unsworth, Fricke & Taylor, 2006 [51]To determine retest reliability, interrater and intrarater reliability of the AusTOMS OT—Self Care scalen = 7 occupational therapistsR: 22–44
M: 32
19/22
86%
Strong
Unsworth, 2005 [52]To determine the sensitivity of the AusTOMS-OT scales in detecting change to client status over time.n = 466 (n = 106 children)Children
R: 0–18
M: 10.4
18/22
82%
Strong
Unsworth, Coulson, Swinton, Cole & Sarigiannis, 2014 [53]To establish the minimal clinically important difference for four domains of the AusTOMs-OT.n = 787 clients of a home-based therapy serviceR: 18–101
M: 71.5 (SD 14.7)
21/24
88%
Strong
Unsworth, Timmer & Wales, 2018 [54]To investigate inter-rater and intra-rater reliability of occupational therapists using the AusTOMs-OT, and level of agreement for all AusTOMs-OT scales, including test–retest reliability, measurement error, and the error range.n = 31 occupational therapistsM: 38.0 (SD 10.0)23/24
96%
Strong
Unsworth, Duckett, Duncombe, Perry, Skeat & Taylor, 2004 [55]To investigate the construct (convergent) validity of the AusTOMs in comparison to EuroQuol-5Dn = 205 occupational therapy (67), physiotherapy (110), and speech pathology (28) clientsUnspecified19/22
86%
Strong
CAPE/PACBrown & Thyer, 2019 [56]To examine the convergent validity between the Children’s Leisure Assessment Scale and CAPE-PAC.n = 40 healthy Australian childrenM: 9.2 (SD 2.0)21/22
95%
Strong
G.A King, Law, S. King, Hurley, Hanna, Kertoy & Rosenbaum, 2007 [57]To determine construct validity of the CAPE and PAC.n = 427 children with physical functional limitationsR: 6–1520/22
91%
Strong
Potvin, Snider, Prelock, Kehayia & Wood-Dauphinee, 2013 [58]To determine the psychometric properties of the CAPE/PAC for children with high functioning autism.n = 61 (n = 30 children with high functioning autism; n = 31 typically developing peers)Autism sample
R: 7–13
19/22
86%
Strong
COPMEyssen, Beelen, Dedding, Cardol & Dekker, 2005 [59]To assess the reliability and inter-rater agreement of the COPM.n = 95 occupational therapy clientsR: 19–80
M: 47.0 (SD 15.0)
24/26
92%
Strong
McColl, Paterson, Davies, Doubt & Law, 2000 [60]To determine the validity and community utility of the COPM.n = 61 individuals with a disabilityR: 18->7522/22
100%
Strong
Tuntland, Aaslund, Langeland, Espehaug & Kjeken, 2016 [61]To determine the validity, responsiveness, interpretability and feasibility of the COPM for home-dwelling older adults.n = 225 older adultsM: 80.821/22
95%
Strong
Verkerk, Wold, Louwers, Meester-Delver & Nollet, 2006 [62]To determine the inter-rater agreements, construct and criterion validity of the COPM in parents of children with disabilities.n = parents of 80 childrenParents’ age:
R: 24–48
M: 35.0 (SD 5.0)
Children’s age
R: 1–7.5
M: 3.70 (SD 1.80)
22/24
91%
Strong
Cusick, Lannin & Lowe, 2007 [63]To determine internal consistency, content and construct validity, responsiveness and impact of half scores of the adapted COPM (for children).n = 42 children with spastic hemiplegic cerebral palsyR: 2–7
M: 3.90
23/26
88%
Strong
CPQRosenberg, Jarus & Bart, 2010 [43]To develop and test the psychometric properties of the CPQ.n = 480 (n = 231 children with developmental difficulties; n = 249 typically developing children)Developmental difficulties sample:
M: 5.2 (SD 0.7)
Typically developing sample:
M: 5.1 (SD 0.7)
22/22
100%
Strong
LIFE-HNoreau, Desrosiers, Robichaud, Fougeyrollas, Rochette & Viscogliosi, 2004 [64]To document the reliability of the LIFE-H.n = 84 individuals with physical disabilitiesM: 78.0 (SD 8.2)20/22
91%
Strong
Noreau, Lepage, Boissiere, Picard, Fougeyrollas, Mathieu, Desmarais & Nadeau, 2007 [65]To examine the psychometric properties of the LIFE-H and draw a profile of the level of participation of children aged 5–13 years with impairments.n = 94 parents of children with disabilities
n = 29 experts (content validity panel)
Children’s age:
M: 8 years 10 months (SD 2 years 6 months)
20/22
91%
Strong
PEDICATDumas & Fragala-Pinkham, 2012 [66]To examine concurrent
validity of the PEDI-CAT Mobility domain with
the PEDI Functional Skills (FS) Mobility Scale, evaluate item-specific reliability between the PEDI-CAT
Mobility domain and PEDI FS Mobility Scale, and
assess score distributions for floor and ceiling effects.
n = 35 parentsChildren’s age:
R: 3.93–19.87
M: 11.49 (SD 4.89)
15/20
75%
Good
Dumas, Fragala-Pinkham, Haley, Ni, Coster, Kramer, Kao, Moed & Ludlow, 2012 [67]To assess discriminant validity of the PEDI-CAT and assess test–retest reliability, administration time, and obtain parental feedback about the tool.n = 102 (n = 50 parents of children with disabilities; n = 52 parents of children without disabilities; n = 25 retest sample)Children’s age:
R: 3–20
M: 10.30 (SD 4.64)
20/22
91%
Strong
Dumas, Fragala-Pinkham, Rosen & O’Brien, 2017 [68]To assess construct (convergent and divergent) validity of the PEDI-CAT in children with complex medical conditions.n = 110 childrenR: 0.22–21.93
M: 5 (SD 5.65)
17/20
85%
Strong
Hayley, Coster, Dumas, Fragala-Pinkham, Kramer, Ni, Tian, Kao, Moed & Ludlow, 2011 [69]Assess the accuracy and precision of PEDI-CAT item banks for ages 0–21 years.n = 2822 (n = 617 young people with a disability; n = 2205 typically developing young people)Disability sample:
M: 11 years 8 months (SD 4.7)
Typically developing sample:
M:10 years 1 month (SD 6.1)
19/20
95%
Strong
Shore, Allar, Miller, Matheney, Snyder & Fragala-Pinkham, 2019 [70]To investigate the construct validity and test–retest reliability of the PEDI-CAT for children with cerebral palsy (CP).n = 101 children with CPR: 6–20
M: 11.9 (SD 3.70)
22/22
100%
Strong
Shore, Allar, Miller, Matheney, Snyder & Fragala-Pinkham, 2017 [71]To determine the discriminant validity of the PEDI-CAT according to the Gross Motor Function Classification System and Manual Ability Classification System in children with CP.n = 101R: 6–20
M: 11.9 (SD 3.70)
22/22
100%
Strong
PEDI-CAT ASDCoster, Kramer, Tian, Dooley, Liljenquist, Kao & Ni, 2016 [72]To evaluate the structural validity of the PEDI-CAT for children and youth with symptoms of ASD.n = 365R: 3–21
M: 11.9 (SD 4.67)
19/20
95%
Strong
Kramer, Coster, Kao, Snow & Orsmond, 2012 [73]To evaluate the applicability, representativeness, and comprehensiveness of the PEDI-CAT for children and youth with ASD.n = 20 professionals
n = 18 parents representing n = 21 children and youth with ASD
Children’s age:
R: 3 years 8 months—17 years 11 months
M: 9 years 8.5 months (SD 45.3 months)
16/20
80%
Good
Kramer, Liljenquist & Coster, 2016 [74]To explore test–retest reliability of the PEDI-CAT for ASD and concurrent validity with Vineland-II.n = 39 parentsChildren’s age:
R: 10 years 3 months–18 years 10 months
M: 14 years 10 months (SD 2 years 8 months)
16/20
80%
Good
PEGSMissiuna & Pollock, 2000 [75]To pilot a measure and process providing young children with the opportunity to assess their performance on daily tasks and aid goal setting.n = 37 children and parentsChildren’s age:
R: 5–9
19/22
86%
Strong
Missiuna, Pollock, Law, Walter & Cavey, 2006 [76]To determine whether children with a disability could self-report their competence performing everyday activities, and establish whether these self-reports could be used to establish and prioritise occupational therapy intervention goals.n = 117R: 6–10
M: 7.7
21/22
95%
Strong
PEM-CYCoster, Bedell, Law, Khetani, Teplicky, Liljenquist, Gleason & Kao, 2011 [77]To examine the psychometric properties of the PEM-CY.n = 576 caregivers of children and young peopleChildren’s age:
R: 5–17
M: 11 (SD 3.1)
20/22
91%
Strong
Coster, Law, Bedell, Khetani, Cousins & Teplicky, 2011 [78]To describe the conceptual foundation of the PEM-CYN/AN/A12/20
60%
Adequate
Khetani, Marley, Baker, Albrecht, Bedell, Coster, Anaby & Law, 2014 [79]To examine the concurrent validity and utility of the PEM-CY for Health Impact Assessment in non-urban sustainable development projects affecting children with disabilities.n = 89 parents of children and youth with disabilitiesM: 11.91 (SD 3.36)22/22
100%
Strong
ROPPSandstrom & Lundin-Olsson, 2007 [48]To develop a questionnaire for self-rated perceived participation and evaluate its psychometric properties.n = 85R: 23–79
M: 55.5 (SD 13.3)
21/22
95%
Strong
Noonan, Kopec, Noreau, Singer, Chan, Masse & Dvorak, 2009 [80]To determine the content validity of measures of participation by linking to the ICF.N/AN/A15/16
94%
Strong
SCOPEBowyer, Kramer, Kielhofner, Maziero-Barbosa & Girolami, 2007 [81]To examine the reliability and validity of the SCOPE.n = 36R: 2–21
M: 3
21/22
95%
Strong
Kramer, Bowyer, Kielhofner, O’Brien & Maziero-Barbosa, 2009 [82]To assess how practitioners performed using a revised version of the SCOPE and the effect of revisions on practitioner rating behaviours.n = 39 practitioners reporting on n = 168 paediatric clients.Children’s age:
R: 6 months–15 years 8 months
M: 4 years 10.96 months (SD 35.27 months)
21/22
95%
Strong
Bowyer, Lee, Kramer, Taylor & Kielhofner, 2012 [83]To determine the clinical utility of the SCOPE.n = 21 practitionersNot reported17/20
85%
Strong
Vineland-3Sparrow, Cicchetti & Saulnier, 2016 [50]User manual, describing psychometric properties of the Vineland-3.n = 2560 (normative sample)R:0–90N/A
1 ABAS-3, Adaptive Behavior Assessment System, 3rd edition; AusTOMs-OT, Australian Therapy Outcome Measures for Occupational Therapy, 3rd edition; CAPE-PAC, Children’s Assessment of Paticipation and Enjoyment and Preferences for Activities of Children; COPM, Canadian Occupational Performance Measure; CPQ, Children’s Participation Questionnaire; LIFE-H, Assessment of Life Habits; PEDI-CAT, Pediatric Evaluation of Disability Inventory—Computer Adaptive Test; PEDI-CAT (MD), PEDI-CAT with mobility device; PEDI-CAT ASD, PEDI-CAT module for autism spectrum disorder; PEGS, Perceived Efficacy Goal Setting System; ROPP, Rating of Perceived Participation; SCOPE, Short Child Occupational Profile; Vineland-3, Vineland Adaptive Behaviour Scales, 3rd edition; 2 R, range; M, mean; SD, standard deviation.
Table 4. Characteristics of included assessment of functioning tools.
Table 4. Characteristics of included assessment of functioning tools.
Measure 1ReliabilityValidityResponsivenessOverall Utility
Internal ConsistencyReliabilityContent ValidityConstruct ValidityCriterion Validity
ABAS-3Excellent
0.96–0.99
Test-retest
Excellent
0.82
ExcellentExcellentExcellent-Excellent
Inter-rater
Adequate to excellent
0.67–0.85
Alternate-forms
Adequate to excellent
0.79–0.95
AusTOMs-OT-Test–retest
Adequate to excellent
0.616–0.960
ExcellentAdequateAdequateExcellentAdequate
Inter-rater
Adequate
>0.70
Intra-rater
Adequate
>0.74
COPMExcellent
0.86–0.88
Test–retest
Adequate
0.67–0.69
ExcellentExcellentAdequateAdequateAdequate
Inter-rater
Excellent
0.80
CAPE/PACCAPE
Poor to adequate
0.42–0.77
Test–retest
Poor to excellent
0.55–0.81
AdequateAdequateAdequateAdequatePoor
PAC
Adequate to excellent
0.76–0.84
Test–retest (ASD)
Poor to adequate
0.196–0.758
CPQAdequate to excellent
0.79–0.90
Test–retest
Excellent
0.84–0.90
AdequateAdequateAdequateAdequateAdequate
LIFE-H-Test–retest
Excellent
0.95
ExcellentAdequate--Adequate
Inter-rater
Adequate to excellent
0.78–0.89
Intra-rater
Adequate
>0.75
PEDI-CATPoor to excellent
0.3390–1.00
Test–retest
Excellent
0.90–0.99
ExcellentAdequateAdequateAdequateAdequate
Inter-rater
Excellent
0.83–0.89
PEDI-CAT ASD-Test–retest
Excellent
0.86–0.92
ExcellentAdequateAdequate-Adequate
PEGSAdequate
0.795
Inter-rater
Poor
0.261–0.307
ExcellentAdequateAdequate-Adequate
PEM-CYAdequate to excellent 0.67–0.80Test–retest
Poor to excellent
0.58–1.00
ExcellentAdequateAdequate-Adequate
ROPPExcellent
0.90
Test–retest
Excellent
0.97
AdequateAdequateAdequate-Adequate
SCOPEExcellent
0.90
Inter-rater
Adequate to excellent
0.64–0.83
ExcellentAdequate--Adequate
Vineland-3Excellent
0.90–0.98
Test–retest
Adequate to excellent
0.73–0.92
ExcellentAdequateAdequate-Adequate
Inter-rater
Adequate to excellent
0.70–0.81
1 ABAS-3, Adaptive Behavior Assessment System, 3rd edition; AusTOMs-OT, Australian Therapy Outcome Measures for Occupational Therapy, 3rd edition; CAPE-PAC, Children’s Assessment of Paticipation and Enjoyment and Preferences for Activities of Children; COPM, Canadian Occupational Performance Measure; CPQ, Children’s Participation Questionnaire; LIFE-H, Assessment of Life Habits; PEDI-CAT, Pediatric Evaluation of Disability Inventory—Computer Adaptive Test; PEDI-CAT (MD), PEDI-CAT with mobility device; PEDI-CAT ASD, PEDI-CAT module for autism spectrum disorder; PEGS, Perceived Efficacy Goal Setting System; ROPP, Rating of Perceived Participation; SCOPE, Short Child Occupational Profile; Vineland-3, Vineland Adaptive Behaviour Scales, 3rd edition.
Table 5. Distribution of codes linked to the International Classification of Functioning, Disability and Health [17] components and chapters.
Table 5. Distribution of codes linked to the International Classification of Functioning, Disability and Health [17] components and chapters.
Measures of Functioning 1
ABAS-3AusTOMs-OTCAPE-PACCOPMCPQLIFE-HPEDI-CATPEDI-CAT
(MD)
PEDI-CAT ASDPEDI-CAT ASD (MD)PEGSPEM-CYROPPSCOPEVineland-3
Total codes2569959364798270213315258261122957648
Body functions
(%)
22
(8)
78
(79)
0001
(1)
17
(6)
17
(8)
19
(7)
19
(7)
2
(8)
3
(3)
06
(11)
117
(18)
Mental21
(95)
10
(13)
0001
(100)
16
(94)
16
(94)
18
(95)
18
(95)
1
(50)
004
(67)
107
(91)
Sensory and pain012
(15)
0000000000004
(3)
Voice and speech1
(5)
9
(12)
0000000000001
(1)
Cardiovascular, haematological, immunological and respiratory09
(12)
0000000003
(100)
000
Digestive, metabolic and endocrine09
(12)
00001
(6)
1
(6)
1
(5)
1
(5)
00001
(1)
Genitourinary and reproductive09
(12)
0000000000001
(1)
Neuromusculoskeletal and movement-related011
(14)
000000001
(50)
002
(33)
3
(3)
Skin and related structures09
(12)
0000000000000
Activities and participation
(%)
232
(91)
21
(21)
59
(100)
36
(100)
47
(100)
97
(99)
253
(94)
196
(92)
296
(94)
239
(93)
24
(92)
62
(55)
27
(93)
36
(63)
531
(82)
Learning and applying knowledge14
(6)
1
(5)
5
(8)
001
(1)
19
(8)
19
(10)
20
(7)
20
(8)
1
(4)
3
(5)
06
(17)
115
(22)
General tasks and demands19
(8)
1
(5)
0001
(1)
11
(4)
11
(6)
17
(6)
17
(7)
01
(2)
07
(19)
15
(3)
Communication32
(14)
02
(3)
1
(3)
2
(4)
10
(10)
10
(4)
10
(5)
28
(9)
28
(12)
2
(8)
5
(8)
4
(15)
4
(11)
114
(21)
Mobility6
(3)
8
(38)
3
(5)
4
(11)
1
(2)
15
(15)
107
(42)
51
(26)
108
(36)
52
(22)
13
(54)
4
(6)
6
(22)
5
(14)
87
(16)
Self-care50
(22)
1
(5)
05
(14)
7
(14)
20
(21)
67
(26)
66
(34)
78
(26)
77
(32)
2
(8)
6
(10)
5
(19)
6
(17)
77
(15)
Domestic life35
(15)
4
(19)
4
(7)
6
(17)
5
(10)
12
(12)
20
(8)
20
(10)
22
(7)
22
(9)
08
(13)
2
(4)
1
(3)
29
(5)
Interpersonal interactions and relationships25
(11)
1
(5)
00010
(10)
10
(4)
10
(5)
12
(4)
12
(5)
09
(14)
4
(15)
3
(8)
57
(11)
Major life areas30
(13)
2
(9)
6
(10)
8
(22)
9
(19)
12
(12)
6
(2)
6
(3)
8
(3)
8
(3)
1
(4)
8
(13)
2
(7)
4
(11)
27
(5)
Community, social and civic life28
(12)
3
(14)
39
(66)
12
(33)
24
(51)
16
(16)
3
(1)
3
(2)
3
(1)
3
(1)
5
(21)
18
(29)
4
(15)
010
(2)
Environmental factors
(%)
2
(1)
000000000047
(42)
2
(7)
15
(26)
0
Products and technology0000000000010
(21)
07
(47)
0
Natural environment and human-made changes to the environment0000000000017
(36)
000
Support and relationships1
(50)
00000000007
(15)
05
(33)
0
Attitudes000000000005
(11)
2
(100)
2
(13)
0
Services, systems and policies1
(50)
00000000008
(17)
01
(7)
0
1 ABAS-3, Adaptive Behavior Assessment System, 3rd edition; AusTOMs-OT, Australian Therapy Outcome Measures for Occupational Therapy, 3rd edition; CAPE-PAC, Children’s Assessment of Paticipation and Enjoyment and Preferences for Activities of Children; COPM, Canadian Occupational Performance Measure; CPQ, Children’s Participation Questionnaire; LIFE-H, Assessment of Life Habits; PEDI-CAT, Pediatric Evaluation of Disability Inventory—Computer Adaptive Test; PEDI-CAT (MD), PEDI-CAT with mobility device; PEDI-CAT ASD, PEDI-CAT module for autism spectrum disorder; PEDI-CAT ASD (MD), PEDI-CAT ASD with mobility device; PEGS, Perceived Efficacy Goal Setting System; ROPP, Rating of Perceived Participation; SCOPE, Short Child Occupational Profile; Vineland-3, Vineland Adaptive Behaviour Scales, 3rd edition.
Table 6. Percentage of total codes linking to the International Classification of Functioning, Disability and Health Core Sets [20] for Autism covered by measures of functioning.
Table 6. Percentage of total codes linking to the International Classification of Functioning, Disability and Health Core Sets [20] for Autism covered by measures of functioning.
Measures of Functioning 1
ABAS-3AusTOMs-OTCAPE-PACCOPMCPQLIFE-HPEDI-CATPEDI-CAT
(MD)
PEDI-CAT ASDPEDI-CAT ASD (MD)PEGSPEM-CYROPPSCOPEVineland-3
Codes (Total)2569959364798270213315258261122957648
Codes linking to Comprehensive ICF 2 Core Set for Autism
n (%)
242 (95)48
(49)
52
(88)
27
(75)
39
(83)
77
(79)
150
(56)
146
(69)
191
(59)
186
(72)
14
(54)
61
(55)
20
(69)
35
(61)
520
(80)
Body functions21
(8)
42
(88)
0001
(1)
13
(9)
13
(9)
15
(8)
15
(8)
2
(14)
005
(14)
105
(20)
Activities & Participation220
(91)
6
(12)
52
(100)
27
(100)
39
(100)
76
(99)
137
(91)
133
(91)
176
(92)
171
(92)
12
(86)
42
(69)
18
(90)
18
(51)
415
(80)
Environmental Factors1
(1)
000000000019
(31)
2
(10)
12
(34)
0
Codes linking to Brief ICF Core Set for Autism (6–16 years)
n (%)
156
(61)
35
(35)
43
(73)
18
(50)
30
(64)
49
(50)
104
(39)
102
(48)
132
(42)
129
(50)
10
(39)
43
(38)
11
(38)
34
(60)
418
(65)
Body functions21
(13)
30
(86)
0001
(2)
13
(12)
13
(13)
14
(11)
14
(11)
2
(20)
005
(15)
102
(24)
Activities & Participation134
(86)
5
(14)
43
(100)
18
(100)
30
(100)
48
(98)
91
(88)
89
(87)
118
(89)
115
(89)
8
(80)
27
(63)
9
(82)
17
(50)
316
(76)
Environmental Factors1
(1)
000000000016
(37)
2
(18)
12
(35)
0
1 ABAS-3, Adaptive Behavior Assessment System, 3rd edition; AusTOMs-OT, Australian Therapy Outcome Measures for Occupational Therapy, 3rd edition; CAPE-PAC, Children’s Assessment of Paticipation and Enjoyment and Preferences for Activities of Children; COPM, Canadian Occupational Performance Measure; CPQ, Children’s Participation Questionnaire; LIFE-H, Assessment of Life Habits; PEDI-CAT, Pediatric Evaluation of Disability Inventory—Computer Adaptive Test; PEDI-CAT (MD), PEDI-CAT with mobility device; PEDI-CAT ASD, PEDI-CAT module for autism spectrum disorder; PEDI-CAT ASD (MD), PEDI-CAT ASD with mobility device; PEGS, Perceived Efficacy Goal Setting System; ROPP, Rating of Perceived Participation; SCOPE, Short Child Occupational Profile; Vineland-3, Vineland Adaptive Behaviour Scales, 3rd edition; 2 International Classification of Functioning, Disability and Health.
Table 7. Percentage of unique codes linking to the International Classification of Functioning, Disability and Health Core Sets [20] for Autism covered by measures of functioning.
Table 7. Percentage of unique codes linking to the International Classification of Functioning, Disability and Health Core Sets [20] for Autism covered by measures of functioning.
Measures of Functioning 1
ABAS-3AusTOMs-OTCAPE-PACCOPMCPQLIFE-HPEDI-CATPEDI-CAT (MD)PEDI-CAT ASDPEDI-CAT ASD (MD)PEGSPEM-CYROPPSCOPEVineland-3
Unique codes linking to Comprehensive ICF 2 Core Set for Autism
n (%) (110)
48
(44)
10
(9)
11
(10)
13
(12)
12
(11)
30
(27)
44
(40)
43
(38)
46
(42)
45
(41)
14
(13)
23
(21)
18
(16)
28
(25)
67
(61)
Body functions (20)8
(40)
4
(20)
0001
(5)
2
(10)
2
(10)
2
(10)
2
(10)
2
(10)
004
(20)
17
(85)
Activities & Participation (59)39
(66)
6
(10)
11
(19)
13
(22)
12
(20)
29
(49)
42
(71)
40
(68)
44
(75)
43
(73)
6
(10)
14
(24)
16
(27)
14
(24)
50
(85)
Environmental Factors (31)1
(3)
00000000009
(29)
2
(6)
10
(32)
0
Unique codes linking to Brief ICF Core Set for Autism (6–16 years)
n (%) (81)
31 (38)7
(9)
4
(5)
6
(7)
5
(6)
16
(20)
28
(35)
28
(35)
29
(36)
29
(45)
10
(12)
15
(19)
8
(10)
27
(33)
47
(58)
Body functions (18)8
(44)
3
(17)
0001
(6)
2
(11)
2
(11)
2
(11)
2
(11)
2
(11)
004
(22)
16
(89)
Activities & Participation (36)22
(61)
4
(11)
4
(11)
6
(17)
5
(14)
15
(42)
26
(72)
26
(72)
27
(75)
27
(75)
3
(8)
7
(19)
7
(19)
13
(36)
31
(86)
Environmental Factors (27)1
(4)
00000000008
(30)
1
(4)
10
(37)
0
1 ABAS-3, Adaptive Behavior Assessment System, 3rd edition; AusTOMs-OT, Australian Therapy Outcome Measures for Occupational Therapy, 3rd edition; CAPE-PAC, Children’s Assessment of Paticipation and Enjoyment and Preferences for Activities of Children; COPM, Canadian Occupational Performance Measure; CPQ, Children’s Participation Questionnaire; LIFE-H, Assessment of Life Habits; PEDI-CAT, Pediatric Evaluation of Disability Inventory—Computer Adaptive Test; PEDI-CAT (MD), PEDI-CAT with mobility device; PEDI-CAT ASD, PEDI-CAT module for autism spectrum disorder; PEDI-CAT ASD (MD), PEDI-CAT ASD with mobility device; PEGS, Perceived Efficacy Goal Setting System; ROPP, Rating of Perceived Participation; SCOPE, Short Child Occupational Profile; Vineland-3, Vineland Adaptive Behaviour Scales, 3rd edition; 2 International Classification of Functioning, Disability and Health.
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Hayden-Evans, M.; Milbourn, B.; D’Arcy, E.; Chamberlain, A.; Afsharnejad, B.; Evans, K.; Whitehouse, A.J.O.; Bölte, S.; Girdler, S. An Evaluation of the Overall Utility of Measures of Functioning Suitable for School-Aged Children on the Autism Spectrum: A Scoping Review. Int. J. Environ. Res. Public Health 2022, 19, 14114. https://doi.org/10.3390/ijerph192114114

AMA Style

Hayden-Evans M, Milbourn B, D’Arcy E, Chamberlain A, Afsharnejad B, Evans K, Whitehouse AJO, Bölte S, Girdler S. An Evaluation of the Overall Utility of Measures of Functioning Suitable for School-Aged Children on the Autism Spectrum: A Scoping Review. International Journal of Environmental Research and Public Health. 2022; 19(21):14114. https://doi.org/10.3390/ijerph192114114

Chicago/Turabian Style

Hayden-Evans, Maya, Benjamin Milbourn, Emily D’Arcy, Angela Chamberlain, Bahareh Afsharnejad, Kiah Evans, Andrew J. O. Whitehouse, Sven Bölte, and Sonya Girdler. 2022. "An Evaluation of the Overall Utility of Measures of Functioning Suitable for School-Aged Children on the Autism Spectrum: A Scoping Review" International Journal of Environmental Research and Public Health 19, no. 21: 14114. https://doi.org/10.3390/ijerph192114114

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop