Next Article in Journal
Combined Use of Febuxostat and Colchicine Does Not Increase Acute Hepatotoxicity in Patients with Gout: A Retrospective Study
Next Article in Special Issue
Prevalence, Clinical Aspects and Outcomes in a Large Cohort of Persons with Diabetic Foot Disease: Comparison between Neuropathic and Ischemic Ulcers
Previous Article in Journal
Thoracic Ultrasound for Immediate Exclusion of Pneumothorax after Interventional Bronchoscopy
Previous Article in Special Issue
Multi-System Factors Associated with Metatarsophalangeal Joint Deformity in Individuals with Type 2 Diabetes
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Review

Clinician Assessment Tools for Patients with Diabetic Foot Disease: A Systematic Review

1
Department of Nursing and Podiatry, University of Málaga, Arquitecto Francisco Peñalosa, s/n. Ampliación Campus de Teatinos, 29071 Málaga, Spain
2
Medical School of Physical Education and Sports, University of Málaga, C/Jiménez Fraud 10. Edificio López de Peñalver, 29010 Málaga, Spain
3
Department of Physiotherapy, University of Málaga, Arquitecto Francisco Peñalosa, s/n. Ampliación campus de Teatinos, 29071 Málaga, Spain
*
Author to whom correspondence should be addressed.
J. Clin. Med. 2020, 9(5), 1487; https://doi.org/10.3390/jcm9051487
Submission received: 10 April 2020 / Revised: 11 May 2020 / Accepted: 12 May 2020 / Published: 15 May 2020

Abstract

:
The amputation rate in patients with diabetes is 15 to 40 times higher than in patients without diabetes. To avoid major complications, the identification of high-risk in patients with diabetes through early assessment highlights as a crucial action. Clinician assessment tools are scales in which clinical examiners are specifically trained to make a correct judgment based on patient outcomes that helps to identify at-risk patients and monitor the intervention. The aim of this study is to carry out a systematic review of valid and reliable Clinician assessment tools for measuring diabetic foot disease-related variables and analysing their psychometric properties. The databases used were PubMed, Scopus, SciELO, CINAHL, Cochrane, PEDro, and EMBASE. The search terms used were foot, ankle, diabetes, diabetic foot, assessment, tools, instruments, score, scale, validity, and reliability. The results showed 29 validated studies with 39 Clinician assessment tools and six variables. There is limited evidence on all of the psychometric characteristics of the Clinician assessment tools included in this review, although some instruments have been shown to be valid and reliable for the assessment of diabetic neuropathy (Utah Early Neuropathy Scale or UENS); ulceration risk (Queensland High Risk Foot Form or QHRFF); diabetic foot ulcer assessment, scoring, and amputation risk (Perfusion, extent, depth, infection and sensation scale or PEDIS and Site, Ischemia, Neuropathy, Bacterial Infection, and Depth score or SINBAD); and diabetic foot ulcer measurement (Leg Ulcer Measurement Tool LUMT).

1. Introduction

Diabetes is a chronic disease that might lead to several systemic complications, such as diabetic foot disease (DFD), a common condition with a global prevalence of 6.3%, which is known to affect wound onset and healing [1]. Once a diabetic foot ulcer (DFU) occurs, treatment is often unsuccessful due to infection or neurovascular complications. Patients often require a minor or major amputation, which negatively affects their quality of life and survival [2,3]. The amputation rate in the diabetic population is 15 to 40 times higher than in non-diabetic patients [4]; therefore, DFD translates into high social impact and poor clinical prognosis, creating a heavy burden for health services [5]. The identification of high-risk diabetic patients through early assessment remains the primary action to avoid major complications [6]. For this purpose, valid and reliable instruments are required in order to assess diabetic foot-related variables.
Outcome evaluations measure how patients feel, function, or survive after a disease or condition. The evaluations include clinical outcome assessments (COAs) and biomarkers. Biomarkers are based on an organic process, whereas COAs are based on the implementation and/or interpretation of information from a patient. There are four types of COAs: patient-reported outcomes (PROs), clinician assessment tools or scales, observer-reported outcomes, and performance outcomes [7].
For clinician assessment tools, clinical examiners must be specifically trained to make a correct judgment that is based on patient outcomes. This assessment helps to efficiently identify at-risk patients and monitor whether or not they should undergo an intervention [7]. To our knowledge, there are no scientific reports that thoroughly review DFD clinician assessment tools and their psychometric properties. Previous studies have investigated DFU assessment scales [8,9], but none have performed a detailed analysis of psychometric properties or included scales that measure factors other than the presence and characteristics of an ulcer (diabetic neuropathy, ulcer risk).
Therefore, the aims of this work were, as follows: (1) to identify valid and reliable clinician assessment tools for measuring DFD-related variables, (2) to analyse the psychometric properties of the identified clinician assessment tools or scales, and (3) to highlight clinician assessment tools that are associated with improved recommendations for patients with DFD based on their psychometric properties.

2. Materials and Methods

2.1. Protocol and Registration

This systematic review was developed following the preferred reporting items for systematic reviews and meta-analyses (PRISMA) guidelines [10]. It was registered in the PROSPERO database (CRD no. 42019118202).

2.2. Eligibility Criteria

The study subjects were patients with DFD, which included those with diabetic foot (infection, ulceration, or destruction of tissues of the foot of a person that is diagnosed with diabetes mellitus) or diabetic neuropathy (the presence of symptoms or signs of nerve dysfunction in a person with diabetes mellitus) [11], regardless of the type of diabetes, intervention, gender, or age. All the studies of clinician assessment tools for DFD evaluation and monitoring were included. All documents published up to 30 December 2019 that were published in English, French, Italian, Portuguese, or Spanish were included. Studies of clinician assessment tools that did not include any psychometric properties in their development or did not provide any measurement properties that met the consensus-based standards for the selection of health measurement instruments (COSMIN) criteria were excluded [12]. Although the COSMIN methodology is aimed at studies on the measurement properties of PROMs, it can also be used in other types of studies on the measurement properties. These measurement properties are reliability (internal consistency, reliability, and measurement error), validity (content validity, construct validity, and criterion validity), and responsiveness [12].

2.3. Sources and Search

The databases used were PubMed, Scopus, SciELO, CINAHL, Cochrane, PEDro, and EMBASE. The following search words were used: foot, ankle, diabet *, diabetic foot, assessment, tools, instruments, score, scale, valid *, and reliab *.
Taking into account the differences between each database, the following search strategy was used: (((foot or ankle) AND (diabet *)) OR (diabetic foot)) AND ((assess *) OR (scale) OR (score) OR (instruments) OR (valid *) OR (reliab *)).

2.4. Study Selection

Three reviewers independently reviewed all of the articles and participated in each phase of study selection. Before reading the full-text articles, the titles and abstracts of the references that were identified in the initial search were filtered according to the eligibility criteria. Differences in judgment were resolved by agreement between the reviewers.

2.5. Data Extraction and Synthesis

In order to facilitate understanding of the results, variables measured by clinician assessment tools were classified into two categories according to diagnostic purpose: “DFD-related variables” and “DFU-related variables”.
The COSMIN checklist is considered to be useful for reporting study measurement properties; therefore, the COSMIN measurement property taxonomy was followed to synthesise the results of this review [12]. Nevertheless, the data extraction process was adapted to take into account all psychometric properties, as this study aimed to review all clinician assessment tools. The following measurements were included in the synthesis of results: sensitivity, specificity, positive predictive value (VPP), negative predictive value (VPN), positive probability ratio (LR+), negative probability ratio (LR−), area under the receiver operating characteristic curve (AUC-ROC), gold standard, agreement with gold standard, inter-rater reliability(INTER), and intrarater reliability (INTRA). Other data were extracted in order to complete the general analysis of each study: taxonomy of the clinician assessment tool, authors, publication year, type of diabetes, and number of study subjects.

3. Results

The flow diagram (Figure 1) summarises the study selection stages for the studies that were included in this review, detailing the reasons for exclusions [10]. The most common reasons for exclusion of full-text articles were publication in a language different from those that were included in the eligibility criteria or not reporting any psychometric or measurement properties.
In total, 29 validated studies with 39 scales and six variables were included. The group “DFD-related variables” contained two variables (diabetic neuropathy, ulcer risk) and the group “DFU-related variables” contained four variables (amputation risk, DFU healing, DFU infection assessment, and DFU measurement).
The validation study that included the largest sample was the one that validated the Curative Health Services system (CHS) (n = 19,280) and the one with the smallest sample validated the Leg Ulcer Measurement tool (LUMT) (n = 22).
The most popular validation method for clinician assessment tools or scales was the calculation of psychometric properties that were based on 2 × 2 contingency tables, used in 17 out of 29 studies. Four studies validated clinician assessment tools following the indications in the COSMIN guidelines, while eight studies used different statistical calculations. Sensitivity and specificity were the most frequently calculated psychometric properties, with their value being known for 29 and 27 scales, respectively. PPV was calculated for 21 scales, NPV for 19 scales, LR+ for 14 scales, and LR− for 13 scales. Inter- and intrarater reliability were the least often calculated (10 and seven scales, respectively).
Table 1 shows the DFD-related variables and the validated clinician assessment tools for measurement. Two variables and 20 scales were included in this category. Ten scales were found for the assessment of diabetic neuropathy and 10 for the assessment of ulceration risk.
Table 2 shows the DFU-related variables and the validated clinician assessment tools. Three variables and 17 scales were included in this category. Most of the scales (n = 10) were related to DFU scoring, assessment, and risk of amputation.
Table 3 shows the DFD- and DFU-related variables that followed the COSMIN guidelines [9] in order to measure the validity and reliability. These five scales, unlike those that are presented in Table 1 and Table 2, do not calculate properties, like sensitivity or specificity.
An additional table was included (Table S1) with other details of each scale, including the study subjects, dimensions, punctuation, and description.

4. Discussion

This work aimed to identify validated clinician assessment tools for the measurement of DFD-and DFU-related variables, in order to analyse their psychometric properties and highlight those scales with the best examples. For most outcome variables, at least one scale has been highlighted for its psychometric properties, which have been expanded on in two additional sections at the end of the discussion, namely recommendations for clinical application and potential developments from a research perspective. The objectives were accomplished based on the results that were obtained in this study.
In the present study, the psychometric characteristics of all clinician assessment and follow-up tools in patients with DFD or DFU are presented. However, when interpreting the results, it is important to consider that there are a series of conditioning factors that limit the ability make comparisons between different tools or scales. We observed that some psychometric properties present better results in one scale than another [42,43,44].
The difference in results could be justified in multiple ways, all of which fall into two basic categories. On the one hand, there are the structural characteristics of the scale itself, aspects, such as the number of items that make up the tool and the way in which each of those items is evaluated, which are two aspects that definitively determine the way in which the clinician assessment tool is used [44,45]. On the other hand, the conditions in which the scale is used unequivocally determine its possible result. In this sense, it is also important to take the profile of the person being evaluated into account. Thus, descriptive characteristics, such as age, gender, time at which the pathology began, education level, socioeconomic aspects and sociocultural aspects, among others, how the final result of the evaluation might determine whether a specific variable is seen [42,45,46].
In this analysis, we aimed to carry out an exhaustive comparison. However, comparisons could only be performed when the conditions for the assessment process and the subject profile were the same, as the structure of the tools cannot be changed; that is, the conditions and descriptive characteristics of the sample were similar. Only under these conditions could we perform a comparison that minimises the error that is derived from the divergence in conditions or profiles of the subjects evaluated [43,44,47,48]. This is important to keep in mind when selecting a clinician assessment tool, as health professionals or researchers should select a tool that used similar conditions and subject profiles for its validation to the sample being assessed [45,46,47].
The number of subjects that were used to validate the tool is a final aspect that must be taken into account. Some scales have very good psychometric characteristics, but the sample used for validation was too small. In this case, the results should be interpreted as a possible tendency to produce results, as they do not have the necessary strength to be considered 100% valid and reliable. Type 2 (beta) errors, resulting from an inadequate sample size to achieve results with the necessary robustness, is an area frequent limitation in many validation studies of clinician assessment tools [44,45].

4.1. Recommendations for Research

The most common validation method in the studies reviewed (17 out of 29) was the use of gold standards togenerate 2 × 2 contingency tables. This suggests a tendency to submit clinician assessment tools or scales to external validation that does not follow the COSMIN guidelines, used in four studies in this review. It is recommended that a criterion for scale validation that uses the same methodology is established in order to facilitate dissemination, understanding, and comparison of results.
The calculation of psychometric properties that were derived from sensitivity and specificity was found to be lacking PPV and NPV, which reflect the impact of prevalence on validity [43,49], and +/−LR were important in terms of the probability of the score to detect true positives and negatives [44,50]. Therefore, we recommend that all of the psychometric properties should be calculated in future validation studies.
Likewise, inter- and intrarater reliability were frequently absent in validation studies, which are fundamental properties for determining whether or not the scales should be recommended for that purpose [45,46,51,52]. This is highly dependent on the criteria and skills of the clinician or researcher. Similarly, the responsiveness was only known for one scale [40], leading to missed information regarding the sensitivity to change for the vast majority of scales evaluated in this review.
Only 12 validation studies specified the type of diabetes of subjects in their sample. This might have an impact on aspects, such as diabetic neuropathy [47,53], so it seems necessary to include in future studies.

4.2. Clinical Recommendations

When deciding which tool or scale to use in a clinical setting, it is important to make two considerations. On the one hand, it is necessary to take the characteristics of the clinical setting, the type of patients, and the variables that will be evaluated, among other factors, into account [42,45]. On the other hand, clinical staff must choose an accurate and adequate assessment tool so that the quality of the results is guaranteed in order to guarantee the quality of the results. The number of available questionnaires to evaluate similar variables has increased exponentially in recent years [42,45,47]. However, many questionnaires that are used in the clinical setting have not undergone a comprehensive validation process [42,48]. Therefore, it is important to know the scale that is intended to be used as the process of evaluation and monitoring of the patient depends, at least in part, on the selection of the correct tool [43,44].
The information that an assessment and monitoring tool offers also depends to some extent on its psychometric characteristics. Clinical staff with little training in the selection of evaluation tools should ask the following question: what are the most important psychometric characteristics when evaluating an evaluation and monitoring tool? Validity and reliability are the two characteristics that researchers unanimously identify to be the most decisive [42,43,44,47,48]. The validity of a tool refers to its ability to be used to measure the variable for which it was designed, the more precise the better [54]. Several types of validity that can be analysed, but they most commonly include construct validity, content validity, and criterion validity [44]. On the other hand, reliability is defined as the ability of an assessment tool to provide consistent results over time when the assessment conditions are the same, including the administration method, characteristics of the sample, type of instrument and evaluators, among others. From its definition, it can be easily deduced that reliability is a changing characteristic within the valuation instrument, which will depend, to a great extent, on the conditions in which it is used. This is why it is necessary to carry out a new validation study when the evaluation conditions change considerably [43,45,47,54].
These two variables are not completely independent, as an assessment tool that is not reliable cannot be valid, but an assessment tool might be reliable, but not valid [42,44,45,46,54].
Finally, although the reliability and validity of an assessment tool are the two most important psychometric characteristics, it is important not to forget that there are characteristics that are related to responsiveness, especially in the clinical setting, defined as the ability of an assessment tool to identify changes that may occur over time (as a consequence of treatment, for example) [54].
Based on the results of this review, it would be suitable to use the Leg Ulcer Measurement Tool scale (LUMT) for ulcer measurement and theQueensland High Risk Foot Formscale (QHRFF) to assess ulceration risk. However, the psychometric characteristics of these tools do not have sufficient strength, because they did not use a sufficient sample [44], as the LUMT and QHRFF validation studies were carried out with 19 and 22 subjects, respectively, as previously noted. The Perfusion, extent, depth, infection and sensation scale or PEDIS and the Site, Ischemia, Neuropathy, Bacterial Infection, and Depth score (SINBAD) scales for DFU assessment may be recommended over other clinician assessment tools or scales due to their poor intrarater reliability. Similarly, the Utah Early Neuropathy Scale (UENS) for diabetic neuropathy assessment should be used with caution, due to the unavailable data on intrarater reliability. The results of this review are not conclusive for recommending a scale to assess DFU healing due to their variability issues. Even though it was not discussed in the reviewed studies, it seems accurate to consider, or ideally measure, the time that it takes to complete each scale in order to make a definitive recommendation, as this might alter the normal development of a health service’s attention.
It would be advisable to combine scales in patients with diabetic foot with PRO scales and objective measurements with OCOMs and/or biomarkers in order to obtain a multidisciplinary and complete approach to patient monitoring and follow-up. Moreover, using any of these three approaches is not exclusive to others (e.g., a DFU with a low risk of amputation in a patient with high HbAc1 levels, a sedentary lifestyle and bad habits), as they all play an important role in the assessment and monitoring of patients with DFD.
The present study has a number of limitations that must be taken into account when interpreting the results. Firstly, although an attempt was made to carry out the widest possible search from a linguistic point of view, including five languages (English, French, Spanish, Portuguese, and Italian), we might have missed other tools published in a language other than those mentioned. Secondly, in the present study, an enormous effort was made to synthesise the most frequently studied psychometric characteristics; however, there are other psychometric characteristics that were not included in this study.

5. Conclusions

Although there is limited evidence for the psychometric characteristics of the clinician assessment tools that are included in this review, some instruments were found to be valid and reliable for the assessment of diabetic neuropathy (UENS), ulceration risk (QHRFF); DFU assessment, scoring, and amputation risk (PEDIS and SINBAD); and, DFU measurement (LUMT). However, further research is required to improve the reliability and validity of properties in the recommended scales from this review, according to the evidence provided in the literature.

Supplementary Materials

The following are available online at https://www.mdpi.com/2077-0383/9/5/1487/s1, Table S1: characteristics of the Clinician assessment tools included in the study.

Author Contributions

Conceptualization, M.R.-M. and M.G.-S.; Methodology, R.F.-T.; Validation, R.F.-T., A.J.P.-P. and J.C.G.-R.; Formal Analysis, M.G.-S.; Investigation, M.R.-M. and M.G.-S.; Resources, R.F.-T. and A.J.P.-P.; Data analysis, R.F.-T., A.J.P.-P. and J.C.G.-R.; Writing—Original Draft Preparation, R.F.-T.; Writing—Review & Editing, M.R.-M. and M.G.-S.; Visualization, M.R.-M.; Supervision, M.R.-M. and M.G.-S.; Project Administration, J.C.G.-R. All authors have read and agreed to the published version of the manuscript.

Funding

This research received no external funding.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Zhang, P.; Lu, J.; Jing, Y.; Tang, S.; Zhu, D.; Bi, Y. Global epidemiology of diabetic foot ulceration: A systematic review and meta-analysis. Ann Med. 2017, 49, 106–116. [Google Scholar] [CrossRef] [PubMed]
  2. Apelqvist, J. Diagnostics and treatment of the diabetic foot. Endocrine 2012, 41, 384–397. [Google Scholar] [CrossRef]
  3. Navarro-Flores, E.; Cauli, O. Quality of life in individuals with diabetic foot syndrome. Endocr. Metab. Immune Disord.-Drug Targets 2020. [Google Scholar] [CrossRef]
  4. Narres, M.; Kvitkina, T.; Claessen, H.; Droste, S.; Schuster, B.; Morbach, S. Incidence of lower extremity amputations in the diabetic compared with the non-diabetic population: A systematic review. PLoS ONE 2017, 12, e0182081. Available online: https://www.ncbi.nlm.nih.gov/pmc/articles/PMC5573217/ (accessed on 10 March 2020). [CrossRef] [PubMed] [Green Version]
  5. Raghav, A.; Khan, Z.A.; Labala, R.K.; Ahmad, J.; Noor, S.; Mishra, B.K. Financial burden of diabetic foot ulcers to world: A progressive topic to discuss always. Ther. Adv. Endocrinol. Metab. 2018, 9, 29–31. [Google Scholar] [CrossRef] [PubMed]
  6. Chicharro-Luna, E.; Pomares-Gómez, F.J.; Ortega-Ávila, A.B.; Marchena-Rodríguez, A.; Blanquer-Gregori, J.F.J.; Navarro-Flores, E. Predictive model to identify the risk of losing protective sensibility of the foot in patients with diabetes mellitus. Int. Wound J. 2020, 17, 220–227. [Google Scholar] [CrossRef]
  7. Powers, J.H.; Patrick, D.L.; Walton, M.K.; Marquis, P.; Cano, S.; Hobart, J. Clinician-Reported Outcome Assessments of Treatment Benefit: Report of the ISPOR Clinical Outcome Assessment Emerging Good Practices Task Force. Value Health 2017, 20, 2–14. [Google Scholar] [CrossRef] [Green Version]
  8. Karthikesalingam, A.; Holt, P.J.; Moxey, P.; Jones, K.G.; Thompson, M.M.; Hinchliffe, R.J. A systematic review of scoring systems for diabetic foot ulcers. Diabet. Med. 2010, 27, 544–549. [Google Scholar] [CrossRef]
  9. Monteiro-Soares, M.; Boyko, E.J.; Jeffcoate, W.; Mills, J.L.; Russell, D.; Morbach, S. Diabetic foot ulcer classifications: A critical review. Diabetes Metab. Res. Rev. 2020, 36 (Suppl. S1), e3272. [Google Scholar] [CrossRef] [Green Version]
  10. Moher, D.; Liberati, A.; Tetzlaff, J.; Altman, D.G.; PRISMA Group. Preferred reporting items for systematic reviews and meta-analyses: The PRISMA statement. PLoS Med. 2009, 6, e1000097. [Google Scholar] [CrossRef] [Green Version]
  11. Van Netten, J.J.; Bus, S.A.; Apelqvist, J.; Lipsky, B.A.; Hinchliffe, R.J.; Game, F. Definitions and criteria for diabetic foot disease. Diabetes Metab. Res. Rev. 2020, 36 (Suppl. S1), e3268. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  12. Mokkink, L.B.; Terwee, C.B.; Patrick, D.L.; Alonso, J.; Stratford, P.W.; Knol, D.L. The COSMIN checklist for assessing the methodological quality of studies on measurement properties of health status measurement instruments: An international Delphi study. Qual. Life Res. 2010, 19, 539–549. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  13. Zilliox, L.A.; Ruby, S.K.; Singh, S.; Zhan, M.; Russell, J.W. Clinical neuropathy scales in neuropathy associated with impaired glucose tolerance. J. Diabetes Complicat. 2015, 29, 372–377. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  14. Bril, V.; Perkins, B.A. Validation of the Toronto Clinical Scoring System for diabetic polyneuropathy. Diabetes Care 2002, 25, 2048–2052. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  15. Asad, A.; Hameed, M.A.; Khan, U.A.; Ahmed, N.; Butt, M.-R.A. Reliability of the neurological scores for assessment of sensorimotor neuropathy in type 2 diabetics. J. Pak. Med. Assoc. 2010, 60, 166–170. [Google Scholar]
  16. Fateh, H.R.; Madani, S.P.; Heshmat, R.; Larijani, B. Correlation of Michigan neuropathy screening instrument, United Kingdom screening test and electrodiagnosis for early detection of diabetic peripheral neuropathy. J. Diabetes Metab. Disord. 2016, 15, 8. Available online: https://www.ncbi.nlm.nih.gov/pmc/articles/PMC4807585/ (accessed on 10 March 2020). [CrossRef] [Green Version]
  17. Singleton, J.R.; Bixby, B.; Russell, J.W.; Feldman, E.L.; Peltier, A.; Goldstein, J. The Utah Early Neuropathy Scale: A sensitive clinical scale for early sensory predominant neuropathy. J. Peripher. Nerv. Syst. 2008, 13, 218–227. [Google Scholar] [CrossRef]
  18. Murphy, C.A.; Laforet, K.; Da Rosa, P.; Tabamo, F.; Woodbury, M.G. Reliability and predictive validity of Inlow’s 60-Second Diabetic Foot Screen Tool. Adv. Skin Wound Care 2012, 25, 261–266. [Google Scholar] [CrossRef]
  19. Bower, V.M.; Hobbs, M. Validation of the basic foot screening checklist: A population screening tool for identifying foot ulcer risk in people with diabetes mellitus. J. Am. Podiatr. Med. Assoc. 2009, 99, 339–347. [Google Scholar] [CrossRef]
  20. Lazzarini, P.A.; Ng, V.; Kinnear, E.M.; Kamp, M.C.; Kuys, S.S.; Hurst, C. The Queensland high risk foot form (QHRFF)—Is it a reliable and valid clinical research tool for foot disease? J. Foot Ankle Res. 2014, 7, 7. [Google Scholar] [CrossRef] [Green Version]
  21. Leese, G.P.; Reid, F.; Green, V.; McAlpine, R.; Cunningham, S.; Emslie-Smith, A.M. Stratification of foot ulcer risk in patients with diabetes: A population-based study. Int. J. Clin. Pract. 2006, 60, 541–545. [Google Scholar] [CrossRef] [PubMed]
  22. Zhou, Q.; Peng, M.; Zhou, L.; Bai, J.; Tong, A.; Liu, M. Development and validation of a brief diabetic foot ulceration risk checklist among diabetic patients: A multicenter longitudinal study in China. Sci. Rep. 2018, 8, 962. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  23. Monteiro-Soares, M.; Vaz-Carneiro, A.; Sampaio, S.; Dinis-Ribeiro, M. Validation and comparison of currently available stratification systems for patients with diabetes by risk of foot ulcer development. Eur. J. Endocrinol. 2012, 167, 401–407. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  24. Monteiro-Soares, M.; Martins-Mendes, D.; Vaz-Carneiro, A.; Sampaio, S.; Dinis-Ribeiro, M. Classification systems for lower extremity amputation prediction in subjects with active diabetic foot ulcer: A systematic review and meta-analysis. Diabetes Metab. Res. Rev. 2014, 30, 610–622. [Google Scholar] [CrossRef] [PubMed]
  25. Forsythe, R.O.; Ozdemir, B.A.; Chemla, E.S.; Jones, K.G.; Hinchliffe, R.J. Interobserver Reliability of Three Validated Scoring Systems in the Assessment of Diabetic Foot Ulcers. Int. J. Low. Extrem. Wounds 2016, 15, 213–219. [Google Scholar] [CrossRef]
  26. Bravo-Molina, A.; Linares-Palomino, J.P.; Vera-Arroyo, B.; Salmerón-Febres, L.M.; Ros-Díe, E. Inter-observer agreement of the Wagner, University of Texas and PEDIS classification systems for the diabetic foot syndrome. Foot Ankle Surg. 2018, 24, 60–64. [Google Scholar] [CrossRef]
  27. Chuan, F.; Tang, K.; Jiang, P.; Zhou, B.; He, X. Reliability and validity of the perfusion, extent, depth, infection and sensation (PEDIS) classification system and score in patients with diabetic foot ulcer. PLoS ONE 2015, 10, e0124739. [Google Scholar] [CrossRef]
  28. Armstrong, D.G.; Lavery, L.A.; Harkless, L.B. Validation of a diabetic wound classification system. The contribution of depth, infection, and ischemia to risk of amputation. Diabetes Care 1998, 21, 855–859. [Google Scholar] [CrossRef]
  29. Arisandi, D.; Oe, M.; Roselyne Yotsu, R.; Matsumoto, M.; Ogai, K.; Nakagami, G. Evaluation of validity of the new diabetic foot ulcer assessment scale in Indonesia. Wound Repair Regen. 2016, 24, 876–884. [Google Scholar] [CrossRef]
  30. Thompson, N.; Gordey, L.; Bowles, H.; Parslow, N.; Houghton, P. Reliability and validity of the revised photographic wound assessment tool on digital images taken of various types of chronic wounds. Adv. Skin Wound Care 2013, 26, 360–373. [Google Scholar] [CrossRef]
  31. Monteiro-Soares, M.; Dinis-Ribeiro, M. A new diabetic foot risk assessment tool: DIAFORA. Diabetes Metab. Res. Rev. 2016, 32, 429–435. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  32. Beckert, S.; Pietsch, A.; Küper, M.; Wicke, C.; Witte, M.; Königsrainer, A.M.A.I.D. A Prognostic Score Estimating Probability of Healing in Chronic Lower Extremity Wounds. Ann. Surg. 2009, 249, 677–681. [Google Scholar] [CrossRef] [PubMed]
  33. Gardner, S.E.; Hillis, S.L.; Frantz, R.A. A prospective study of the PUSH tool in diabetic foot ulcers. J. Wound Ostomy Cont. Nurs. 2011, 38, 385–393. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  34. Margolis, D.J.; Allen-Taylor, L.; Hoffstad, O.; Berlin, J.A. Diabetic neuropathic foot ulcers: Predicting which ones will not heal. Am. J. Med. 2003, 115, 627–631. [Google Scholar] [CrossRef] [PubMed]
  35. Parisi, M.C.R.; Zantut-Wittmann, D.E.; Pavin, E.J.; Machado, H.; Nery, M.; Jeffcoate, W.J. Comparison of three systems of classification in predicting the outcome of diabetic foot ulcers in a Brazilian population. Eur. J. Endocrinol. 2008, 159, 417–422. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  36. Woo, K.Y.; Sibbald, R.G. A cross-sectional validation study of using NERDS and STONEES to assess bacterial burden. Ostomy Wound Manag. 2009, 55, 40–48. [Google Scholar]
  37. Gardner, S.E.; Hillis, S.L.; Frantz, R.A. Clinical signs of infection in diabetic foot ulcers with high microbial load. Biol. Res. Nurs. 2009, 11, 119–128. [Google Scholar] [CrossRef]
  38. Lavery, L.A.; Armstrong, D.G.; Murdoch, D.P.; Peters, E.J.G.; Lipsky, B.A. Validation of the Infectious Diseases Society of America’s diabetic foot infection classification system. Clin. Infect. Dis. 2007, 44, 562–565. [Google Scholar] [CrossRef] [Green Version]
  39. Bril, V.; Tomioka, S.; Buchanan, R.A.; Perkins, B.A.; mTCNS Study Group. Reliability and validity of the modified Toronto Clinical Neuropathy Score in diabetic sensorimotor polyneuropathy. Diabet. Med. 2009, 26, 240–246. [Google Scholar] [CrossRef]
  40. Woodbury, M.G.; Houghton, P.E.; Campbell, K.E.; Keast, D.H. Development, validity, reliability, and responsiveness of a new leg ulcer measurement tool. Adv. Skin Wound Care 2004, 17 Pt 1, 187–196. [Google Scholar] [CrossRef] [Green Version]
  41. Lipsky, B.A.; Polis, A.B.; Lantz, K.C.; Norquist, J.M.; Abramson, M.A. The value of a wound score for diabetic foot infections in predicting treatment outcome: A prospective analysis from the SIDESTEP trial. Wound Repair Regen. 2009, 17, 671–677. [Google Scholar] [CrossRef] [PubMed]
  42. Fautrel, B.; Alten, R.; Kirkham, B.; de la Torre, I.; Durand, F.; Barry, J. Call for action: How to improve use of patient-reported outcomes to guide clinical decision making in rheumatoid arthritis. Rheumatol. Int. 2018, 38, 935–947. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  43. Fletcher, C.; Flight, I.; Gunn, K.; Patterson, P.; Wilson, C. Comparative systematic review of the psychometric properties of measures of illness perceptions in family members of individuals diagnosed with a chronic physical illness. Scand. J. Caring Sci. 2020. [Google Scholar] [CrossRef] [PubMed]
  44. Souza, A.C.; Alexandre, N.M.C.; Guirardello, E.B. Psychometric properties in instruments evaluation of reliability and validity. Epidemiol. Serv. Saude 2017, 26, 649–659. [Google Scholar] [CrossRef]
  45. Ferrill, M.J.; Brown, D.A.; Kyle, J.A. Clinical versus statistical significance: Interpreting P values and confidence intervals related to measures of association to guide decision making. J. Pharm. Pract. 2010, 23, 344–351. [Google Scholar] [CrossRef]
  46. Kimberlin, C.L.; Winterstein, A.G. Validity and reliability of measurement instruments used in research. Am. J. Health Syst. Pharm. 2008, 65, 2276–2284. [Google Scholar] [CrossRef]
  47. Kroenke, K.; Monahan, P.O.; Kean, J. Pragmatic characteristics of patient-reported outcome measures are important for use in clinical practice. J. Clin. Epidemiol. 2015, 68, 1085–1092. [Google Scholar] [CrossRef] [Green Version]
  48. Chen, C.M.; Cano, S.J.; Klassen, A.F.; King, T.; McCarthy, C.; Cordeiro, P.G. Measuring quality of life in oncologic breast surgery: A systematic review of patient-reported outcome measures. Breast J. 2010, 16, 587–597. [Google Scholar] [CrossRef]
  49. Bacteria Culture Test: MedlinePlus Lab Test Information. Available online: https://medlineplus.gov/lab-tests/bacteria-culture-test/ (accessed on 10 March 2020).
  50. Casqueiro, J.; Casqueiro, J.; Alves, C. Infections in patients with diabetes mellitus: A review of pathogenesis. Indian J. Endocrinol. Metab. 2012, 16 (Suppl. S1), S27–S36. [Google Scholar]
  51. Pickwell, K.; Siersma, V.; Kars, M.; Apelqvist, J.; Bakker, K.; Edmonds, M. Predictors of Lower-Extremity Amputation in Patients with an Infected Diabetic Foot Ulcer. Diabetes Care 2015, 38, 852–857. [Google Scholar] [CrossRef] [Green Version]
  52. Lalkhen, A.G.; McCluskey, A. Clinical tests: Sensitivity and specificity. Contin. Educ. Anaesth. Crit. Care Pain 2008, 8, 221–223. [Google Scholar] [CrossRef] [Green Version]
  53. Silva Fuente-Alba, C.; Molina Villagra, M. Likelihood ratio (razón de verosimilitud): Definición y aplicación en Radiología. RAR 2017, 81, 204–208. [Google Scholar] [CrossRef]
  54. Mokkink, L.B.; Terwee, C.B.; Patrick, D.L.; Alonso, J.; Stratford, P.W.; Knol, D.L.; Bouter, L.M.; de Vet, H.C. The COSMIN study reached international consensus on taxonomy, terminology, and definitions of measurement properties for health-related patient-reported outcomes. J. Clin. Epidemiol. 2010, 63, 737–745. [Google Scholar] [CrossRef] [Green Version]
Figure 1. PRISMA Flow Diagram adapted with permission from The PRISMA group, 2020 [10].
Figure 1. PRISMA Flow Diagram adapted with permission from The PRISMA group, 2020 [10].
Jcm 09 01487 g001
Table 1. Clinician assessment tools validated for the assessment of diabetic foot disease (DFD) related variables.
Table 1. Clinician assessment tools validated for the assessment of diabetic foot disease (DFD) related variables.
VariableScaleAUT (Year)TypenSENS (%)SPEC (%)PPV (%)NPV (%)LR+LR−AUC-ROC (%)Gold Standard (GS)Agreement with GSInterIntra
Diabetic Neuropathy assessmentEarly Neuropathy Scale (ENS)Zilliox et al. (2015) [13]_1138397996726.670.170.94 to 0.96Nerve Conduction Studies (NCS), Quantitative Sensory Testing, Sudomotor Axon Reflex, Intraepidermal Nerve Fiber Density.___
Total Neuropathy Score (Clinical)Zilliox et al.
(2015) [13]
_1138197996625,90.20.97 to 0.99Same as above___
Modified Toronto Clinical Neuropathy Scale (mTCNS)Zilliox et al.
(2015) [13]
_1139897999431.20.031Same as above___
Neuropathy Impairment Score in the Lower Limbs (NIS-LL)Zilliox et al.
(2015) [13]
_1138397986926.470.180.94 to 0.96Same as above___
Toronto Clinical Neuropathy Scale (TCNS)Bril et al. (2002) [14]1/289-------Sural Nerve Fiber DensityR2 = 0.256
Neuropathy disability score (NDS)Asad et al. (2010) [15]26092.3147.6276.676.92___NCS___
Diabetic Neuropathy Examination (DNE)Asad et al. (2010) [15]26017.9510010039.62___NCSAccuracy =
46.67%
United Kingdom Screening Test (UKST)Fateh et al. (2016) [16]1/212563.9350__1.280.72_NCS___
Michigan Neuropathy Screening Instrument (MNSI)Fateh et al. (2016) [16]1/212575.2133.3__1.130.74_NCS___
Utah Early Neuropathy Scale (UENS)Singleton et al. (2008) [17]_21592_____0.88NCSr = 0.298
to −0.401
ICC = 0.94
Ulceration risk60-s Inlow’s assessment toolMurphy et al. (2012) [18]_69_______Development of DFU_ICC = 0.83 to 0.93ICC = 0.96 to 1.00
Basic Foot Screening Checklist (BFSC)Bower et al. (2009) [19]2500547782____Modified Royal Perth Hospital Podiatry Department’s neurovascular assessment tool_k = 0.35_
Queensland High Risk Foot Form (QHRFF)Lazzarini et al. (2014) [20]1/2Intra = 19 Inter = 43
SENS PPV = 32
88 to 100_88____Development of DFU k = 1.00k = 1.00
Scottish Foot Ulcer Risk Score (SFURS)Leese et al. (2006) [21]_352684.3 to 95.266.8 to 9029.499.6___Development of DFU __
Diabetic foot ulceration risk checklist (DFURC)Zhou et al. (2018) [22]1/24776275____0.77Development of DFUr = 0.76__
American Diabetes Association System(ADA)Monteiro-Soares et al. (2012) [23]_36490.9 to 10013 to 70.410.3 to 23.498.7 to 1001.1 to 3.10.10.83Development of DFU___
Modified International Working Group on the Diabetic Foot System (IWGDF)Monteiro-Soares etal. (2012) [23]_36487.9 to 10038.4 to 70.713.9 to 2398.3 to 1001.6 to 30.20.86Development of DFU___
University of Texas System (UT)Monteiro-Soares et al. (2012) [23]_36457.6 to 72.765.9 to 84.617.5 to 27.195.2 to 962.1 to 3.70.4 to 0.50.73Development of DFU___
Scottish Intercollegiate Grouping Network System (SIGN)Monteiro-Soares et al. (2012) [23]_3641008.7 to 51.49.9 to 171001.1 to 2.1NC0.75Development of DFU___
Seattle Risk ScoreMonteiro-Soares et al. (2012) [23]_36469.7 to 93.943.8 to 83.414.3 to 29.596.5 to 97.91.7 to 4.20.1 to 0.40.82Development of DFU___
AUT (Year) = authors of the validation study and year of publication; Type = type of diabetes; SENS = sensitivity; SPEC = specificity; PPV = positive predictive value; NPV = negative predictive value; LR+ = positive likelihood ratio; LR− = negative likelihood ratio; AUC-ROC = area under the receiver operator characteristic curve; Gold Standard = gold standard used for external validity; Agreement with GS = degree of external validity with the gold standard; Inter-Rater = inter-rater reliability; Intra-Rater = intra-rater reliability; NC = non-calculable; ICC = Intraclass Correlation Coefficient; k = Cohen’s kappa coefficient.
Table 2. Clinician assessment tools validated for the assessment of diabetic foot ulcer (DFU) related variables.
Table 2. Clinician assessment tools validated for the assessment of diabetic foot ulcer (DFU) related variables.
VariableScaleAUT (Year)TypenSENS (%)SPEC (%)PPV (%)NPV (%)LR+LR−AUC-ROC (%)Gold Standard (GS)Agreement With GSInterIntra
DFU assessment scoring and amputation riskDiabetic Ulcer Severity Score (DUSS)Monteiro-Soares et al. (2014) [24]_13784697281__0.8065Amputation predictionAccuracy = 76%__
Depth, extent of bacterial colonization, phase of healing and associated etiology
(DEPA)
Monteiro-Soares et al. (2014) [24]_13779848381__0.8908Amputation predictionAccuracy = 82%__
Site, Ischemia, Neuropathy, Bacterial Infection, and Depth score (SINBAD)Monteiro-Soares et al. (2014) [24]_13763918872__0.8483Amputation predictionAccuracy = 77%__
Forsythe et al. (2016) [25]1/237_________ICC =
0.91
ICC =
0.44
Wagner’s classificationMonteiro-Soares et al. (2014) [24]_13775949380__0.8921Amputation predictionAccuracy = 85%__
Bravo-Molina et al. (2016) [26]1/2250_________k = 0.55_
Perfusion, extent, depth, infection and sensation scale (PEDIS)Chuan et al. (2015) [27]1/23649382____0.95Healing, unhealing and amputation___
Bravo-Molina et al. (2016) [26]1/2250_________k = 0.574_
Forsythe et al. (2016) [25]1/237_________ICC = 0.80 to 0.90ICC = 0.23 to 0.42
University of Texas classificationArmstrong et al. (1998) [28]_360_______Amputation predictionR2= 143.1 and 91__
Bravo-Molina et al. (2016) [26]1/2250_________k = 0.513_
Forsythe et al. (2016) [25]1/237_________ICC =
0.94
ICC =
0.53
Diabetic Foot Ulcer Assessment Scale (DFUAS)Arisandi et al. (2016) [29]262897186773.110.160.9Total score of BWAT, PUSH and wound surface arear = 0.83 to 0.92ICC = 0.98_
Photographic Wound Assessment Tool (PWAT)Thompson et al. (2013) [30]_68 *_______Bedside assessmentsICC = 0.89ICC = 0.40 to 0.80ICC =
−0.24 to 0.95
Diabetic foot risk assessment
(DIAFORA)
Monteiro-Soares et al. (2016) [31]_29357 to 10053 to 8811 to 5888 to 1002 to 50.03 to 0.50.91Amputation prediction___
DFU healingChronic Lower Extremity Ulcer ScoreBeckert et al. (2009) [32]_2019_______Healing timeKaplan-Meier = 0.45 to 0.83__
Pressure Ulcer Scale for Healing (PUSH)Gardner et al. (2011) [33]_29_______Healing timeR2 = 0.76_
Curative Health
Services system (CHS)
Margolis et al. (2003) [34]_19280____0.48 to 3.84_0.65 to 0.70Wound closure at week 20___
Sepsis, arteriopathy, denervation System (SAD)Parisi et al. (2008) [35]-10587.552.26580___Healing timeAccuracy = 70.2%__
DFU infection assessmentNon healing, exudates, red tissue, debris, smell criteria (NERD)Woo et al. (2009) [36]_112 32 to 6047 to 86_____Microbiological analysis___
Size, temperature, osteomyelitis edema, exudate, smell criteria (STONEES)Woo et al. (2009) [36]_112 37 to 8744 to 89_____Microbiological analysis___
Clinical Signs and Symptom Checklist (CSSC)Gardner et al. (2009) [37]1/2640 to 880 to 91____0.38 to 0.56Microbial load___
Infectious Diseases Society of America classification (IDSA –IWGDF)Lavery et al. (2007) [38]_1666_______Amputation and lower extremity-related hospitalization riskR2 = 108 to 118.6__
AUT (Year) = authors of the validation study and year of publication; Type = type of diabetes; SENS = sensitivity; SPEC = specificity; PPV = positive predictive value; NPV = negative predictive value; LR+ = positive likelihood ratio; LR− = negative likelihood ratio; AUC-ROC = area under the receiver operator characteristic curve; Gold Standard = gold standard used for external validity; Agreement with GS = degree of external validity with the gold standard; Inter-Rater = inter-rater reliability; Intra-Rater = intra-rater reliability; ICC = Intraclass Correlation Coefficient; k = Cohen’s kappa coefficient. * venous/arterial leg wounds (n = 13), diabetic foot wounds (n = 18), pressure ulcers (n = 32), and wounds of other etiologies (n = 5).
Table 3. Clinician assessment tools validated for the assessment of DFD and DFU related variables according to consensus-based standards for the selection of health measurement instruments (COSMIN) guidelines.
Table 3. Clinician assessment tools validated for the assessment of DFD and DFU related variables according to consensus-based standards for the selection of health measurement instruments (COSMIN) guidelines.
ReliabilityValidityResponsiveness
Internal Consistency ICCSEMContent ValidityConstruct ValidityCriterion Validity
VariableScaleAut (Year)TypenInterIntraInterIntraConcurrentPredictive
Diabetic neuropathy assessment *Toronto Clinical Neuropathy Score(TCNS)Bril et al. (2009) [39]1/2650.760.83k = 0.62 to 1.00 _______
Modified Toronto Clinical Neuropathy Score (mTCNS)0.780.87k = 0.54 to 0.73 ___R = −0.45 to 0.82___
DFU measurement **Leg Ulcer Measurement Tool (LUMT)Woodbury et al. (2004) [40]_22_0.77 and 0.890.963.3 and 4.82.0_R = 0.43 and 0.82R = 0.82_0.84
DFU assessment, scoring and amputation risk **Diabetic foot ulcer assessment scale (DFUAS)Arisandi et al. (2016) [29]_66_0.98___DoneP < 0.001R = 0.83 to 0.92SENS =
89% SPEC =
71% PPV = 86% NPV = 77%
_
DFU infection assessment **Diabetic Foot Infection Wound Score (DFIWS)Lipsky et al. (2009) [41]_3710.70 to 0.95_____R = 0.21 and 0.27___
AUT (YEAR) = authors of the validation study and year of publication; TYPE = type of diabetes; ICC = Intraclass Correlation Coefficient; SEM = Standard Error Measurement. * = DFD related variables; ** = DFU related variables, k = Cohen’s kappa coefficient.

Share and Cite

MDPI and ACS Style

Fernández-Torres, R.; Ruiz-Muñoz, M.; Pérez-Panero, A.J.; García-Romero, J.C.; Gónzalez-Sánchez, M. Clinician Assessment Tools for Patients with Diabetic Foot Disease: A Systematic Review. J. Clin. Med. 2020, 9, 1487. https://doi.org/10.3390/jcm9051487

AMA Style

Fernández-Torres R, Ruiz-Muñoz M, Pérez-Panero AJ, García-Romero JC, Gónzalez-Sánchez M. Clinician Assessment Tools for Patients with Diabetic Foot Disease: A Systematic Review. Journal of Clinical Medicine. 2020; 9(5):1487. https://doi.org/10.3390/jcm9051487

Chicago/Turabian Style

Fernández-Torres, Raúl, María Ruiz-Muñoz, Alberto J. Pérez-Panero, Jerónimo C. García-Romero, and Manuel Gónzalez-Sánchez. 2020. "Clinician Assessment Tools for Patients with Diabetic Foot Disease: A Systematic Review" Journal of Clinical Medicine 9, no. 5: 1487. https://doi.org/10.3390/jcm9051487

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop