Introduction
Orthoses are external supportive devices that are worn to reduce pain and enhance the function of patients with disorders of the neuromuscular and/or musculoskeletal systems. The most common types of orthoses are hand splints, spinal bracing, in-shoe foot orthoses (FO), and ankle-foot orthoses (AFO). FOs are used to support and accommodate the foot to avoid or correct foot deformities, help to maintain uniform body weight distribution and improve foot function as well as reduce pain. AFOs aim to regulate the movement of the ankle, compensate for weakness, heel misalignment and control deformities. AFOs are also used to improve toe clearance, maintain a neutral position and resist contracted muscles of the ankle and foot during gait.
Traditional manufacturing of foot and ankle orthoses is cumbersome and involves labour intensive manual production methods [
1]. Fabrication of FOs involves first forming the negative impression, such as pressing the plantar surface of the foot into a foam box or draping the foot using plaster of Paris. The negative impression is filled with plaster to generate the positive model and manually modified by the clinician. After placing the positive model on the vacuum table, it is wrapped with heated thermoplastic sheet and moulded to the geometry of the model by applying a vacuum. Similarly, AFOs are generally hand made from plaster casting the patient’s lower leg. The negative cast is filled with fluid plaster of Paris to form a positive model, which is modified manually by adding or removing plaster. This modified positive is then vacuum formed with polypropylene to produce an AFO [
2,
3]. These traditional methods of capturing foot and ankle morphology can be highly resource intensive, especially for fabricating AFOs, requiring dedicated infrastructure including a casting room, plaster friendly furniture, sink with plaster capture, and anti-slip floor. For departments or practices that have only one casting room and several clinicians, room availability can present logistical difficulties and increased patient wait-times. In addition, storage of consumables, such as foam impression boxes and plaster rolls, requires a dry area that can occupy a large space. Positive plaster casts are heavy and need to be handled carefully to prevent breakage that would require recasting the patient. After fabricating either FOs or AFOs, the positive cast is destroyed to provide storage space for new casts, which prevents duplication of the same prescription from an old cast. Although casting for FOs may not require the same level of resourcing as AFOs, the process is still highly dependent on practitioner experience of positioning and manipulating the foot and/or ankle [
4]. Overall, these traditional methods are labour intensive, restrict design choices, and require high level of skill and dedicated infrastructure that can increase costs and patient wait times [
5,
6].
Digital approaches are emerging as alternative plaster-less fabrication methods, which have the potential to reduce long lead times, material wastage, and cost [
5,
7]. Digital fabrication requires the input of foot and ankle morphology, which can be obtained by 3D scanning the foot and ankle directly or by scanning a negative impression. The digitised data can be used to create a 3D model of the patient and/or their device [
8]. Computer Aided Design (CAD) software is used to process the 3D scan, where adjustments can be made to the geometry [
9]. The resulting 3D model of the modified positive model or final orthotic design can then be exported to either a milling machine or a 3D printer [
10,
11].
Recently, 3D scanners have been developed to improve the production of orthoses and prostheses [
12,
13]. Using 3D scanning provides clinicians with flexibility as to where they are taking impressions (e.g. on ward or in fitting rooms or in the community). 3D scanning technology would also minimise plaster storage requirements and enable exact duplication of a prescription. In a digital fabrication workflow, the accurate and reliable input of a patient’s lower leg morphology is critical for an appropriately fitting device. However, commercially available scanners have varying speed, accuracy and reliability that need to be investigated. Therefore, the aim of this systematic review was to compare the speed, accuracy and reliability of 3D scanning with traditional methods of capturing foot and ankle morphology for fabricating orthoses.
Methods and materials
Systematic literature search
We followed the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) checklist to conduct the systematic review [
14]. The search strategy focused on terms comparing 3D scanning with other traditional morphology capture methods of the foot and/or ankle. The focus was to cover all possible methods for capturing the morphology of the foot and ankle. For example, plaster casting and foam impression boxes could be used to capture the foot and ankle to produce AFOs, FOs or footwear.
Search terms related to the 3D scanning (3D scan*, Photogrammetry, Laser scan*, Structured Light scan*, Three dimensional scan*, (3D digitalization or 3D digitalisation), Three-dimensional construction, 3D surface scan*, 3D laser scan*, 3D structured light scan*, scan*) combined with AND to search terms related to foot and/or ankle (ankle, foot, Foot morphology, (ankle and foot), ankle morphology, foot parameter*, ankle parameter*) also combined with AND to search terms related to foot and ankle capturing methods other than 3D scanning (Plaster cast*, foam impression, polyurethane resin, (fiber* cast* or fibre* cast*), (orthopedic cast* or orthopaedic cast*), cast*, (Plaster Mold* or plaster Mould), (mold* or mould), Hand cast*, (cast* adj4 ankle), (cast* adj4 foot), fiberglass cast*, cast* socks, negative impression, positive impression, foot trace*, foot print*, footprint). Electronic database searches were carried out in ProQuest Central, MEDLINE (via OvidSP), EMBASE, Scopus, AMED (via OvidSP), Web of Science and CINAHL (via EBSCO). The search keywords were designed for MEDLINE and adapted for other databases. No restrictions were added to the search, such as language or date (Additional file
1).
Eligibility criteria
All studies comparing 3D scanning to other foot and/or ankle capture methods were eligible for review and were included regardless of date of article publication, language, participant age or demographics. Reviews, conference reports and newspaper articles were excluded, as these are rarely peer-reviewed and may only present preliminary or limited data.
Study selection and data extraction
After deletion of duplicates, the titles and abstracts of included studies were assessed and screened by authors M.F. and Z.W. based on eligibility criteria in the first pass. Following this, the full-text articles were retrieved by the researchers to assess eligibility for inclusion independently (second pass). In case of disagreement, author J.B. was asked to evaluate the article and all discrepancies were resolved. The included articles underwent data extraction by authors M.F. and Z.W. independently who then compared the extractions for accuracy and completeness. Extraction of data comprised of study design, sample size, demographic characteristics, information about the 3D scanner and scanning methods, and comparative foot/ankle capture techniques.
Study outcomes of time, accuracy and reliability were extracted. For the purposes of this review, we considered speed as the time required to obtain the foot and/or ankle morphology, accuracy as the relationship between the scanned measurements to the patient’s clinical measurements, and reliability as the consistency and repeatability of the capture method. The reported ICCs were classified as poor (less than 0.50), moderate (between 0.50 to 0.75), good (between 0.75 to 0.90) or excellent (greater than 0.90) [
15].
Study quality
The evidence level of each study was assessed using the Oxford Centre for Evidence-Based Medicine 2011 Levels of Evidence (OCEBM Levels) rating from level one to level five, where level one representing a randomised controlled design and highest level of evidence [
16]. The methodological and quality of the assessment measures reported in the included studies were rated using version one of the Consensus-Based Standards for the Selection of Health measurement Instrument (COSMIN) [
17‐
19]. The reported instruments were assessed using three measurement properties from the COSMIN checklist: content validity, reliability and measurement error [
20]. These three items from the COSMIN checklist were used as they were the most relevant to the aims of this review. COSMIN is the gold standard for patient reported outcome measurement evaluation, however more recently it has been applied to clinician-rated assessments [
17,
20,
21]. Studies that evaluated or reported the efficacy of an intervention were assessed using the Grading of Recommendations Assessment, Development, and Evaluation (GRADE) approach [
22] utilising GRADEpro GDT. The GRADE approach was used to assess the strength and certainty of the overall evidence reported in the included studies in this review.
We attempted meta-analysis on pooled measurements of foot parameters collected from 3D scanning and traditional methods. Three studies [
23‐
25] provided raw measurements for parameters of the foot such as arch height, rearfoot width and forefoot width. However, due to heterogeneity in data capture methods we were unable to conduct the meta-analysis (Additional file
2).
Discussion
In this systematic review of the literature, we identified six articles that compared 3D scanning with traditional methods of capturing morphology of the foot and/or ankle. There was moderate level evidence that 3D scanning requires less time to capture the foot and ankle when compared to traditional methods, especially for clinicians experienced in 3D scanning [
26,
28]. The accuracy of 3D scanning for FOs was generally comparable with plaster casts, digital footprints and ink footprints to capture foot morphology [
23,
25]. Head-to-head, 3D scanning was generally comparable in inter-rater reliability with plaster casting and foam impression as several foot parameters achieved excellent ICCs [
23,
27]. The intra-rater reliability of 3D scanning and traditional methods was comparable with ICCs ranging between poor and excellent, however some aspects of the foot were more reliably captured than others. However, none of the included studies investigated accuracy or reliability of 3D scanning for AFOs which requires capturing lower leg, ankle as well as foot morphology. According to GRADE and COSMIN quality assessments, no study rated higher than moderate (Table
2) or adequate at best (Additional file
3) with most studies were assessed as inadequate or doubtful. Thus, there is insufficient evidence to support a clinical recommendation for the use of 3D scanning to capture the morphology of the foot and ankle (Table
5).
Table 6
Time required to cast or 3D scan the foot and/or ankle
| Cast time (AFO) | 3D Scan time (AFO) | p-value |
All user | Experienced user only | All user | Experienced user only |
Roberts A, et al. 2016 [ 26] | 12.2 (SD 4.9) min | | 11.1 (SD 9.5) min | | P = 0.056 |
| 13.1 (SD 4.4) min | | 8.9 (SD 2.9) min | P < 0.001 |
| Cast time (FO) | 3D Scan time (FO) | p-value |
Student | Clinician | Student | Clinician |
| 16 min | 11 min | | 2 min | |
Two studies identified in this review reported the time required to 3D scan the foot and ankle, which is important when considering integration of digital processes into clinical workflows. Focusing on the scanning process, a study by Dessery and Pallari found that a low-cost 3D scanner (£289) was faster than a high-cost handheld scanner (£13,700) when capturing the knee for fabricating knee orthoses [
30]. However, the Dessery and Pallari study did not compare the time taken for 3D scanning with a traditional method. When considering the entire orthotic device production workflow, one of the articles in our review, reported that 3D scanning in combination with CAM produced comparable devices as traditional methods in similar time frames [
26]. More recent studies have supported these findings suggesting that additive manufacturing methods are as effective as traditional methods for producing AFOs when considering time, cost and device performance [
5,
31,
32]. While some evidence suggests 3D scanning may be faster than traditional methods of morphology capture, it is crucial that this does not sacrifice accuracy or reliability.
With regard to reliability of capturing foot parameters, our review found that some foot parameters, such as length and forefoot width, were reliably captured regardless of the method used. Foot arch height was the least reliable foot parameter captured by any method. This could be due to the flexibility of the arch, which makes it difficult to hold in a consistent position when casting or scanning. Laughton et al., found that foot measurements were significantly influenced by the method used to obtain foot shape [
23]. Similarly, Guldemond et al., compared FOs produced by plaster cast to foam impression box and observed that each method resulted in different pressure pattern and contact area [
33]. Variability within capture position is significant as comfort, fitness, kinematic and kinetic function of the resulting orthotic device may be affected [
34]. Too much variability in the 3D scanning process makes the correction of the deformity completely dependent on the rectification process, with several studies highlighting that this is a pinch point in the clinical workflow [
26,
35,
36].
The experience of the clinician affected the reliability of the 3D scan in three of the included studies [
24,
26,
27], and was related to reducing 3D scanning time and variability in all foot parameters. Therefore, user training and support is critical for successful implementation of 3D scanning processes in a clinical environment [
37]. Roberts et al., found that clinicians inexperienced in 3D scanning had the most AFO fitting problems [
26]. This is supported by Wong et al., who reported that clinicians who are familiar with CAD/CAM systems were faster and less likely to have fitting issues [
35]. However, the learning curve for an orthotist to reach competence with a CAD/CAM system could be up to 4 years [
36]. Despite improvements in reliability and speed with experienced users, it is unclear how much experience in 3D scanning is needed to produce quality scans and how quickly this is gained. Thus, continuous assessment of scanning accuracy and reliability as well as the regular evaluation of newly available technologies are recommended.
Our review only included studies that involved the foot and ankle. Inclusion of additional regions of the body may have resulted in higher article return in our search, however these were not relevant to our research question. We also did not assess the final orthotic device that was produced by either 3D scanning or traditional methods. However, other studies assessing AFOs [
38], FOs [
39,
40] and scoliosis braces [
35,
36,
41,
42] found comparability between 3D scanning with those manufactured traditionally in terms of fitting and device performance. Most of the studies included in this review focused on the production of FOs for healthy adult participants, which does not account for deformities (such as the need to apply corrections during scanning). Only one study in our review investigated 3D scanning in children that were prescribed AFOs. The use of 3D scanning in children can be more difficult to manage considering adherence to instructions. Thus, there is a need for more high-quality studies that examine 3D scanning for AFOs for both paediatric and adult patients with pathology. In addition, there is a growing market for commercially available 3D scanners. Our review included laser 3D scanners, however there are many more models available. Therefore, as technology improves a continual assessment of the optimum 3D scanning method and technique in terms of speed, accuracy and reliability during scanning needs to be investigated.
Conclusion
Studies comparing the speed, accuracy and reliability of 3D scanning with traditional methods of capturing the morphology of the foot and/or ankle are small and of generally low quality. With this limited evidence, 3D scanning was found to be faster than plaster casting for capturing the foot and ankle, especially for those experienced in 3D scanning. In the context of FOs, 3D scanning the foot is comparable in accuracy and reliability with traditional methods. However, this review found no evidence for the reliability or accuracy of scanning the foot and ankle for the fabrication of AFOs, an area ripe for future research.
Open AccessThis article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit
http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (
http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.
Publisher’s Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.