Abstract
Accurate and reliable foot measurements at different stances offer comprehensive geometrical information on foot, thus enabling a more comfortable insole/footwear for practical use and daily activities. However, there lacks investigations on continuous deformation of foot shape during the roll-over process. This study analyses the foot deformation of 19 female diabetic patients during half weight bearing standing and self-selected walking speed by using a novel 4D foot scanning system. The scanning system has good repeatability and accuracy in both static and dynamic scanning situations. Point cloud registration for scanned image reorientation and algorithms to automatically extract foot measurements is developed. During the foot roll-over process, maximum deformation of length and girth dimensions are found at first toe contact. Width dimensions have maximum deformation at heel take off. The findings provide a new understanding of foot shape changes in dynamic situations, thus providing an optimal solution for foot comfort, function and protection.
Similar content being viewed by others
Introduction
Accurate foot measurements are important to enable footwear and insole fit and comfort. The foot shape in the half weight bearing (HWB) condition provides an important reference source for customised insole designs1,2, while the subtalar joint in the neutral position is widely used for foot orthoses in clinical casting3. Undoubtedly, the foot shape changes with different loads in standing and walking conditions4,5,6. It is widely accepted the footwear should match with the foot shape for optimal fit and wear comfort7. However, the lack of dynamic foot information has compelled designers to consider dynamic foot deformation information based on their own assumptions and experience when designing shoe lasts8. Based on self-reported through interview and surveys, foot ulcers are frequently caused by new shoes, friction caused by footwear materials, and inappropriate fit9.
Nevertheless, little research has been conducted on the changes in foot shape with motion10,11,12,13,14,15,16 due to the high cost of dynamic scanning systems. The dynamic foot scanning system proposed in Coudert et al.15 consists of six cameras that work in a synchronised manner. However, socks must be worn or else the surface of the feet must be painted with ink to solve the problem of lack of texture, which is undesirable in a clinical setting. A technique for taking the cross-sectional (ball, instep, and heel) measurements of the foot during walking was proposed in Kimura et al.17. Multi-view stereo matching was used to capture the dorsal surface of the foot. The scanning system was then upgraded so that a camera and an LCD projector could be used to reduce noise and simplify the detection process of the corresponding points13. Vidmar et al.12 also developed a 4D foot scanning prototype by using commodity hardware and RGB-D cameras to make the 4D scanning more accessible, with the use of active stereoscopic vision technology. A novel structured-light prototype system was proposed in Thabet et al.14, in which a video sequence of the foot during a single step is inputted, and resulted in the output of a 3D reconstructed plantar of the foot that corresponds with the inputted information. However, these systems either have a low sample rate of 14–15 Hz only12,16 and deliver poor image quality due to limited number of cameras, or can only scan the geometry of the dorsal or plantar surface14,15. This study analyses the deformation of the diabetic foot during motion by using a 4D measurement method (3dMD LLC, Atlanta, GA) to capture dense surface images in static conditions and dynamic shapes during motion with sparse landmarks. The method can capture 360-degree full foot images at a sampling rate of 40 Hz.
In addition to scanning technology, the post-processing of scanned images has a major influence on the image quality and further analysis of the data related to the feet. However, due to the problems with 3D scanning such as scanning angle (cannot measure surface that is beyond the line of sight of the scanner), and differences between object size and scanning distance18, the traditional manual registration and measurement process is time-consuming and prone to errors. The use of different scanning systems has however resulted in a large volume of point clouds, so algorithms have been developed for point cloud registration to increase the data processing efficiency and accuracy in previous studies18,19,20,21,22. Point cloud registration has been widely used in many computer vision tasks, like 3D reconstruction23,24, object detection25, pose and motion estimation26,27,28, autonomous driving29,30, robotic manipulation31, medical imaging32,33,34, etc. It is an important step to merge multiple data sets into a globally unified model, or map an unknown data set onto a known data set to identify its features or estimate its pose.
Besl and Mckay20 described a well-known method for point cloud registration based on the iterative closest point (ICP) algorithm. This algorithm repeatedly selects the corresponding pairs of points between the target and source point clouds, then calculates the optimal translation, rotation, and scaling up or down, and finds the transformation parameters between the corresponding pairs of points by using the least squares method. This process is repeated until there is an optimal match between the two sets of point clouds to meet various metric criteria, like the root-mean-square error (RSME)35. Another robust probabilistic method for point cloud registration based on a coherent point drift (CPD) algorithm was introduced by Myronenko and Song22,36. The CPD algorithm is used to consider the alignment of two point sets as a probability density estimation problem22,37, where the probability value of 1/0 represents the true/false correspondence respectively, and a larger probability refers to greater certainty of the correspondence. Given that there are two point sets M and S, they represent the distribution of M as a Gaussian Mixture Model (GMM), where the corresponding likelihood function peaks when M is fully aligned with S. In this study, the CPD algorithm is used for registering foot images to a standard coordinate for measurement purposes, and then the key foot measurements related to the shoe/insole design are extracted automatically.
Therefore, the primary aims of this study are:
-
(1)
To validate the repeatability and accuracy of the 3dMD foot scanning system,
-
(2)
To explore a suitable approach for foot image reorientation based on point cloud registration so that key foot measurements can be automatically extracted, and
-
(3)
To analyse foot roll-over shapes for patients with diabetes.
Methodology
Dynamic foot scanning system
The 3dMD foot scanning system (3dMD LLC, AG, USA) is also known as a 4D foot scanning system, which has the additional dimension of time as opposed to the three dimensions of 3D scanning systems. The system contains 10 machine vision cameras, including dedicated cameras (green circle labelled in Fig. 1) that capture the plantar of the foot with projection through glass or customised speckle patterns. The speckle patterns enable the accurate reconstruction of the foot shape when in contact with the glass (length * width: 42 * 19 cm). They provide a 360-degree geometric shape of the entire foot for both the surface of the dorsal and plantar of the foot with articulation and movement during locomotion, and a progressive sequence of 3D foot images (40 fps) over a period of time can be recorded, which enables the operator to select the optimal frame in real time for immediate analysis or render the entire image sequence for further evaluation and use. The system rendering engine incorporates information from all camera viewpoints per frame so there is no manual stitching required. The accuracy of the 3D foot images from this system can reach 0.7 mm or higher. A 100% LED lighting environment also ensures the safety and comfort of the subjects during longer scanning sessions.
System validation
Accuracy and repeatability are two important indicators of the robustness of measurements in measuring systems. According to ISO 5725-1:1994, accuracy is the degree of agreement between the test result and the true or accepted reference value. Precision is defined as the degree of agreement between test results obtained under the same stipulated conditions38. Good repeatability can ensure as few errors as possible that are caused by measuring systems randomly. Therefore, a reliable measurement system should have both good repeatability and the ability to provide accurate measurements.
In this study, the repeatability of the 3dMD foot scanning system is examined through repeated scanning of the same object under the same conditions. The accuracy is examined by comparing the difference in the measurements of the same object between the system and a market-available scanner with a relatively high degree of accuracy. To prevent unavoidable subjective errors caused by soft tissue deformation and body sway, a rigid foot model (see Fig. 2) and a rigid ball (ping pong ball) with a circumference of 40 mm are used to assess the measurement performance of the system in static and dynamic situations respectively.
Repeatability test
Repeatability is defined as the level of consistency between measurements of the same object taken under the same scanning conditions by using the system. The foot model and ball were therefore scanned three times by the same operator under the same scanning conditions to assess the repeatability of the system. The foot model was scanned with a self-weight bearing at 2 different views (the angle of the two views is 180°) respectively, see Fig. 3. The rigid ball was also scanned when rolling through the platform from two different directions (the angle of the two directions is 180°). The rolling speed is 1.4 m/s39, which is close to the average walking pace of humans. The system was switched off and on between each scan.
The raw scanned data of the foot model and ball were processed by using Geomagic Design X software to create meshes. These meshes were randomly selected and superimposed to calculate the mesh deviations of various pairs for repeatability assessments: (1) among the meshes scanned in the same view/direction, and (2) among the meshes scanned in a different view/direction. The accumulated areas (in % of the total mesh area) of the mesh deviations between each pair were calculated at 0.1 mm increments40,41. The mesh deviation is the difference between the scanned images created by the system.
Accuracy test
Generally, accuracy is defined as the proximity of a measurement to its true or tolerant value. In this study, the 4D foot scanning system is compared with the EinScan Pro handheld 3D scanner (SHINING 3D®) with a foot station1, see Fig. 4. This scanner can process up to 3,000,000 points per second under the handheld scan mode. The handheld scanner shows a similar resolution and accuracy as the fixed scanner by using a minimum point distance setting of 0.2 mm. The accuracy of the scanned foot data with the use of this scanner is up to ± 0.5 mm. Both surface of the dorsal and plantar of the foot can be scanned simultaneously by using the foot station.
A rigid foot model was scanned three times by the same operator who is well trained to use both the handheld scanner and 4D foot scanning system. Scanned images from both scanners were randomly selected and compared by using Geomagic, and the accumulated areas (in % of the total mesh area) of the mesh deviations were calculated at 0.1 mm increments between the selected pair. The mesh deviation is the measurement error between scans created by the two scanners. In addition, the circumference of scans of the ball from the 4D foot scanning system was measured 5 times to obtain the mean value for comparison with the original circumference of the ball so as to validate the accuracy of the system in a dynamic condition.
Foot scanning and measurements in standing and walking conditions
Experiment
A total of 19 female subjects between 57 and 75 years old (mean: 66, SD: 5) participated in the study. The height, weight and BMI (body mass index) of the involved subjects are 152.0–166.0 cm (mean: 157.6, SD: 4.3), 42.0–72.0 kg (mean: 55.2, SD: 7.3) and 18.2–30.8 kg/m2 (mean: 22.3, SD: 3.2) respectively. The dominant foot, which is determined to be the foot that kicks a ball habitually42, was scanned 3 times during stance with HWB and self-selected walking speed conditions respectively by using the 4D foot scanning system, see Fig. 5. The subjects have Type 1 or 2 diabetes mellitus (DM) in the early stages (self-reported with a diagnosis from a clinical physician) and the inclusion criteria43,44 are those with no history of ulcers or neurological disorders (except neuropathy), and able to walk a length of 20 m repeatedly without a walking aid. Subjects who show the presence of active foot ulcers were excluded45. This study was reviewed and approved by the Human Subjects Ethics Sub-committee of The Hong Kong Polytechnic University (Reference Number: HSEARS20200128001). All methods were performed in accordance with the relevant guidelines and regulations. Information on the experimental requirements were provided to all of the participants and written informed consent was obtained from all the participants before the experiment commenced.
Foot anthropometric measurements
Thirteen key foot anthropometric measurements were extracted for an in-depth analysis of the foot deformation, including length: foot length (FL), medial ball length (MBL), lateral ball length (LBL); width: anatomical ball width (ABW), orthogonal ball width (OBW), and orthogonal heel width (OHW); height: ball height (BH), instep height (IH); girth: anatomical ball girth (ABG), and instep girth (IG); and angle: ball angle (BA), toe1 angle (T1A), and toe5 angle (T5A)5,6. According to the foot roll-over pattern defined by Blanc et al.46 and Barisch-Fritz et al.5, five representative frames at first heel, MTH contact, and toe contact, and heel and MTH take off respectively were selected from the plantar perspective of the complete roll-over process, and their corresponding foot measurements, see Fig. 6.
Point cloud registration and automatic foot measurements
Instead of processing the scanned images and taking foot measurements manually by using Geomagic, new approaches of point cloud reorientation for 3D foot image registration and automated measurement are proposed, to improve the efficiency of foot image analysis and measurement.
Point cloud filtering
Raw data obtained from 3D scanners is often corrupted with noise and outliers47. These errors can reduce the accuracy of the point cloud representation and post-processing, thus causing issues in determining the local point cloud features (e.g., normal vectors or curvature rate of change at sampled points), which can lead to incorrect values and then errors in point cloud alignment, data measurement, and other post-processing tasks. Therefore, the first step of scanned image processing is 3D point cloud filtering, which is used to remove the noise and outliers48,49. A large number of variant filters have been proposed for different types of surfaces and noise models48,49, including the Statistical Outlier Removal filter50,51, Bilateral filter52,53, Radius Outlier Removal54, and Voxel Grid filter55, etc. However, none of these methods are appropriate as they require an iterative trial-and-error process to choose the algorithm and the parameters based on the scanned surface and noise characteristics.
In this study, the noise and outliers of the foot images are removed by using Statistical Outlier Removal (Sor) filter before registration. This is carried out by calculating the neighbours of each point. The sparse outliers that do not meet the criteria are trimmed. For each point pi (i = 1,…, n) in the input dataset, the mean distance di from pi to all its neighbours are calculated, see Eqs. (1) and (2). The result is assumed to be a Gaussian distribution with mean and standard deviations. The points that are not within a σ standard deviation from the mean distance are defined as outliers and removed from the dataset48, which means if di > dmean + 1*σ, then pi is removed. Figure 7 shows an example of data comparison before and after filtering.
Point cloud registration
After filtering, the 3D image should be re-aligned to a standard position based on local system to take the foot measurements40,56, see Fig. 8. First, the coordinate of the point set—first toe contact frame, was manually aligned to the standard position as the target point set. Then the other point sets were aligned to the target point set respectively by finding the points that correspond to each other. In this study, the alignment between the target and other point sets is regarded as a density estimation problem based on the CPD method.
The target and other point sets are the two 3D point sets in this study: MJ×3 = (m1, m2, …, mJ)T and SK×3 = (s1, s2, …, sK)T, where J and K are the number of points in the two point sets respectively. The points in the target point set M were generated by using the GMM. The other point set S as the GMM centroids need to fit M by maximising the probability of GMM centroids S to generate M. This is to force S (GMM centroids) to move coherently as a group to preserve the topological structure of the point set22.
In this study, good approximation to the distance function between S and M is developed based on the CPD algorithm57. The problem of point set registration is regarded as distance function optimization, which is to minimize the errors to find the best space transformation between the point sets. An example of a 3D image registration result is shown in Fig. 9.
Automated extraction of foot measurement
Using image registration, all five selected frames were reoriented to a standard coordinate. According to the definition of each foot measurement6, the key anatomical points (P1–P10) were first extracted from each frame automatically. A total of thirteen foot measurements were taken, by using Eqs. (3) - (13) (Fig. 10). Also, the automated foot measurements based on 5 subjects were compared with manual measurements to examine the consistency of the two methods.
The key points (P1-P10) extracted from the foot images include: P1 and P10 which are the maximum and minimum Y values along the Y-axis. The foot outline projection in the X-Y plane (Fig. 11) consists of bumps extracted by using the Graham algorithm58. P2 is the point with the maximum absolute X value when the Y value are between P1 and P4. P3 is the point with the maximum absolute X value when the Y value is between P1 and P5.
P4 and P5 are the points with the maximum and minimum X values along the X-axis.
P6 and P7 are the points with the maximum Z values along the Z-axis when the Y values are 0.5 and 0.618 in the FL respectively.
P8 and P9 are the points with the maximum and minimum X values along the X-axis with a 14–20% FL.
The FL, MBL and LBL are the distance between the pternion P10 and P1, P4, P5 respectively along the X-axis.
The ABW is the distance between P4 and P5; OBW is the distance between P4 and P5 projected onto the X-axis and OHW is the distance between P8 and P9 projected onto the X-axis.
The BH and IH are the distance of P6 (61.8% of FL) and P7 (50% of FL) to the X-Y plane along the Z-axis, respectively.
The BA is the angle between lines \(P4P5\) and \(P4P8\); T1A is the angle between \(P2P4\) and \(P4P8\); and T5A is the angle between \(P3P5\) and \(P5P9\).
The ABG is the circumference that passes through P4 and P5 along the Z-axis, and the IG is the circumference that passes through P6 along the Z-axis. As shown in Eq. (14), Pi is the point at the cross sections (ABG, IG), and N is the number of points.
Data analysis
All of the foot measurements were analysed by using SPSS Statistics 21 software (IBM Corp., Armonk, NY, USA). A Shapiro-Wilk test was used to examine the normality of the 13 foot measurements. The results showed that all of the foot measurements are normally distributed (P > 0.05) in the different conditions. Intraclass correlation coefficients (ICCs) were used to determine the consistency of the automatic and manual measurement methods. A paired sample t-test was used to determine the significance between foot measurements during walking and in the stance condition with HWB. The significance level of the statistical analysis was set at 0.05.
Results
Repeatability of 3dMD foot scanning system
To evaluate the repeatability of the system, the 3D images of the foot model and ball were paired and selected randomly from 2 different scanning views/directions. Two randomly selected images were aligned using global and automatic alignment methods successively in Geomagic. Details of the pairs and results of the mesh deviations are listed in Table 1.
For the static scanning of the foot model, 98.83% of the areas of overlap between randomly selected images from View 1 has a deviation less than ± 0.5 mm, and 99.84% within ± 1 mm. Pairs in View 2 showed similar results; the overlapping areas between the meshes is 98.86% with a deviation less than ± 0.5 mm, and 99.80% within ± 1 mm. The overlapping areas of images randomly selected from Views 1 and 2 are up to 96.08% with a deviation less than ± 0.5 mm, and 99.56% within ± 1 mm.
For the dynamic scanning of the ball, 98.94% of the overlapping area between randomly selected images from Direction 1 has a mesh deviation less than ± 0.5 mm, and 99.95% within ± 1 mm. Pairs from Direction 2 showed similar results. The overlapping areas between the meshes is 98.46% with a deviation less than ± 0.5 mm, and 99.95% within ± 1 mm. The overlapping areas of images randomly selected from 2 different directions up to 98.92% with a deviation less than ± 0.5 mm, and 100% within ± 1 mm.
Accuracy of 3dMD foot scanning system
Meshes of the foot model from the 4D foot scanning system and EinScan Pro handheld 3D scanner were compared to examine the accuracy of the system under a static situation. It was found that 96.66% of the mesh overlapped between images randomly selected from the 2 scanners with a deviation less than ± 1 mm, see Fig. 12. For the accuracy validation of dynamic scanning, the circumference of ball scans randomly selected from 2 directions were measured 5 times by using Geomagic. The mean value of their measured circumference is over 99%, quite close to the original value of 40 mm.
Comparison of foot measurements between automatic and manual methods
In this study, a total of 13 foot measurements of 5 subjects have been measured by using automatic and manual measurement methods respectively. ICC analysis was used to check the consistency of the foot measurements measured with the automatic and manual methods. In Table 2, the ICC value of each foot measurement is higher than 0.8 (P < 0.001), which indicates that the automated foot measurement shows a good agreement with the manual measurement.
Foot measurements of diabetic patients
Participant information
The description statistics of the 19 female diabetic participants are listed in the Table 3, including age, weight, height, body mass index (BMI), foot size and years of diagnosis.
Comparison of foot measurements: dynamic vs. static conditions
The maximum (MaxDyn) and minimum (MinDyn) values of each foot measurement during dynamic walking were extracted to analyse the changes of each foot measurement during whole ground contact. In addition, the MinDyn and MaxDyn of the foot measurements were compared with those of HWB standing through a paired sample t-test respectively, see Table 4.
As shown in Table 4, when the MaxDyn and MinDyn are compared, the measured foot values significantly increase from 1.2 to 28.4% in dynamic situations. From the first heel contact to MTH take off, the foot dimension changes are continuously measured and compared with MinDyn. Major increases in foot length and girth are found at the stance of first toe contact, while its dimension change in foot height is minimal. The highest increment in foot width is found at heel take off stance, see Fig. 13.
Then the MaxDyn and MinDyn are also compared with HWB standing respectively. The measured foot values significantly increase 0.5–35.7% from HWB to MaxDyn with the exception of orthogonal ball width and ball angle. While no significant differences are found with each foot measurement between MinDyn and HWB, except for ball width.
Discussion
Scanning performance of 3dMD foot scanning system
As shown in Table 1, the repeatability of randomly selected images from the same scanned views is similar (98% within ± 0.5 mm) in both static and dynamic scanning situations, which indicates that this system shows high repeatability from the same scanning views. The overlapping area from different static scanning views is slightly less than that from the same view, which might be attributed to the fact that View 2 is specialized for left foot scanning with the current equipment setting. The foot model is not a homogeneous object and therefore the repeatability of the scanned images in the two different views is slightly lower compared to that of the scanned images from the same view. For the homogeneous ball, the repeatability of images from 2 different directions does not have this problem. The repeatability of the 4D foot scanning system excels that of 4D foot reconstruction system (4DFRS), which is a dynamic foot reconstruction system developed by Thabet et al.59, and has proven reconstruction differences that average 2.44 mm and 2.81 mm in static and dynamic situations respectively.
In addition, Fig. 12 indicates that the accuracy of the system is similar as that of the handheld scanner with static scanning. However, meshes overlap less within a stricter deviation, but still meet the foot measurement tolerance in footwear manufacturing60. For dynamic scanning, the measurement of scans is well close to the original value. The accuracy of this system is higher than the dynamic foot scanning system proposed in Novak et al.61, the accuracy of which can achieve a scanning height and width better than 1.12 mm, scanning girth better than 1.73 mm, and scanning angle better than 2.41°.
Foot deformation at different stances while walking
In this study, compared to the foot shape at static situation, continuous changes of each foot measurement were investigated and found to have significant deformations at dynamic situation. For deformation of lengths (FL, MBL, and LBL): The dynamic lengths are larger compared to static stance with HWB. As shown in Table 4, the extension degree of MBL is larger than LBL. Toe allowance is crucial for shoes to enable a natural roll-over process62. Footwear manufacturer used to leave enough space in front of the toes for wearing comfort following the fashion trends based on subjective judgement. From this study, a tolerance of 3 mm in the lengths should be considered as dynamic allowance to optimise the fit of the toe box during walking.
For deformation of widths (ABW, OBW, and OHW): Compared to static stance with HWB, the widths reach the maximum value at heel take off stance. From this study, a tolerance of 5 mm in ball width should be considered for toe box shape design to accommodate the foot deformation. The heel width increased 4.8% during walking compared to static stance with HWB. Heel cup is recommended to enclose the heel soft tissue by providing additional confinement for the heel63.
For deformation of height dimensions (IH, BH): The arches collapse with increased loads upon the foot during walking64,65. Arch pads and metatarsal pads, which accommodate the morphological plantar deformation during locomotion can ensure the plantar fully contact the insole for better distribution of plantar pressure. As shown in Table 4, on the basis of arch pad thickness at HWB standing, a tolerance of 3-5 mm is further recommended for motion comfort.
For deformation of angles (BA, T1A, T5A): Besides toe allowance, the ball angle is also an important measure to determine the flex line location for shoes. In this study, it is interesting to find that the ball angle tends to be obtuse during walking. The angle between the flex and medial lines of the shoe for diabetics is thereby suggested to be approximately 90°. The forefoot seems more pointed since the toe angles increase during walking, especially at final push stances. The deformation of TA1 is slightly higher than TA5, which can be attributed to the fact that Hallux Valgus is commonly found in the feet of diabetic patients66. However, for shoe/insole design, pointed forefoot contour is not recommended due to toes spread out during standing.
For deformation of girths (ABG, IG): The dynamic girth is larger than static stance with HWB, which might result from the contractions of intrinsic and extrinsic foot muscles67, as well as plantar fascia and ligaments deformation during walking68. As shown in Table 4, a 10 mm allowance should be considered to optimise the shoe girth fit during walking.
In this study, the continuous changes of foot shape were analysed from 5 representative stances, to investigate the dynamic allowance in design of diabetic footwear with optimal fit and comfort during walking. Generally, the findings from this study remedy the gap in the analysis of static foot deformation. Nevertheless, there are still some limitations in this study. First, the 5 frames which represent the whole ground contact are selected through visual observation, so manual errors are unavoidable even though this task is done by the same person. All of the frames of the foot roll-over process rather than a few of them are measured automatically for analysis. Therefore, the error caused by manual selection can be avoidable. Secondly, the number of diabetic subjects involved in this study is small (only female subjects), so the results cannot be generalized. More subjects can be recruited to analyse dynamic foot deformation in future studies.
Conclusion
This study has introduced an advanced 4D foot scanning system with good repeatability and accuracy for foot measurements in both standing and walking contexts. In comparison to traditional 3D scanning, the system can comprehensively and efficiently compare and visualise the changes in foot shape at different regions and during different stances of walking. In this study, the foot geometry changes and deformation of the feet of diabetic patients during their self-selected walking speed are continuously measured and compared by using the advanced scanning system. Compared with the foot measurements taken at static foot stance, foot length and girth dimensions at first toe contact and foot width at heel take off provide good references of foot shape changes during walking in design of diabetic footwear. Conventional footwear designs based on foot shapes taken with static stance in no/half weight bearing conditions inherently result in fit problems during walking, thus adversely affecting wear comfort and increasing the risk of foot pain and pressure. This study contributes by providing a practical recommendation for diabetic footwear and insole designs. Apart from adding toe allowance in designing the toe box and flex line, arch and metatarsal pads as well as a heel cup can be taken into consideration to reduce the risk for diabetic foot ulcers caused by excessive plantar pressure and deformation at dynamic situations. Skin-marker based motion capture is a frequently used method for foot movement analysis at different dynamic situations69. However, it is time-consuming and costly and detailed deformation of soft tissue cannot be captured28. Extended studies will be conducted to extract the information of foot motion functions from the new marker-less 4D scanner to give detailed recommendation on therapeutic insole design for diabetes.
Data availability
Data are available upon reasonable request. If you want to request the data from this study, please contact corresponding author, Dr. Kit-lun Yick.
References
Zhang, L., Yick, K. L., Li, P. L., Yip, J. & Ng, S. P. Foot deformation analysis with different load-bearing conditions to enhance diabetic footwear designs. PloS One 17(3), e0264233. https://doi.org/10.1371/journal.pone.0264233 (2022).
San Tsung, B. Y., Zhang, M., Fan, Y. B. & Boone, D. A. Quantitative comparison of plantar foot shapes under different weight-bearing conditions. J. Rehabil. Res. Dev. 40(6), 517 (2003).
Guldemond, N. et al. Casting methods and plantar pressure: Effects of custom-made foot orthoses on dynamic plantar pressure distribution. J. Am. Podiatr. Med. Assoc. 96, 9–18. https://doi.org/10.7547/0960009 (2006).
Xiong, S., Goonetilleke, R., Zhao, J., Li, W. & Witana, C. Foot deformations under different load-bearing conditions and their relationships to stature and body weight. Anthropol. Sci. 117, 77–88. https://doi.org/10.1537/ase.070915 (2009).
Barisch-Fritz, B., Schmeltzpfenning, T., Plank, C. & Grau, S. Foot deformation during walking: Differences between static and dynamic 3D foot morphology in developing feet. Ergonomics 57(6), 921–933. https://doi.org/10.1080/00140139.2014.899629 (2014).
Grau, S. & Barisch-Fritz, B. Improvement of safety shoe fit—valuation of dynamic foot structure. Footwear Sci. 10(3), 179–187. https://doi.org/10.1080/19424280.2018.1529062 (2018).
Blenkinsopp, R., Harland, A. R., Price, D., Lucas, T. & Roberts, J. A method to measure dynamic dorsal foot surface shape and deformation during linear running using digital image correlation. Proced. Eng. 34, 266–271. https://doi.org/10.1016/j.proeng.2012.04.046 (2012).
Ma, X. & Luximon, A. 9—Design and manufacture of shoe lasts. In Handbook of footwear design and manufacture (ed. Luximon, A.) 177–196 (Woodhead Publishing, 2013).
Jones, P., Bus, S. A., Davies, M. J., Khunti, K. & Webb, D. Toe gaps and their assessment in footwear for people with diabetes: a narrative review. J. Foot Ankle Res. 13(1), 70. https://doi.org/10.1186/s13047-020-00439-3 (2020).
Schmeltzpfenning, T., Plank, C., Krauß, I., Aswendt, P. & Grau, S. Dynamic foot scanning. Prospects and limitations of using synchronized 3D scanners to capture complete human foot shape while walking 145–155 (CRC Press, 2010).
Fritz, B., Schmeltzpfenning, T., Plank, C., Hein, T. & Grau, S. Anthropometric influences on dynamic foot shape: Measurements of plantar three-dimensional foot deformation. Footwear Sci. 5(2), 121–129. https://doi.org/10.1080/19424280.2013.789559 (2013).
Vidmar, J.V.G. & Song, Y. 4D foot scanner prototype development. Delft University of Technology. (2020).
Kimura, M., Mochimaru, M., Kanade, T. Measurement of 3D foot shape deformation in motion. (2009). doi:https://doi.org/10.1145/1394622.1394636
Thabet, A. K., Trucco, E., Salvi, J., Wang, W. & Abboud, R. J. Dynamic 3D shape of the plantar surface of the foot using coded structured light: a technical report. J. Foot Ankle Res. 7(1), 5. https://doi.org/10.1186/1757-1146-7-5 (2014).
Coudert, T., Vacher, P., Smits, C., Zande, M.V.D. A method to obtain 3 D foot shape deformation during the gait cycle. In The Ninth International Symposium on the 3D Analysis of Human Movement (2006).
Kouchi, M., Kimura, M. & Mochimaru, M. Deformation of foot cross-section shapes during walking. Gait Posture 30(4), 482–486. https://doi.org/10.1016/j.gaitpost.2009.07.113 (2009).
Kimura, M., Mochimaru, M., Kouchi, M., Saito, H., Kanade, T. 3D cross-sectional shape measurement of the foot while walking. In Proceedings of 7th symposium on footwear biomechanics Cleveland: International Society of Biome-chanics Technical Group on Footwear Biomechanics; 07/05. (2005).
Xie, Y. et al. The 3D point clouds registration for human foot. In Intelligence Science II (eds Shi, Z. et al.) 282–292 (Springer International Publishing, 2018).
Wang, M. et al. (2018) A 3D foot shape feature parameter measurement algorithm based on Kinect2. EURASIP J. Image Video Process. 1, 119. https://doi.org/10.1186/s13640-018-0368-5 (2018).
Besl, P. & McKay, H. D. A method for registration of 3-D shapes. IEEE Trans. Pattern Anal. Mach. Intell. 14, 239–256. https://doi.org/10.1109/34.121791 (1992).
Gunde, M., Salles, N., Hemeryck, A. & Martin-Samos, L. Iterative rotations and assignments (IRA): A shape matching algorithm for atomic structures. Softw. Impacts 12, 100264. https://doi.org/10.1016/j.simpa.2022.100264 (2022).
Myronenko, A. & Song, X. Point set registration: Coherent point drift. IEEE Trans. Pattern Anal. Mach. Intell. 32(12), 2262–2275. https://doi.org/10.1109/tpami.2010.46 (2010).
Xu, J., Liu, Z., Han, Z. & Geng, X. Application of point cloud registration in 3D reconstruction of catenary parts based on SIFT and LBP. Tiedao Xuebao/J. China Railw. Soc. 39, 76–81. https://doi.org/10.3969/j.issn.1001-8360.2017.10.010 (2017).
Yang, P., Zhou, Y., Yao, J., Tang, Y. & Chen, J. Three-dimensional shape reconstruction via an objective function optimization-based point cloud registration method. Opt. Eng. 56, 1. https://doi.org/10.1117/1.OE.56.11.113108 (2017).
Selviah D. Robust Automatic 3D Point Cloud Registration and Object Detection, Geomatics World. 03/01. (2018).
Ye, M., Wang, X., Yang, R., Ren, L. & Pollefeys, M. Accurate 3d pose estimation from a single depth image. In 2011 International Conference on Computer Vision; IEEE. p. 731–738. (2011)
Zhang, W. & Chenkun, Q.I. Pose Estimation by Key Points Registration in Point Cloud, 2019 3rd International Symposium on Autonomous Systems (ISAS). 65–68. https://doi.org/10.1109/ISASS.2019.8757773 (2019).
Jiang, D., Li, J.-W., Geng, X., Ma, X. & Chen, W.-M. Fast tool to evaluate 3D movements of the foot-ankle complex using multi-view depth sensors. Med. Nov. Technol. Dev. 17, 100212. https://doi.org/10.1016/j.medntd.2023.100212 (2023).
Zheng, Y., Li, Y., Shuo, Y. & Lu, H. Global-PBNet: A novel point cloud registration for autonomous driving. IEEE Trans. Intell. Transp. Syst. https://doi.org/10.1109/TITS.2022.3153133 (2022).
Chen, S., Liu, B., Feng, C., Vallespi-Gonzalez, C. & Wellington, C. 3D point cloud processing and learning for autonomous driving: Impacting map creation, localization, and perception. IEEE Signal Process. Mag. 38(1), 68–86. https://doi.org/10.1109/MSP.2020.2984780 (2021).
Pomerleau, F., Colas, F. & Siegwart, R. A review of point cloud registration algorithms for mobile robotics. Found. Trends Robot. 4, 1–104. https://doi.org/10.1561/2300000035 (2015).
Rasoulian, A., Rohling, R. & Abolmaesumi, P. Group-wise registration of point sets for statistical shape models. IEEE Trans. Med. Imaging 31(11), 2025–2034 (2012).
Wu, G., Kim, M., Wang, Q. & Shen, D. S-HAMMER: Hierarchical attribute-guided, symmetric diffeomorphic registration for MR brain images. Hum. Brain Mapp. 35(3), 1044–1060 (2014).
Oliveira, F. & Tavares, J. Medical image registration: A review. Comput Methods Biomech. Biomed. Eng. 17, 73–93. https://doi.org/10.1080/10255842.2012.670855 (2014).
Ren, S. et al. Color point cloud registration algorithm based on hue. Appl. Sci. 11, 5431. https://doi.org/10.3390/app11125431 (2021).
Bernhard, S., John, P. & Thomas, H. Non-rigid point set registration: Coherent point drift. In Advances in Neural Information Processing Systems 19: Proceedings of the 2006 Conference. MIT Press, 1009–1016 (2007).
Golyanik V., Taetz B., Reis G. & Stricker D. Extended Coherent Point Drift Algorithm with Correspondence Priors and Optimal Subsampling, WACV 2016: IEEE Winter Conference on Applications of Computer Vision. https://doi.org/10.1109/WACV.2016.7477719 (2016).
ISO 5725-1:1994(en) Accuracy (trueness and precision) of measurement methods and results—Part 1: general principles and definitions. Secondary ''ISO 5725–-:1994(en) Accuracy (trueness and precision) of measurement methods and results—Part 1: general principles and definitions'' (1994).
Rodin, D., Shapiro, Y., Pinhasov, A., Kreinin, A. & Kirby, M. An accurate wearable hydration sensor: Real-world evaluation of practical use. PLoS One 17, e0272646. https://doi.org/10.1371/journal.pone.0272646 (2022).
Wan, F. K. W., Yick, K.-L. & Yu, W. W. M. Validation of a 3D foot scanning system for evaluation of forefoot shape with elevated heels. Measurement 99, 134–144. https://doi.org/10.1016/j.measurement.2016.12.005 (2017).
Psikuta, A., Frackiewicz-Kaczmarek, J., Mert, E., Bueno, M.-A. & Rossi, R. M. Validation of a novel 3D scanning method for determination of the air gap in clothing. Measurement 67, 61–70. https://doi.org/10.1016/j.measurement.2015.02.024 (2015).
van Melick, N., Meddeler, B. M., Hoogeboom, T. J., Nijhuis-van der Sanden, M. W. G. & van Cingel, R. E. H. How to determine leg dominance: The agreement between self-reported and observed performance in healthy adults. PloS One 12(12), e0189876. https://doi.org/10.1371/journal.pone.0189876 (2017).
Chiles, N. S. et al. Diabetes, peripheral neuropathy, and lower-extremity function. J. Diabetes Complicat. 28(1), 91–95. https://doi.org/10.1016/j.jdiacomp.2013.08.007 (2014).
Sacco, I. C. et al. Abnormalities of plantar pressure distribution in early, intermediate, and late stages of diabetic neuropathy. Gait Posture 40(4), 570–574. https://doi.org/10.1016/j.gaitpost.2014.06.018 (2014).
Bus, S. A. et al. Plantar pressure relief in the diabetic foot using forefoot offloading shoes. Gait Posture 29(4), 618–622. https://doi.org/10.1016/j.gaitpost.2009.01.003 (2009).
Blanc, Y., Balmer, C., Landis, T. & Vingerhoets, F. Temporal parameters and patterns of the foot roll over during walking: normative data for healthy adults. Gait Posture 10(2), 97–108. https://doi.org/10.1016/S0966-6362(99)00019-3 (1999).
Rakotosaona, M.-J., La Barbera, V., Guerrero, P., Mitra, N. J. & Ovsjanikov, M. PointCleanNet: Learning to denoise and remove outliers from dense point clouds. Comput. Gr. Forum 39(1), 185–203. https://doi.org/10.1111/cgf.13753 (2020).
Ruchay, A., Dorofeev, K., Kalschikov, V. Accuracy analysis of 3D object reconstruction using point cloud filtering algorithms. In Information Technology and Nanotechnology, 169–174. doi: https://doi.org/10.18287/1613-0073-2019-2391-169-174 (2019).
Rakotosaona, M.-J., La Barbera, V., Guerrero, P. & Ovsjanikov, M. PointCleanNet : Learning to denoise and remove outliers from dense point clouds: PointCleanNet. Comput. Gr. Forum https://doi.org/10.1111/cgf.13753 (2019).
Aggarwal, C. C. Outlier analysis. In Data mining: The textbook (ed. Aggarwal, C. C.) 237–263 (Springer International Publishing, 2015).
Rusu, R.B., Cousins, S. 3D is here: Point cloud library (PCL). In 2011 IEEE International Conference on Robotics and Automation, 1–4. doi:https://doi.org/10.1109/ICRA.2011.5980567 (2011)
Paris, S., Kornprobst, P., Tumblin, J. & Durand, F. Bilateral filtering: Theory and applications. Found. Trends Comput. Gr. Vis. 4(1), 1–73. https://doi.org/10.1561/0600000020 (2009).
Moorfield B., Haeusler R. & Klette R. Bilateral Filtering of 3D Point Clouds for Refined 3D Roadside Reconstructions, International Conference on Computer Analysis of Images and Patterns. https://doi.org/10.1007/978-3-319-23117-4_34 (2015)
Geng Y. et al. A Method of Welding Path Planning of Steel Mesh Based on Point Cloud for Welding Robot. Research Square (2021).
Han, X.-F. et al. A review of algorithms for filtering the 3D point cloud. Signal Process. Image Commun. 57, 103–112. https://doi.org/10.1016/j.image.2017.05.009 (2017).
Kouchi, M. Inter-generation differences in foot morphology: aging or secular change?. J. Hum. Ergol. 32(1), 23–48 (2003).
Mitra, N.J., Gelfand, N., Pottmann, H. & Guibas, L. Registration of point cloud data from a geometric optimization perspective. In Proceedings of the 2004 Eurographics/ACM SIGGRAPH symposium on Geometry processing; Association for Computing Machinery, 22–31. doi: https://doi.org/10.1145/1057432.1057435 (2004).
Tereshchenko V., Tereshchenko Y. & Kotsur D. Point triangulation using Graham’s scan, Fifth International Conference on the Innovative Computing Technology (INTECH 2015). 148–151. https://doi.org/10.1109/INTECH.2015.7173370 (2015).
Thabet, A., Trucco, E., Salvi, J., Wang, W. & Abboud, R.A dynamic 3D foot reconstruction system. In Conference proceedings: Annual International Conference of the IEEE Engineering in Medicine and Biology Society IEEE Engineering in Medicine and Biology Society Conference, 599-602. doi: https://doi.org/10.1109/IEMBS.2011.6090133 (2011).
Au, E., Goonetilleke, R., Witana, C. & Xiong, S. A methodology for determining the allowances for fitting footwear. Int J Hum. Factors Model. Simul. 2, 341–366. https://doi.org/10.1504/IJHFMS.2011.045003 (2011).
Novak, B., Mozina, J. & Jezeršek, M. 3D laser measurements of bare and shod feet during walking. Gait Posture https://doi.org/10.1016/j.gaitpost.2014.02.015 (2014).
Barisch-Fritz, B., Plank, C. & Grau, S. Evaluation of the rule-of-thumb: Calculation of the toe allowance for developing feet. Footwear Sci. 8(3), 119–127. https://doi.org/10.1080/19424280.2016.1144654 (2016).
Lin, C.-Y., Chen, P.-Y., Wu, S.-H., Shau, Y.-W. & Wang, C.-L. Biomechanical effects of plastic heel cup on plantar fasciitis patients evaluated by ultrasound shear wave elastography. J. Clin. Med. 11(8), 2150 (2022).
Sichting, F. & Ebrecht, F. The rise of the longitudinal arch when sitting, standing, and walking: Contributions of the windlass mechanism. PLoS One 16(4), e0249965. https://doi.org/10.1371/journal.pone.0249965 (2021).
Kramer, P. A. & Lautzenheiser, S. G. Foot morphology influences the change in arch index between standing and walking conditions. Anat. Rec. https://doi.org/10.1002/ar.24890 (2022).
Sarla, G. Morphological changes in diabetic foot. Int. J. Pulm. Respir. Sci. https://doi.org/10.19080/IJOPRS.2019.04.555637 (2019).
Farris, D. J., Kelly, L. A., Cresswell, A. G. & Lichtwark, G. A. The functional importance of human foot muscles for bipedal locomotion. Proc. Natl. Acad. Sci. 116(5), 1645–1650. https://doi.org/10.1073/pnas.1812820116 (2019).
Zelik, K. E., La Scaleia, V., Ivanenko, Y. P. & Lacquaniti, F. Coordination of intrinsic and extrinsic foot muscles during walking. Eur. J. Appl. Physiol. 115(4), 691–701. https://doi.org/10.1007/s00421-014-3056-x (2015).
Kidder, S. M., Abuzzahab, F. S., Harris, G. F. & Johnson, J. E. A system for the analysis of foot and ankle kinematics during gait. IEEE Trans. Rehabil. Eng. 4(1), 25–32 (1996).
Acknowledgements
This research is funded by the Laboratory for Artificial Intelligence in Design (Project code: RP1-2), Innovation and Technology Fund, Hong Kong.
Author information
Authors and Affiliations
Contributions
L.Y.Z: Conceptualization; Data curation; Formal analysis; Investigation; Methodology; Validation; Visualization; Roles/Writing—original draft. K.L.Y: Conceptualization; Funding acquisition; Project administration; Resources; Supervision; Writing—review & editing. M.J.Y: Data curation; Formal analysis; Investigation; Methodology; Validation; Software. J.Y: Funding acquisition; Project administration; Resources; Supervision. S.P.N: Funding acquisition; Project administration; Resources; Supervision.
Corresponding author
Ethics declarations
Competing interests
The authors declare no competing interests.
Additional information
Publisher's note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/.
About this article
Cite this article
Zhang, Ly., Yick, Kl., Yue, Mj. et al. An exploratory study of dynamic foot shape measurements with 4D scanning system. Sci Rep 13, 8628 (2023). https://doi.org/10.1038/s41598-023-35822-0
Received:
Accepted:
Published:
DOI: https://doi.org/10.1038/s41598-023-35822-0
- Springer Nature Limited