Unsuitable shoe shapes and sizes are a critical reason for unhealthy feet, may severely contribute to chronic injuries such as foot ulcers in susceptible people (e.g., diabetes patients), and thus need accurate measurements in the manner of expert-based procedures.
1. Introduction
Healthy feet are the main factor for activity in daily life, whether in movement related to work or exercise
[1]. Neglecting foot health may result in chronic injuries such as foot ulcers
[2]. It is a significant obstacle for susceptible people who are suffered from negative long-term consequences and substantial healthcare expenses
[3].
Suitable shoe shapes and sizes are essential for healthy feet and need accurate measurements. Available shoes in the commercial sectors are based on the average size, standardizing the foot base on a measuring tape (length and width). It may not be comfortable and nor fit for susceptible people such as diabetes patients
[4]. Moreover, manually finding shoe sizes is tedious and time-consuming
[5]. Therefore, optical measuring technologies, binocular vision, phase measurement, digital holography, and structured light techniques have become the principal machine measures for mass-customized shoes; however, detecting foot characteristics is a complex process
[6]. In this way, 3D-scanning-based technology has been extensively investigated in computer graphics to address that concern
[7]. It employs a laser-based technique to detect foot shape and identify size by releasing reflected light on a foot’s surface, that can then accurately compute to produce a virtual item
[8].
However, accessing high-quality technologies is difficult for ordinary patients since their cost is very high, and the measurement procedure may take a very long time. Some research has attempted to overcome this limitation by proposing simple 3D-scanning devices based on RGB-depth cameras such as PrimeSense, Kinect, and RealSense. Compared to conventional 3D scanning equipment, they are affordable, portable, and simple to operate
[9]. In addition, some of them apply visualization-based try-on simulations as assistive tools to help people measure foot size in order to make better decisions
[10]. The visualization may utilize AR technology to manufacture relevant foot information based on smart devices. For instance, Jiang et al. proposed an AR-based approach for the virtual try-on of shoes projected on mobile devices
[11]. They found that a detection system, applied to the AR technique and displayed on mobile devices, helps people effectively enhance their perception of a product.
The principals of feet detection technology consist of two main processes: (1) the information detection process and (2) the information visualization process. It may begin with a detection process based on the marker-based process that senses real-time signals from the real-world environment and extracts essential information. The results let computer systems simultaneously simulate virtual objects based on 3D models mixed with real-world objects. Technically, there are two well-known approaches for foot detection systems. Firstly, the marker-based sensing approach uses a physical symbol (such as photos or text) as a reference position using an RGB camera
[12]. The current systems focus on simulating virtual foot measurements using the marker-based approach to track and monitor objects
[13]. However, this technique depends on the quality of the marker positions that are placed on unmoving objects unsuitable for detecting active objects, such as the human body. It becomes a limitation when users, such as diabetes patients, need accurate foot measurements, but cannot access advanced and professional tools. Secondly, the markerless-based sensing approach utilizes the feature of a depth camera for real-time object tracking, which can also apply to foot-detection systems. Addressing this concern, by introducing a new markerless-based approach to the standard of professional tools that can be accessed through mobile devices so that ordinary people can accurately measure their shoe size at anytime and anywhere, is challenging.
2. Feet Detection
The susceptible people are those whose feet are sensitive to injury caused by unfitted footwear that may affect long-term foot health, such as chronic patients and older people
[14]. Alsheikh et al.
[15] researched the need for primary healthcare based on diabetic foot conditions. They found that, recently, patients have been less cared for in terms of foot health and that there is a need for further study to fill this gap. This suggests that utilizing advanced technologies is challenging but may alleviate this problem.
Researchers have addressed this concern based on machine learning techniques. D’Angelo et al.
[16] proposed an approach for foot detection using interpretable machine learning techniques. They discussed how the approach could explain the problem explicitly, allowing staff to understand the foot condition and effectively decide on the treatment. Thotad et al.
[17] and Ahsan et al.
[18] proposed an approach for detecting diabetic foot ulcers using deep learning and computer vision techniques. They discussed the proposed techniques to help the system detect foot ulcers effectively. Some have solved the problem using sensor technologies to detect the foot shape and size. Mei
[19] and Kini et al.
[20] employed force sensors that measure and classify foot types and that allow the system to match each foot with proper footwear. They claimed that the techniques help people choose suitable footwear and may prevent long-term negative effects. In addition, Chun et al.
[21] proposed a foot-detection approach using an RGB-D camera as a sensor. They emphasized the foot arch details critical for measuring and capturing the fit size and shape factors. They concluded that they produced high-quality inputs that effectively let the system analyze foot arch characteristics.
Although numerous studies have proposed new approaches to deal with foot measurement problems with high detection effectiveness, none consider the already-used approaches for real-time foot measuring at home with user-friendly devices. They employed high computational performance, sensors, and techniques that are not yet ready to deploy for ordinary patients who are not experts. Moreover, they focused on post-event analysis rather than on an assistive tool for patients to measure appropriate footwear shapes and sizes in order to prevent worse cases. This research gap is challenging, but it may be possible to apply lightweight sensors with real-time technologies to address this concern.
3. Foot Detection Based on Real-Time-Based System
A foot-detection technique based on a real-time system aims to estimate the shape size so that people can choose suitable shoes. It connects physical and computer-generated objects in a virtual environment, letting people envision the approximate shoes fitted to their personalities. It may employ online processing to produce a live-stream simulation of foot information in particular situations. AR offers a real-time-based system for foot detection that lets systems control the real-world environment and interact with 3D-based virtual objects; however, applying AR to automatic foot detection in medical fields is challenging
[22].
Research has examined AR technologies to support real-time-based systems and has primarily been relevant to medical training
[23]. Focusing on health care, Sip et al.
[24] and de Assis et al.
[25] proposed AR-based systems as assistive tools to help staff rehabilitate patients affected by stroke. They discussed the fact that AR technologies let physicians and experts practice their readiness for first aid. Moreover, Jeung et al.
[26] employed AR technologies to guide physicians in understanding surgical processes. They confirmed that AR technologies help them reduce faults during operations effectively. This suggests that AR technologies are in demand in medical fields, and that they can help physicians and experts deal with emergency cases. Unfortunately, most of the available studies introduce AR technologies in order to support experts, and few studies concern susceptible people, such as diabetes patients, who need technologies that measure their feet, both shape and size, and which they can try at home with available devices.
In conclusion, real-time foot-detection systems for ordinary people are currently in their infant stage and demand research that needs further contribution in order to address the knowledge gaps. Researchers highlight recent research gaps in terms of two limitations: (1) a lack of study on lightweight sensors to measure foot shape based on available devices and (2) the absence of a proposed ground truth to measure and identify foot shape descriptions concerning diabetic patients. The following section will show the overview system architecture of real-time feet detection to address the challenges.