Submitted Successfully!
To reward your contribution, here is a gift for you: A free trial for our video production service.
Thank you for your contribution! You can also upload a video entry or images related to this topic.
Version Summary Created by Modification Content Size Created at Operation
1
Yuping Ye
 -- 1231 2023-07-06 03:44:14 |
2 update references and layout
Rita Xu
 Meta information modification 1231 2023-07-06 04:46:58 |

Video Upload Options

Do you have a full video?
Send video materials Upload full video

Confirm

Are you sure to Delete?
Yes No
Cite
If you have any further questions, please contact Encyclopedia Editorial Office.
Liang, J.; Ye, Y.; Gu, F.; Zhang, J.; Zhao, J.; Song, Z. 3D Measurement of High-Reflective Surfaces. Encyclopedia. Available online: https://encyclopedia.pub/entry/46489 (accessed on 05 May 2024).
Liang J, Ye Y, Gu F, Zhang J, Zhao J, Song Z. 3D Measurement of High-Reflective Surfaces. Encyclopedia. Available at: https://encyclopedia.pub/entry/46489. Accessed May 05, 2024.
Liang, Jixin, Yuping Ye, Feifei Gu, Jiankai Zhang, Juan Zhao, Zhan Song. "3D Measurement of High-Reflective Surfaces" Encyclopedia, https://encyclopedia.pub/entry/46489 (accessed May 05, 2024).
Liang, J., Ye, Y., Gu, F., Zhang, J., Zhao, J., & Song, Z. (2023, July 06). 3D Measurement of High-Reflective Surfaces. In Encyclopedia. https://encyclopedia.pub/entry/46489
Liang, Jixin, et al. "3D Measurement of High-Reflective Surfaces." Encyclopedia. Web. 06 July, 2023.
3D Measurement of High-Reflective Surfaces
Edit
This entry is adapted from the peer-reviewed paper 10.3390/photonics10060695

The reflection phenomenon exhibited by highly reflective surfaces considerably affects the quality of captured images, thereby rendering the task of structured light (SL) 3D reconstruction.

high reflection structured light polarization

1. Introduction

As a crucial component of computer vision, 3D reconstruction technology has been rapidly developed and has gained widespread applications in various fields, such as intelligent terminal, biomedical, mechanical manufacturing, and virtual reality [1][2]. Among vision-based 3D reconstruction methods, the typical time-coded SL system consists of a projector and a camera. The projector projects a pre-coded fringe pattern onto the surface of object, and the camera captures a series of images with pattern illuminations [3][4]. The feature points of camera and projector were matched by decoding method, and the 3D information of the object’s surface is calculated by triangulation based on the calibration results [5][6]. The time-multiplexing SL method is capable of attaining both high accuracy and dense point clouds, therefore, it has a high application value in industrial inspections due to its high precision and high reconstruction density [7].
In industrial manufacturing, there are a large number of samples with highly reflective surfaces such as metal workpieces, and the highly reflective phenomenon caused by the projected light will make the projected stripes blur in the camera field of view, which will seriously affect the accuracy of 3D reconstruction and lead to irreversible loss of measurement information. Therefore, finding ways to suppress and eliminate the highly reflective phenomenon becomes a difficult problem that needs to be addressed in SL 3D reconstruction.
For the problem of highlight in SL method, the existing solutions mainly include adaptive projection intensity, multiple exposures, multi-view method, and the use of optical filters [8][9][10][11][12]. These methods can alleviate the reconstruction issue caused by high-reflective surfaces to some extent. However, the adaptive projection intensity, multiple exposure, and multi-view methods all require multiple acquisitions under different conditions, which are time-consuming and have complex algorithms. In contrast, using an optical filter such as a polarizer, which suppresses highlight areas from an optical imaging perspective, can avoid multiple scans of highly reflective surfaces.
An SL 3D reconstruction method of high reflectance surface using polarized light technique is proposed. The SL system employed in this study comprises a DLP fitted with a fixed-angle linear polarizer and a four-channel polarizing camera. The striped images of the four polarization channels with brightness differences are acquired by the SL scanning. Then, a binary code time-multiplexing SL method is adopted to obtain four distinct point clouds. The weight map is generated based on the four texture maps and depth maps to guide the point cloud fusion, and the best points are selected from the four point clouds to smooth the missing parts by the point cloud smoothing and noise reduction strategy. Finally, a precise and complete point cloud is obtained with a single scan, which has advantages in terms of time and precision.

2. 3D Measurement of High-Reflective Surfaces

In SL scanning, a pre-designed fringe pattern is actively projected onto the target surface, and the camera captures the image with the corresponding fringe information for 3D reconstruction. The commonly used sinusoidal coded stripes and gray code combined with phase-shift encoded stripes are all based on the projection intensity [13]. However, the periodic change in illumination intensity caused by these stripes results in blurred fringe information when the surface reflectance is uneven. To address this issue, a binary fringe based on Gray code combined with line shift coding has been proposed [14], which is independent of fringe intensity and shows better robustness against uneven surface reflectance. Nonetheless, highly reflective surfaces can cause overexposure in the camera image, leading to the loss of fringe information.
There are many solutions for the problem of SL scanning on surfaces with high reflectivity. In [8], a method based on camera response function, which adaptively adjusts the pixel-level intensity of projected fringe pattern according to the reflectivity of object surface, is proposed to deal with the highlight surface.This method can effectively improve the image quality of fringe, but it takes a lot of time to extract the reflectance information of object surface and calculate the projection intensity. In [9], the binary line shift fringe pattern is projected multiple times under different exposure times, and the fringe images at different exposure times are fused into well-exposed fringe images with the high dynamic range (HDR) image fusion technology for three-dimensional reconstruction. This method can also reconstruct a relatively complete point cloud, but the selection of multiple exposure times is based on experience, and multiple exposure increases the scanning time. In [10], a binocular SL system is proposed to process highly reflective surface, different angles of cameras on both sides are used to avoid specular reflection on the same surface, and highlight areas are detected separately, therefore, two point clouds can be reconstructed for splicing and fusion. Although this method can improve the reconstruction effect of the point cloud, it does not directly solve the highlight problem, and the outcome is not good for some free-form high-reflectance surfaces. In [11], a transparent screen is placed in front of the camera and the intensity of its corresponding screen pixels is adjusted according to the camera response function, which can improve the dynamic range of the camera and weaken the influence of highlights in structural light scanning. This method is equivalent to adding an optical filter to deal with the problem of high reflection. In [12], the difference in sensitivity efficiency of monochromatic laser under the RGB channel of color sensor is used to obtain images with different brightness values, which are fused to obtain images with high dynamic range for reconstruction. This method utilizes optical filters on the color sensor and HDR technology to accomplish high-dynamic-range 3D reconstruction.
Polarized light technology has been widely used in computer vision. This technology is to filter random vibration light signals into light signals that vibrate regularly along the polarization direction through polarization devices, eliminate the impact of stray reflected light on camera imaging, and achieve the removal of highly reflective areas [15]. In [16], a method is proposed to project sinusoidal encoded fringes and collect four groups of fringe images by a four-channel polarization camera. Through traversing the pixels of the four channel images, the appropriate channels were selected to enhance the fringe and then three-dimensional reconstruction was performed. However, the channel selection method is random and noise is easy to be introduced during reconstruction. In [17], a method of three-dimensional measurement of the dynamic objects by using the circularly polarized light and polarizing camera is proposed. The method also adopts sinusoidal coding, and speckle will be produced because laser is used as the light source, which will affect the measurement accuracy. In [18], a polarization-based method is proposed to remove image highlight and a normalized weighted algorithm is used to recover the surface information of the highlight region. This method can restore fringe information to complete reconstruction by adjusting the angle of polarizer and multiple exposures. However, the method of manually adjusting polarizer for measurement is difficult to adapt to complex and varied industrial scenes. In [19], a method is proposed to estimate the interval optimal projection intensity according to the camera response function under the polarization system and obtain the optimal fringe image by image fusion method, based on which 3D reconstruction is performed. Although the polarizer is not adjusted in the reconstruction process, the projection intensity is estimated according to the images acquired by multiple projections, which requires a certain preparation time.

References

  1. Ye, Y.; Chang, H.; Song, Z.; Zhao, J. Accurate infrared structured light sensing system for dynamic 3D acquisition. Appl. Opt. 2020, 59, E80–E88.
  2. Wan, M.; Kong, L.; Peng, X. Single-Shot Three-Dimensional Measurement by Fringe Analysis Network. Photonics 2023, 10, 417.
  3. Zhang, S. Recent progresses on real-time 3D shape measurement using digital fringe projection techniques. Opt. Lasers Eng. 2010, 48, 149–158.
  4. Cao, W.; Wang, R.; Ye, Y.; Shi, C.; Song, Z. CSIE: Coded strip-patterns image enhancer embedded in structured light-based methods. Opt. Lasers Eng. 2023, 166, 107561.
  5. Hartley, R.; Zisserman, A. Multiple View Geometry in Computer Vision; Cambridge University Press: Cambridgeshire, UK, 2003.
  6. Gu, F.; Cao, H.; Xie, P.; Song, Z. Accurate Depth Recovery Method Based on the Fusion of Time-of-Flight and Dot-Coded Structured Light. Photonics 2022, 9, 333.
  7. Sansoni, G.; Carocci, M.; Rodella, R. Calibration and performance evaluation of a 3-D imaging sensor based on the projection of structured light. IEEE Trans. Instrum. Meas. 2000, 49, 628–636.
  8. Lin, H.; Han, Z. Automatic optimal projected light intensity control for digital fringe projection technique. Opt. Commun. 2021, 484, 126574.
  9. Song, Z.; Jiang, H.; Lin, H.; Tang, S. A high dynamic range structured light means for the 3D measurement of specular surface. Opt. Lasers Eng. 2017, 95, 8–16.
  10. Li, B.; Xu, Z.; Gao, F.; Cao, Y.; Dong, Q. 3d reconstruction of high reflective welding surface based on binocular structured light stereo vision. Machines 2022, 10, 159.
  11. Cao, J.; Li, C.; Li, C.; Zhang, X.; Tu, D. High-reflectivity surface measurement in structured-light technique by using a transparent screen. Measurement 2022, 196, 111273.
  12. Zhang, Y.; Qiao, D.; Xia, C.; Yang, D.; Fang, S. A method for high dynamic range 3D color modeling of objects through a color camera. Mach. Vis. Appl. 2023, 34, 6.
  13. Porras-Aguilar, R.; Falaggis, K. Absolute phase recovery in structured light illumination systems: Sinusoidal vs. intensity discrete patterns. Opt. Lasers Eng. 2016, 84, 111–119.
  14. Gühring, J. Dense 3D surface acquisition by structured light using off-the-shelf components. SPIE Proc. 2000, 4309, 220–231.
  15. Wolff, L.B. Using polarization to separate reflection components. In Proceedings of the 1989 IEEE Computer Society Conference on Computer Vision and Pattern Recognitiony, San Diego, CA, USA, 4–8 June 1989; pp. 363–364.
  16. Salahieh, B.; Chen, Z.; Rodriguez, J.J.; Liang, R. Multi-polarization fringe projection imaging for high dynamic range objects. Opt. Express 2014, 22, 10064–10071.
  17. Chen, Z.; Wang, X.; Liang, R. Snapshot phase shift fringe projection 3D surface measurement. Opt. Express 2015, 23, 667–673.
  18. Zhu, Z.; Xiang, P.; Zhang, F. Polarization-based method of highlight removal of high-reflectivity surface. Optik 2020, 221, 165345.
  19. Zhu, Z.; Zhu, T.; Sun, X.; Zhang, F. 3D reconstruction method based on the optimal projection intensity of a polarization system. Appl. Opt. 2022, 61, 10290–10298.
More
© Text is available under the terms and conditions of the Creative Commons Attribution (CC BY) license; additional terms may apply. By using this site, you agree to the Terms and Conditions and Privacy Policy.
Upload a video for this entry
Information
Subjects: Robotics
Contributors MDPI registered users' name will be linked to their SciProfiles pages. To register with us, please refer to https://encyclopedia.pub/register :
Jixin Liang
,
Yuping Ye
,
Feifei Gu
,
Jiankai Zhang
,
Juan Zhao
,
Zhan Song
View Times: 211
Revisions: 2 times (View History)
Update Date: 06 Jul 2023
Table of Contents
    1000/1000
    Hot Most Recent
    Feedback