Submitted Successfully!
To reward your contribution, here is a gift for you: A free trial for our video production service.
Thank you for your contribution! You can also upload a video entry or images related to this topic.
Version Summary Created by Modification Content Size Created at Operation
1 These classical algorithms and emerging AVI methods are introduced, analyzed, and compared in this review. And, the remaining challenges and future research trends of visual defect detection are discussed and forecasted at an abstract level. + 1182 word(s) 1182 2020-09-21 15:53:28 |
2 format changed -73 word(s) 1109 2020-10-21 06:15:48 |

Video Upload Options

Do you have a full video?

Confirm

Are you sure to Delete?
Cite
If you have any further questions, please contact Encyclopedia Editorial Office.
Fang, X.; Luo, Q.; Zhou, B.; Li, C.; Tian, L. Surface Defect Detection. Encyclopedia. Available online: https://encyclopedia.pub/entry/2257 (accessed on 26 April 2024).
Fang X, Luo Q, Zhou B, Li C, Tian L. Surface Defect Detection. Encyclopedia. Available at: https://encyclopedia.pub/entry/2257. Accessed April 26, 2024.
Fang, Xiaoxin, Qiwu Luo, Bingxing Zhou, Congcong Li, Lu Tian. "Surface Defect Detection" Encyclopedia, https://encyclopedia.pub/entry/2257 (accessed April 26, 2024).
Fang, X., Luo, Q., Zhou, B., Li, C., & Tian, L. (2020, September 29). Surface Defect Detection. In Encyclopedia. https://encyclopedia.pub/entry/2257
Fang, Xiaoxin, et al. "Surface Defect Detection." Encyclopedia. Web. 29 September, 2020.
Surface Defect Detection
Edit

Automated visual inspection (AVI) instrument targeting on surface quality emerges as a standard configuration for metal planar materials (e.g., steel, aluminum, copper plates and strips, etc.) to improve product quality and promote production efficiency. A general AVI instrument provides two main functions of defect detection and classification. The former detection process recognizes defective regions from normal background without identifying what types of defects they are. The latter process is dedicated to identify and label detected defects to support finishing product grading. The classification accuracy is directly determined by the precision of defect detection; thus, the overall performance of an AVI system is mainly limited by the accuracy, time efficiency, and robustness of various algorithms in the process of defect detection. Both two-dimensional and three-dimensional surface defect detection technologies are used for defect detection. According to the algorithm properties, the existing two-dimensional methodologies are categorized into four groups: statistical, spectral, model, and machine learning-based methods. On the basis of three-dimensional data acquisition, the three-dimensional technologies are divided into stereoscopic vision, photometric stereo, laser scanner, and structured light measurement methods. 

automated visual inspection image detection surface defect detection metal planar materials

1. Introduction

Metal planar materials (e.g., steel, aluminum, copper plates and strips, etc.) are widely used in automobile manufacturing, bridge construction, aerospace, and other pillar industries, which make immense contributions to the modern social development and the betterment of life. Nevertheless, in the actual industrial production process, the processing equipment damage or the harsh industrial environment will inevitably lead to certain quality problems of metal planar materials products. Some products surface defects showing large-area or periodic characteristics not only impact on the subsequent production but also threaten the quality of terminal products, which bring huge economic and reputational losses to the manufacturing enterprises. The number, degree, and distribution of surface defects areas are significant factors to determine the quality of industrial metal planar materials. The damage detection methods based on vibro-acoustic modulation [1], wireless sensing technology [2] and other different principles have been researched for a long time. However, the computer-vision-based surface defect detection methods are the most commonly used to find and locate the abnormal areas on the image surface due to their advantages of low cost, easy operation, and superior performance, etc. Nowadays, with the rapid development of hardware facilities and the continuous advance of artificial intelligence technology, automated visual inspection (AVI) equipment has gradually become the standard configuration for industrial manufacturers to improve product quality and production efficiency [3][4][5][6][7][8].

2. Taxonomy of Two-Dimension Defect Detection Methods

Researchers divided the previously proposed methods into different categories according to different characteristics; however, due to scholars’ subjective differences, these categories also vary with each individual. For instance, Zhang et al. [9] thought that texture can be divided into statistical texture and structural texture, and accordingly, the surface defect detection methods based on machine vision are divided into non-texture surface defect detection and texture surface defect detection, in which the former includes threshold methods and pyramid methods, and the latter includes spatial domain methods and frequency domain methods. Yet, based on diverse technology roadmaps, Wang et al. [10] classified defect detection methods into three categories: classification-, local exception- and template matching-based. Youkachen et al. [11] proposed that the detection methods can be classified into a probability model, statistical model, proximity model, deviation model, and network model. Wu et al. [12] divided the methods into statistics-, structure-, spectrum- and subspace-based methods. The texture analysis problem is formerly settled by statistical, spectral, and model-based methods. However, it is noteworthy that the rapid development of deep learning in recent years has changed this pattern; more and more defects detection methods based on deep learning have been applied to metal planar materials. Hence, this entry divides the surface defect detection methods of metal planar materials into four categories: traditional statistical-based methods, spectrum-based methods, model-based methods, and emerging machine learning-based methods (Figure 1).

Sensors 20 05136 g003 550

Figure 1. The overall structure of detection method taxonomy.

3. Taxonomy of Three-Dimension Defect Detection Methods

Two-dimensional detection methods mainly rely on gray images to obtain the surface morphology of flat metal and employ gray field change to realize surface defect detection. Due to the lack of height/depth information, these kinds of methods are frequently susceptible to natural light, shadow, water, and oil stains, resulting in false defects. In spite of this, the surface defects of metal planar materials are generally accompanied by height anomalies, such as pits, bumps, depressions, and so on. High reflective spots and dark areas appear in the two-dimensional image after illumination, which is unconducive to the accurate identification of defects. Therefore, the defect detection methods led by 3D imaging technology or 3D reconstruction technology attract wide attention. Making full use of the gray, elevation, and geometric characteristics of the defects, new detection techniques are the development trend of the surface defect detection technology of metal planar materials.

Three-dimensional (3D) data measurement is commonly divided into contact measurement and non-contact measurement. The former shows the characteristics of high destructiveness, high cost, and slow detection speed, and the latter mainly includes penetration measurement and reflection measurement. Penetrating measurement of radioactive substances causes potential hazards. Consequently, the non-contact and high-security advantages of reflection-type measurement turn into the choice of most people, and outstanding results have been obtained in the surface detection of 3D objects. Non-optical measurement is a type of reflection measurement, from early radar and sonar to ultrasonic imaging [13][14], magnetic imaging [15][16], pulsed eddy current imaging [17][18][19][20], and so on. Non-optical measurement needs to be close to the detected surface and generates blind spots if the rough surface or noise interference occurs. Another momentous reflective measurement is an optical measurement. The number of literatures on 3D detection methods of metal planar materials surface defects is limited, and researchers have different opinions on the classification of optical 3D measurement methods. Pernkopf and O'Leary [21] summed up two range imaging methods: light sectioning and photometric stereo. The former uses projected light to calculate distance, while the latter obtains static scene distance from several grayscale intensity images. Koch et al. [22] divided existing 3D detection research into (1) 3D reconstruction methods using 3D laser scanning and stereo vision and (2) target reconstruction methods based on vibration using acceleration sensors. Song et al. [23] believed 3D information acquisition could be divided into two types: passive stereo vision and active structured light. Passive stereo vision is well applied to areas with large texture variation. Active structured light replaces a camera with a projector and actively projects the required texture on the object surface for stereo matching, which has high spatial resolution and accuracy. According to the method of 3D data measurement, 3D detection technology is divided into four types: stereoscopic vision measurement, photometric stereo, laser scanner measurement, and structural light measurement.

References

  1. Li, N.; Wang, F.; Song, G. New entropy-based vibro-acoustic modulation method for metal fatigue crack detection: An exploratory study. Measurement 2020, 150, 1–9.
  2. Li, Q.; Chen, J.; Zhao, L. Research on an improved metal surface defect detection sensor based on a 3D RFID tag antenna. J. Sens. 2020, 2020, 1–13.
  3. Lv, X.; Duan, F.; Jiang, J.; Fu, X.; Gan, L. Deep metallic surface defect detection: The new benchmark and detection network. Sensors 2020, 20, 1562.
  4. Lv, X.; Duan, F.; Jiang, J.; Fu, X.; Gan, L. Deep active learning for surface defect detection. Sensors 2020, 20, 1650.
  5. Ghorai, S.; Mukherjee, A.; Gangadaran, M.; Dutta, P.K. Automatic defect detection on hot-rolled flat steel products. IEEE Trans. Instrum. Meas. 2013, 62, 612–621.
  6. Song, K.; Yan, Y. A noise robust method based on completed local binary patterns for hot-rolled steel strip surface defects. Appl. Surf. Sci. 2013, 285, 858–864.
  7. Luo, Q.; Sun, Y.; Li, P.; Simpson, O.; Tian, L.; He, Y. Generalized completed local binary patterns for time-efficient steel surface defect classification. IEEE Trans. Instrum. Meas. 2019, 68, 667–679.
  8. He, D.; Xu, K.; Zhou, P.; Zhou, D. Surface defect classification of steels with a new semi-supervised learning method. Opt. Lasers Eng. 2019, 117, 40–48.
  9. Xue Wu Zhang; Fang Gong; Li Zhong Xu; Inspection of surface defects in copper strip using multivariate statistical approach and SVM. International Journal of Computer Applications in Technology 2012, 43, 44, 10.1504/ijcat.2012.045840.
  10. He Ying Wang; Jiawei Zhang; Ying Tian; Haiyong Chen; He Xu Sun; Kun Liu; A Simple Guidance Template-Based Defect Detection Method for Strip Steel Surfaces. IEEE Transactions on Industrial Informatics 2018, 15, 2798-2809, 10.1109/tii.2018.2887145.
  11. Youkachen, S.; Ruchanurucks, M.; Phatrapornnant, T.; Kaneko, H. Defect segmentation of hot-rolled steel strip surface by using convolutional auto-encoder and conventional image processing. In Proceedings of the 10th International Conference of Information and Communication Technology for Embedded Systems (IC-ICTES), Kasetsart University, Bangkok, Thailand, 25–27 March 2019; pp. 1–5.
  12. Hao Wu; Xiangrong Xu; Wenbin Gao; Uneven illumination surface defects inspection based on convolutional neural network. null 2019, null, 1-10.
  13. Sun, K.; Shen, Z.; Shi, Y.; Xu, Z.; Yuan, L.; Ni, X. Non-destructive detection of small blowholes in aluminum by using laser ultrasonics technique. In Proceedings of the 17th International Conference on Photothermal and Photoacoustic Phenomena, Suzhou, China, 20–24 October 2013; pp. 1181–1188.
  14. Xiao, R.; Wang, J.; Xie, X.; Guo, F.; Li, X. 3D center segregation reconstruction of steel continuous casting slab. Steel Res. Int. 2019, 90, 1–8.
  15. Ricci, M.; Ficola, A.; Fravolini, M.L.; Battaglini, L.; Palazzi, A.; Burrascano, P.; Valigi, P.; Appolloni, L.; Cervo, S.; Rocchi, C. Magnetic imaging and machine vision NDT for the on-line inspection of stainless steel strips. Meas. Sci. Technol. 2013, 24, 1–17.
  16. Ege, Y.; Bicakci, S.; Gunes, H.; Citak, H.; Coramik, M. An application of BRANN and MFL methods: Determining crack type and physical properties on M5 steel sheets. Measurement 2019, 138, 545–556.
  17. Yunze He; Mengchun Pan; Feilu Luo; Gui Yun Tian; Pulsed eddy current imaging and frequency spectrum analysis for hidden defect nondestructive testing and evaluation. NDT & E International 2011, 44, 344-352, 10.1016/j.ndteint.2011.01.009.
  18. Kishore, M.B.; Park, D.G.; Jeong, J.R.; Kim, J.Y.; Jacobs, L.J.; Lee, D.H. Detection of deep subsurface cracks in thick stainless steel plate. J. Magn. 2015, 20, 312–316.
  19. Harzallah, S.; Chabaat, M. 3D-FEM computation and experimental study of eddy currents for characterization of surface cracks. Int. J. Struct. Integr. 2017, 8, 603–610.
  20. Soni, A.K.; Rao, B.P. Lock-in amplifier based eddy current instrument for detection of sub-surface defect in stainless steel plates. Sens. Imaging 2018, 19, 1–11.
  21. Franz Pernkopf; Paul O'leary; Image acquisition techniques for automatic visual inspection of metallic surfaces. NDT & E International 2003, 36, 609-617, 10.1016/s0963-8695(03)00081-1.
  22. Christian Koch; Ioannis Brilakis; Pothole detection in asphalt pavement images. Advanced Engineering Informatics 2011, 25, 507-515, 10.1016/j.aei.2011.01.002.
  23. Xin Wen; Ke-Chen Song; Menghui Niu; Zhipeng Dong; Yun-Hui Yan; 3D inspection technology combining passive stereo matching and active structured light for steel plate surface sample. International Journal of Surface Science and Engineering 2017, 11, 299, 10.1504/ijsurfse.2017.087422.
More
Information
Contributors MDPI registered users' name will be linked to their SciProfiles pages. To register with us, please refer to https://encyclopedia.pub/register : , , , ,
View Times: 1.1K
Revisions: 2 times (View History)
Update Date: 18 Feb 2021
1000/1000