Additive manufacturing with an emphasis on 3D printing has recently become popular due to its exceptional advantages over conventional manufacturing processes. However, 3D printing process parameters are challenging to optimize, as they influence the properties and usage time of printed parts. Therefore, it is a complex task to develop a correlation between process parameters and printed parts’ properties via traditional optimization methods. A machine-learning technique was recently validated to carry out intricate pattern identification and develop a deterministic relationship, eliminating the need to develop and solve physical models. In machine learning, artificial neural network (ANN) is the most widely utilized model, owing to its capability to solve large datasets and strong computational supremacy.
Three-dimensional (3D) printing, under additive manufacturing, is a new, promising field that has gained prevalent attention in all fields . It involves layer-by-layer deposition via a computer-aided design (CAD) model. 3D printing has several advantages: (a) it can produce parts with complex shapes, which are difficult to produce using conventional manufacturing processes; (b) it can manufacture parts with novel characteristics ; and (c) it decreases the material surplus, reducing the manufacturing cost. These are the reasons why 3D printing has become popular in a very short timeframe. However, 3D-printed parts also contain defects that are very different from those generated by conventional methods. There are various types of defects, including porosity, anisotropy in the microstructure, and part distortion, resulting from high residual stresses due to rapid heating and slow conduction . Hence, it is essential to understand the correlation among the material metallurgical characteristics, printing parameters, microstructure, and properties of 3D-printed parts. There are various essential parameters, e.g., laser power, laser scanning speed, hatch distance between two adjacent layers, powder flow rate, etc., which influence the properties of the final produced parts. Inappropriately, the link between process parameters and the quality of the printed part is very complex and therefore difficult to understand.
Various data-driven models, known as machine learning, have been adopted widely in the domain of 3D printing. The main advantage of such models is that there is no need to develop a long list of multi-physics equations. Instead, they automatically learn the correlation between the inputs and outputs based on the data provided for training. In machine learning, artificial neural network (ANN) is the most commonly used algorithm and is under continuous development due to the availability of enormous databases and computational resources . For instance, ANNs are continuously evolving in the fields of machine vision , vocal recognition , language processing , and self-governing driving . Moreover, there is a new trend for implementing ANN in the 3D printing field.
2. Applications of ANN in 3D Printing
The 3D printing process combines several aspects, including the design of the model, selection of material, printing process, and manufactured part evaluation and characterization. This section combines the application of ANN for the 3D printing process in the case of procedure monitoring, designing, and the correlation between process parameters and final characteristics of the obtained component.
2.1. Process Monitoring
Process monitoring via various sensors, during the printing process, usually provides direct information w.r.t quality supervision and control. Three types of data sources can be identified as: (a) one-dimensional, such as spectra; (b) two-dimensional, such as graphs and images; and (c) three-dimensional, such as morphologies . One-dimensional data can be processed faster but provide less information compared to two- and three-dimensional data. Shevchik et al.  investigated the possibility to use acoustic emission to monitor quality by combining the acoustic emission sensor with the ANN. Figure 1 shows a schematic of the workflow used to monitor the quality during the printing process.
A fiber Bragg grating sensor was used to record the signals during the selective laser melting process. Low-, medium-, and best-quality parts were intentionally produced by process parameters tuning. The singles obtained were classified for training and testing. The convolutional ANN was used for this purpose. The inputs of this model were narrow frequency bands, while the outputs were the classification of the printed part of high, medium, or low quality. It was found that the convolutional ANN can give a result with accuracies of 83, 85, and 89% for high-, medium-, and poor-quality workpieces, respectively, as shown in Figure 2.
Zhang et al.  used a high-speed camera for the collection of process images. This system can also be called a visual system. This setup was able to collect three pieces of information: (a) melt-pool, (b) plasma plume, and (c) spatter formation. The features were sensibly taken out from the images after feeding them into a conventional ML algorithm. The algorithm proposed by the authors is presented in Figure 3. Further, the authors observed that even though the convolutional ANN model does not need a feature extraction step, it still can predict results with 92.7% accuracy. It makes convolutional ANN a potential candidate for real-time monitoring in the 3D printing process.
Figure 3. Schematic used by Zhang et al.  to train a convolutional ANN based on the image processing technique.
The detection of flaws through human-created, condition-based algorithms requires an in-depth understanding of the printing process as well as computer vision knowledge. Such condition-based algorithms are more restrictive; new algorithms have to be generated when new materials become available or when new part geometries are introduced, as this method needs to consider the interactions between various parameters. The reliance on the human operator makes condition-based algorithms less practical. ANN allows anomaly detection through a large dataset of good printing samples and bad printing samples, and the detection capability can be improved by adding new training data. As most in situ monitoring use cameras to acquire information about the printing condition, defect detection relies heavily on the capability of computer vision (CV). The most used ANN technique in computer vision is CANN, although other techniques have been used as well. For instance, Scime and Beuth  used scale-invariant feature transform (SIFT) to extract melt-pool features. They adopted various feature extraction techniques such as a bag of words (BOW) or histogram of oriented gradients (HOG) clustering to extract useful features from images and feature vectors. The feature vector was then fed to the SVM image classification algorithm to learn the defects, such as under-melting, key-holing, and balling . They also attempted to use ANN techniques with CV to detect anomalies such as re-coater hopping and streaking, debris, superelevation, part failure, and incomplete powder spreading. Although the ANN algorithm can predict no anomalies with 100% accuracy, the algorithm was not able to predict re-coater streaking with high accuracy (50.6%). They compared the BOW technique with multiscale CANN (MCANN) and found that MCANN can achieve higher classification accuracies, though it is more computationally expensive (75% slower). Self-organizing error-driven ANN (SEANN), a combination of SOM and ANN, is found to be more accurate in classifying porosity defects than a k-nearest neighbor (KNN) algorithm and multilayer perceptron (MLP) . Ye et al.  used a deep belief algorithm that consisted of stacking-restricted Boltzmann machines (RBMs), which had undirected connections between its top two layers and directed connections between all following adjacent layers, classifying the plume and spatter with minimum pre-processing and no feature extraction. The deep belief algorithm could achieve an 83.4% accuracy. In another work, to extract melt-pool, plume, and splatter data, CANN (92.7%) was found to have higher classification accuracy compared to SVM (89.6%) and the combination of SVM and principal component analysis (PCA) (90.1%) .
Design is an important research topic that requires a comprehensive understanding of the capabilities and limitations of 3D printing techniques. It is the first and critical step in the process workflow. A good CAD model design would not only ensure the printability but would also reduce the amount of support material when needed. However, the design process is normally iterative and time-consuming. A data-driven design for 3D printing would help designers in the design process. Maidin et al.  showed that the design feature database provided ideas and design features for less-experienced designers. The use of the ANN technique in 3D printing enables feature recommendations to existing CAD models, helping the designers to speed up the decision-making process during the design stage. For instance, Yao et al.  conceived a hybrid ANN algorithm, which used hierarchical clustering to classify 3D printing design features and a support vector machine (SVM) to enhance the hierarchical clustering results in the pursuit of the recommended design features. It helped inexperienced designers new to 3D printing to determine suitable design features for remote-controlled car components without actual physical trials and errors. Apart from that, ANN algorithms have been used for the feature recognition of CAD models and the manufacturability analysis of 3D printing. Heat kernel signature and the multiscale clustering method were used by Shi et al. to detect possible design faults in a particular CAD model . A double-layered extreme ANN (DLEANN) was used by Zhang et al. to determine ideal print orientation to avoid putting support structures on user-preferred features . In this DLEANN, the first layer was the classification to evaluate the relative score between the various part orientations, and the second layer was the regression to construct a global score for all printing directions. It was found to be able to identify the best printing directions with minimum visual artifacts due to support removal. Williams et al.  optimized the build orientation, and CANN was found to be better in terms of accuracy and consistency at predicting build time and part mass than the baseline linear regression model. Advancements in numerical simulations have allowed CAD models to be evaluated digitally before they are fabricated and tested physically, reducing the cost and time spent in experiments. However, numerical simulations can be computationally costly and time-consuming with complex processes, making online monitoring of the printing processes not feasible. Data-driven models have potential in predicting the final properties of the printed parts. Khadilkar et al.  used a deep-learning-based (DL) ANN framework to estimate stress distribution on the cured layer from selective laser sintering in almost real-time. In this attempt, a 3D model database that contained a wide range of geometric features was firstly generated. FE simulations on the 16,700 3D-printed models were then used to generate data labels to train the DL-ANN. They found that a two-stream CANN outperforms a single-stream CANN and ANN. Despite this, Koeppe et al.  used ANN to learn a parameterized mechanical model of cellular lattice structures, which includes their linear elastoplastic mechanical behavior to predict maximum von Mises and equivalent principal stresses in the struts and joints (Figure 4). The data-driven stress prediction took about 0.47 s, which was significantly shorter in comparison with the FE simulation, which took 5–10 h. The trained ANN models can potentially be incorporated into existing FE simulation frameworks to simulate the structural performance of larger parts of various scales.
Figure 4. Overview of applying ANN for highly efficient numerical modeling . (a) Experimental test to confirm the FE simulation results. (b) FE simulation results used as input for ANN. (c) ANN architecture containing one fully connected layer followed by two long-short-term memory (LSTM) cells, followed by another fully connected layer. (d) Schematics of fully connected layers. (e) Schematics of LSTM. (f) Comparison with FE simulation showing ANN capability in predicting stresses; with permission from Elsevier.
Chowdhury and Sam  explained that ANN algorithms could learn the thermal deformation of 3D printing processes and provide appropriate geometric compensation to the models for printing. Meng et al.  used 3D printing for the development of new designs, such as biomimetic structures. In particular, composite structures could now be tuned rapidly. ANN algorithms were demonstrated to be suitable for such areas, especially in tuning material properties and the capability to generate new designs that outperform existing composites available in the dataset by . CANN was used to predict the stiffness and toughness of the composite. ANN simulation, which includes the training (n = 80,000) and predictive (n = 20,000) phases, is found to be 250 times quicker compared to FE simulations. It is shown that a small amount of training data is sufficient to obtain an ANN model with high accuracy. Furthermore, obtaining an optimal design for the composite remains possible with incomplete information.
The entry is from 10.3390/ma14010163
- Lu, S.; Zhou, L.N.; Wang, Z. Damage Evolution of Concrete by Electrical Resistivity Monitoring Methods. Appl. Mech. Mater. 2015, 796, 85–89.
- Derby, B. Additive Manufacture of Ceramics Components by Inkjet Printing. Engineering 2015, 1, 113–123.
- Gu, D.; Ma, C.; Xia, M.; Dai, D.; Shi, Q. A Multiscale Understanding of the Thermodynamic and Kinetic Mechanisms of Laser Additive Manufacturing. Engineering 2017, 3, 675–684.
- Herzog, D.; Seyda, V.; Wycisk, E.; Emmelmann, C. Additive manufacturing of metals. Acta Mater. 2016, 117, 371–392.
- Liu, L.; Ding, Q.; Zhong, Y.; Zou, J.; Wu, J.; Chiu, Y.L.; Li, J.; Zhang, Z.; Yu, Q.; Shen, Z. Dislocation network in additive manufactured steel breaks strength–ductility trade-off. Mater. Today 2018, 21, 354–361.
- Mahmood, M.A.; Popescu, A.C.; Hapenciuc, C.L.; Ristoscu, C.; Visan, A.I.; Oane, M.; Mihailescu, I.N. Estimation of clad geometry and corresponding residual stress distribution in laser melting deposition: Analytical modeling and experimental correlations. Int. J. Adv. Manuf. Technol. 2020, 111, 77–91.
- Lecun, Y.; Bengio, Y.; Hinton, G. Deep learning. Nature 2015, 521, 436–444.
- Krizhevsky, A.; Sutskever, I.; Hinton, G.E. ImageNet classification with deep convolutional neural networks. In Proceedings of the Advances in Neural Information Processing Systems, Lake Tahoe, NV, USA, 3–6 December 2012; Volume 2, pp. 1097–1105.
- Anusuya, M.; Katti, S. Speech recognition by machine, a review. Int. J. Comput. Sci. Inf. Secur. 2010, 6, 181–205.
- Devlin, J.; Chang, M.; Lee, K.; Toutanova, K. Bert: Pre-training of deep bidirectional transformers for language understanding. In Proceedings of the NAACL-HLT 2019, Minneapolis, MN, USA, 1 June–7 June 2019; pp. 4171–4186.
- Ondruska, P.; Posner, I. Deep tracking: Seeing beyond seeing using recurrent neural networks. In Proceedings of the AAAI-16 Conference, Phoenix, AZ, USA, 12–17 February 2016.
- Everton, S.K.; Hirsch, M.; Stavroulakis, P.I.; Leach, R.K.; Clare, A.T. Review of in-situ process monitoring and in-situ metrology for metal additive manufacturing. Mater. Des. 2016, 95, 431–445.
- Wasmer, K.; Le-Quang, T.; Meylan, B.; Shevchik, S.A. In Situ Quality Monitoring in AM Using Acoustic Emission: A Reinforcement Learning Approach. J. Mater. Eng. Perform. 2019, 28, 666–672.
- Shevchik, S.A.; Kenel, C.; Leinenbach, C.; Wasmer, K. Acoustic emission for in situ quality monitoring in additive manufacturing using spectral convolutional neural networks. Addit. Manuf. 2018, 21, 598–604.
- Zhang, Y.; Hong, G.S.; Ye, D.; Zhu, K.; Fuh, J.Y.H. Extraction and evaluation of melt pool, plume and spatter information for powder-bed fusion AM process monitoring. Mater. Des. 2018, 156, 458–469.
- Scime, L.; Beuth, J. A multi-scale convolutional neural network for autonomous anomaly detection and classification in a laser powder bed fusion additive manufacturing process. Addit. Manuf. 2018, 24, 273–286.
- Scime, L.; Beuth, J. Anomaly detection and classification in a laser powder bed additive manufacturing process using a trained computer vision algorithm. Addit. Manuf. 2018, 19, 114–126.
- Scime, L.; Beuth, J. Using machine learning to identify in-situ melt pool signatures indicative of flaw formation in a laser powder bed fusion additive manufacturing process. Addit. Manuf. 2019, 25, 151–165.
- Jafari-Marandi, R.; Khanzadeh, M.; Tian, W.; Smith, B.; Bian, L. From in-situ monitoring toward high-throughput process control: Cost-driven decision-making framework for laser-based additive manufacturing. J. Manuf. Syst. 2019, 51, 29–41.
- Ye, D.; Hsi Fuh, J.Y.; Zhang, Y.; Hong, G.S.; Zhu, K. In situ monitoring of selective laser melting using plume and spatter signatures by deep belief networks. ISA Trans. 2018, 81, 96–104.
- Bin Maidin, S.; Campbell, I.; Pei, E. Development of a design feature database to support design for additive manufacturing. Assem. Autom. 2012, 32, 235–244.
- Yao, X.; Moon, S.K.; Bi, G. A hybrid machine learning approach for additive manufacturing design feature recommendation. Rapid Prototyp. J. 2017, 23, 983–997.
- Shi, Y.; Zhang, Y.; Baek, S.; De Backer, W.; Harik, R. Manufacturability analysis for additive manufacturing using a novel feature recognition technique. Comput. Aided Des. Appl. 2018, 15, 941–952.
- Zhang, X.; Le, X.; Panotopoulou, A.; Whiting, E.; Wang, C.C.L. Perceptual models of preference in 3D printing direction. ACM Trans. Graph. 2015, 34, 1–12.
- Williams, G.; Meisel, N.A.; Simpson, T.W.; McComb, C. Design repository effectiveness for 3D convolutional neural networks: Application to additive manufacturing. J. Mech. Des. Trans. ASME 2019, 141.
- Khadilkar, A.; Wang, J.; Rai, R. Deep learning–based stress prediction for bottom-up SLA 3D printing process. Int. J. Adv. Manuf. Technol. 2019, 102, 2555–2569.
- Koeppe, A.; Hernandez Padilla, C.A.; Voshage, M.; Schleifenbaum, J.H.; Markert, B. Efficient numerical modeling of 3D-printed lattice-cell structures using neural networks. Manuf. Lett. 2018, 15, 147–150.
- Chowdhury, S.; Anand, S. Artificial Neural Network Based Geometric Compensation for Thermal Deformation in Additive Manufacturing Processes; ASME International: New York, NY, USA, 2016.
- Meng, L.; Zhao, J.; Lan, X.; Yang, H.; Wang, Z. Multi-objective optimisation of bio-inspired lightweight sandwich structures based on selective laser melting. Virtual Phys. Prototyp. 2020, 15, 106–119.
- Gu, G.X.; Chen, C.T.; Richmond, D.J.; Buehler, M.J. Bioinspired hierarchical composite design using machine learning: Simulation, additive manufacturing, and experiment. Mater. Horiz. 2018, 5, 939–945.
- Gu, G.X.; Chen, C.T.; Buehler, M.J. De novo composite design based on machine learning algorithm. Extrem. Mech. Lett. 2018, 18, 19–28.