5.1. Single ANN Model
This study first investigates the performance of a single ANN in warpage prediction. To optimize the network architecture, a comprehensive grid search was conducted, with the hyperparameter search space established based on our prior methodology [
23]. The hyperparameter search space is summarized in , and the selected optimal combination is listed in . Two sets of test samples were used for the evaluation, as illustrated in .
Figure 12.
The two test designs used for the detailed illustration: (a) Test Sample 1, bowl-dominant; and (b) Test Sample 2, saddle-dominant.
Table 10.
Grid search range of ANN hyperparameters.
Table 11.
Single ANN hyperparameters.
The prediction was first performed on Test Sample 1, with the results presented in and . MAE and MAPE denote the mean absolute and mean absolute percentage error, each averaged over the N = 1089 spatial points of a design; the maximum error and its percentage refer to the single worst point. While the mean testing error was relatively low, the maximum testing error reached 10.69%, corresponding to 265.07 µm. The error surface in b shows that the largest deviations occur at the outer regions of the package.
Figure 13.
Test Sample 1 predicted by the ungated baseline: (a) predicted warpage field; and (b) absolute error surface. Axes in mm, warpage and error in µm.
Table 12.
Prediction performance of the single ANN model on Test Sample 1 and Test Sample 2.
Subsequently, warpage prediction was performed for Test Sample 2. The prediction results for Test Sample 2 are given in and , in which a shows the predicted warpage field and b the corresponding error surface [
21]. As in the previous case, larger prediction errors are observed in the outer regions of the package.
Figure 14.
Test Sample 2 predicted by the ungated baseline: (a) predicted warpage field; and (b) absolute error surface. Axes in mm, warpage and error in µm.
The overall prediction results, along with observations from the training dataset, indicate that using a single ANN for warpage prediction may lead to significant errors, particularly at the outer regions of the FO-PLP. This is primarily because the relationship between geometric parameters and the spatial warpage field differs significantly between the bowl-shaped and saddle-shaped deformation modes. As a result, a single ANN trained on mixed modes tends to average these behaviors, leading to larger prediction deviations, particularly near the panel edges.
To address this issue, this study proposes a warpage prediction approach based on Ensemble Learning. The predicted probabilities of different possible warpage modes, obtained using a Random Forest, are used as weights to integrate the outputs of multiple ANN models, thereby improving the overall prediction accuracy.
5.2. Hybrid Machine Learning
To address the large prediction errors observed in the outer regions of the package, this study introduces a hybrid warpage prediction approach. Prior to predicting the warpage magnitude, a Random Forest is employed to estimate the probability of each warpage mode for a given sample. These probabilities are then used as weights in the subsequent prediction stage to guide the ANN models.
Two separate ANN models are trained using datasets corresponding to different warpage modes. Before ANN training, cluster analysis is applied to reduce the number of data points in the training set, thereby simplifying the dataset and improving the computational efficiency. Each sample is then predicted using both ANN models.
Finally, the outputs of the two ANN models are combined using probability-weighted integration based on the warpage mode probabilities predicted by the Random Forest. Since the predicted probabilities satisfy PB + PS = 1, the final output can be interpreted as the expected warpage field conditioned on the given geometric parameters. The overall workflow of the proposed hybrid model is illustrated in . It consists of three stages: the warpage mode probability estimation, data reduction combined with warpage prediction, and weighted result integration.
Figure 15.
Workflow of the hybrid machine learning method. Blue for pattern probability, green for reducing points, purple for warpage prediction, and orange for weight distribution.
The first stage of the proposed workflow is the estimation of the warpage mode probability. A Random Forest model is trained using five geometric features. The hyperparameters used in the Random Forest training are listed in .
Table 13.
Hyperparameters of Random Forest.
To validate the classification capability of the framework, the Random Forest classifier was evaluated under stratified five-fold cross-validation. The classifier achieves an accuracy of 95.9%, an area under the ROC curve of 0.995, and an out-of-bag accuracy of 98.8%, as detailed in . Furthermore, it correctly identified the expected mode in every one of the sixteen independent test designs evaluated in this study.
Table 14.
Cross-validated classification performance of the Random Forest over the 243 labeled designs.
After training and validation, the model is used to predict the probability of possible warpage modes for specific test samples. Test Sample 1 is first input into the trained Random Forest model. As shown in , the predicted probability for the bowl-shaped pattern is 1, while that for the saddle-shaped pattern is 0, which is consistent with the ground truth. Similarly, Test Sample 2 is then input into the model. The predicted probability for the saddle-shaped pattern is 0.97, also matching the true label. Meanwhile, the bowl-shaped pattern is predicted with a probability of 0.03.
Table 15.
Predicted warpage-mode probabilities for the two representative test designs.
Compared to directly outputting a single class label, providing classification probabilities preserves the model’s confidence in each class, enabling more nuanced and informative decision-making in the subsequent prediction stage. Upon completing the warpage mode probability prediction, the next steps involve the data reduction and warpage prediction stage, followed by the weighted integration stage.
Since different values of
K can affect the clustering quality and data representation, comparing multiple
K values provides a more effective reflection of the underlying data characteristics. As noted by Pham et al. [
38], when the ratio of
K to
N (
K/
N) is too small, the clustering structure may be insufficient; conversely, a large
K/
N ratio may undermine the purpose of data reduction. In this study, this principle is applied to the spatial warpage field, where
N denotes the number of spatial data points per sample (1089 points from the 33 × 33 full array).
Therefore, the K/N ratio is set between 3.33% and 20%, corresponding to K values of approximately 30–200. For each fixed K value, a grid search is conducted to determine the optimal hyperparameters for the corresponding ANN, enabling a comprehensive comparison of the prediction performance across different K values.
The model architecture consists of two distinct neural networks: ANN model 0 and ANN model 1. ANN model 0 is trained using samples with bowl-shaped warpage, while ANN model 1 is trained using samples with saddle-shaped warpage. Accordingly, the impact of K is analyzed and compared independently for each model. The workflow combining clustering analysis with neural network prediction is illustrated in .
Figure 16.
Cluster analysis combined with the two mode-specific networks: (a) ANN model 0; and (b) ANN model 1. Colors and shapes follow the convention of .
ANN model 0 was initially evaluated at 𝐾=30, 40, and 50, with the analysis subsequently extended to 𝐾=100 and higher; the complete results are summarized in . The mean testing error stabilized below 6% for 𝐾≥40, while the maximum testing error stabilized for 𝐾≥50, with only marginal changes in the prediction performance at larger 𝐾 values. These results indicate that the predictive accuracy of ANN model 0 converges as 𝐾 exceeds 50. Accordingly, 𝐾=50 was selected as the minimum viable number of clusters for ANN model 0.
Table 16.
Performance of ANN model 0 with varying K values (K = 30 to 100, 150, and 200).
ANN model 1 was evaluated over the same range, first at K = 30, 40, and 50, and then up to K = 100 and beyond; the complete sweep is summarized in . The mean testing error approaches 3% once K exceeds 50, but both the mean and the maximum errors continue to fluctuate until K = 70, beyond which they remain essentially unchanged. The prediction accuracy of ANN model 1 therefore stabilizes above K = 70, which is taken as the minimum stable K for this model. Selecting the smallest K at which the accuracy has stabilized avoids unnecessary computation without sacrificing the prediction quality.
Table 17.
Performance of ANN model 1 with varying K values (K = 30 to 100, 150, and 200).
The results indicate that, once
K exceeds a threshold, the prediction accuracy of K-means combined with the ANN stabilizes. Above that threshold, the remaining variation is not systematic. Repeating this evaluation at every
K in the grid search gives a mean test error of 5.28 ± 0.39% for ANN model 0 and 3.74 ± 0.19% for ANN model 1 above the minimum stable
K, as shown in . This confirms the reproducibility of the selected operating point, and that further increases in
K yield no systematic improvement in accuracy. This phenomenon reflects the diminishing-return regime [
43,
44,
45], which motivates selecting the smallest stable
K. The point at which the accuracy first stabilizes is therefore adopted as the minimum stable
K, which maximizes the data reduction while keeping the prediction accuracy within an acceptable range and balancing performance against computational efficiency.
Table 18.
Dispersion of the test error over independently optimized configurations.
For each model, the selected K value corresponds to its minimum viable value. The clustering hyperparameters used are listed in . For ANN model 0 and ANN model 1, the minimum viable K values are 50 and 70, respectively. The optimal hyperparameter settings for each ANN model, obtained through a grid search, are presented in and .
Table 19.
Hyperparameter of K-means.
Table 20.
Optimal hyperparameters of ANN model 0 at K = 50.
Table 21.
Optimal hyperparameters of ANN model 1 at K = 70.
By employing this data selection strategy, the training time was significantly reduced from 443 s required by the original single neural network to approximately 42 s in total (19 s for ANN model 0 and 23 s for ANN model 1). The additional computational cost of Random Forest classification and K-means clustering is relatively minor compared to ANN training, achieving an overall reduction of about 90% in training cost. The training time scales linearly with the number of clusters K over the full range tested, as summarized in and illustrated in . At the selected K, the training set falls from 264,627 to 15,190 pointwise entries, a 94.3% reduction, consistent with the 90.4% reduction in network training time.
Figure 17.
Measured training time of the two mode-specific networks against the number of clusters K. The vertical dashed lines represent K = 50 (blue) and K = 70 (red).
Table 22.
Training points, iterations, and measured training time versus the number of clusters.
Next, all test samples are individually input into the two artificial neural network models within the ensemble learning framework. The prediction results from the two models are integrated using a weighted calculation, as defined in Equation (1).
The prediction from ANN model 0, trained on bowl-shaped warpage samples, is denoted as
W0, while the prediction from ANN model 1, trained on saddle-shaped warpage samples, is denoted as
W1. The corresponding Random Forest probabilities are
PB and
PS, respectively. The final warpage prediction W is obtained as follows:
where
PB +
PS = 1.
The results for Test Sample 1 are presented in . ANN model 0 effectively predicts the warpage due to its training on bowl-shaped warpage data, while ANN model 1, trained exclusively on saddle-shaped warpage, exhibits larger prediction deviations.
Table 23.
Performance of the mode-specific networks and of the fused prediction on the two representative test designs.
By applying ensemble learning, the predictions from both models are weighted according to their respective warpage mode probabilities and then summed. Since the Random Forest predicted PB = 1 and PS = 0 for Test Sample 1, the ensemble result is mathematically equivalent to the prediction of ANN model 0 alone. The resulting integrated prediction demonstrates an improved accuracy compared to the single ANN baseline, with the average testing error reduced from 6.45% to 4.77%, and the maximum testing error reduced from 10.69% to 5.76%. The predicted warpage distribution and corresponding surface error map are shown in .
Figure 18.
Test Sample 1 predicted by the proposed framework: (a) predicted warpage field; and (b) absolute error surface. Axes in mm, warpage and error in µm.
The prediction results for Test Sample 2 are also presented in . Since ANN model 0 was trained solely on bowl-shaped warpage data, its prediction deviated significantly from the actual values. In contrast, ANN model 1 accurately captured the sample’s warpage trend. After weighted integration, the overall prediction performance improved compared to using a single ANN model. The average testing error was reduced to 3.49%, and the maximum testing error was improved to 3.82%. The warpage prediction and corresponding surface error maps are shown in .
Figure 19.
Test Sample 2 predicted by the proposed framework: (a) predicted warpage field; and (b) absolute error surface. Axes in mm, warpage and error in µm.
To further evaluate the proposed framework across the design space, 16 held-out designs, including five bowl-dominant and eleven saddle-dominant cases, not represented in the training set, were analyzed. presents the classifier probability of the saddle-shaped mode and the corresponding prediction errors of both the ungated baseline and the proposed framework, while summarizes the overall performance. As shown in , the proposed framework achieved lower mean and maximum absolute errors than the baseline for all 16 designs, yielding average reductions of 38.5% and 31.9%, respectively. Moreover, applying a network trained for the opposite warpage mode increased the mean absolute error by a factor of 5.9, from 30.71±5.24 µm to 181.17±64.49 µm, demonstrating the effectiveness of mode-specific network specialization.
Figure 20.
Per-design comparison of the ungated baseline and the proposed framework over the sixteen held-out test designs: (a) mean absolute error; and (b) maximum absolute error.
Table 24.
Ungated baseline and proposed framework on sixteen held-out designs.
Table 25.
Aggregate performance over the sixteen designs (mean ± standard deviation).
An ablation study compared the probability-weighted fusion against a hard arg-max switch over the eleven non-degenerate designs. As detailed in , the soft gate gave the lower mean error in seven of eleven cases, by 2.82% on average. This benefit is concentrated near the classifier’s decision boundary rather than in the average accuracy for confidently classified designs, as illustrated in . Because using the wrong expert is 5.9 times worse, replacing the hard gate with the classifier’s cross-validated accuracy of 95.9% would raise the expected mean error by 20.1%. Thus, retaining the probabilities buys robustness at a negligible cost where the classification is already confident.
Figure 21.
Behavior of the two gating schemes: (a) mean absolute error with the correct versus the wrong mode-specific network; and (b) prediction error as a function of the classifier probability of the true mode. The vertical dashed line represents the decision threshold where the classifier probability equals 0.5.
Table 26.
Probability-weighted fusion compared with hard switching over the eleven non-degenerate designs.