Leveraging the nugget parameter for efficient Gaussian process modeling |
| |
Authors: | Ramin Bostanabad Tucker Kearney Siyu Tao Daniel W. Apley Wei Chen |
| |
Affiliation: | 1. Department of Mechanical Engineering, Northwestern University, Evanston, Illinois, USA;2. Department of Industrial Engineering and Management Sciences, Northwestern University, Evanston, Illinois, USA;3. Department of Materials Science and Engineering, Northwestern University, Evanston, Illinois, USA |
| |
Abstract: | Gaussian process (GP) metamodels have been widely used as surrogates for computer simulations or physical experiments. The heart of GP modeling lies in optimizing the log‐likelihood function with respect to the hyperparameters to fit the model to a set of observations. The complexity of the log‐likelihood function, computational expense, and numerical instabilities challenge this process. These issues limit the applicability of GP models more when the size of the training data set and/or problem dimensionality increase. To address these issues, we develop a novel approach for fitting GP models that significantly improves computational expense and prediction accuracy. Our approach leverages the smoothing effect of the nugget parameter on the log‐likelihood profile to track the evolution of the optimal hyperparameter estimates as the nugget parameter is adaptively varied. The new approach is implemented in the R package GPM and compared to a popular GP modeling R package ( GPfit) for a set of benchmark problems. The effectiveness of the approach is also demonstrated using an engineering problem to learn the constitutive law of a hyperelastic composite where the required level of accuracy in estimating the response gradient necessitates a large training data set. |
| |
Keywords: | computer experiments Gaussian process hyperparameter estimation ill‐conditioned matrix nugget parameter |
|
|