Operations Research Transactions >
2021 , Vol. 25 >Issue 2: 1 - 14
DOI: https://doi.org/10.15960/j.cnki.issn.1007-6093.2021.02.001
Combined response surface method with adaptive sampling for expensive black-box global optimization
Received date: 2020-09-17
Online published: 2021-05-06
A combined response surface method is presented for expensive black-box global optimization, which can adaptively take sampling points during iterations. Under the framework of response surface method, the convex combination of the cubic radial basis function and the thin plate spline radial basis function is adopted as the response surface. In the initial phase of the algorithm, the global optimizer of the auxiliary function formed by the product of the response surface model and the power of the distance indicator function will be taken as the new sample point. In the following iterations, if the distance between the two response surface models of the two consecutive iterations is smaller than a given threshold, then the global optimizer of the current response surface model will be taken as the next sample point, otherwise the sampling strategy of the initial phase will be adopted. The effectiveness of the proposed algorithm is demonstrated by the results of the numerical experiments carried respectively on 7 standard test problems and 22 standard test problems.
Fusheng BAI, Dan FENG, Ke ZHANG . Combined response surface method with adaptive sampling for expensive black-box global optimization[J]. Operations Research Transactions, 2021 , 25(2) : 1 -14 . DOI: 10.15960/j.cnki.issn.1007-6093.2021.02.001
| 1 | Myers R H , Montgomery D C . Response Surface Methodology: Process and Product Optimization Using Designed Experiments[M]. New York: Wiley, 1995. |
| 2 | Khuri A I , Cornell J A . Response Surfaces[M]. New York: Marcel Dekker Inc., 1987. |
| 3 | Jones D R , Schonlau M , Welch W J . Efficient global optimization of expensive black-box functions[J]. Journal of Global Optimization, 1998, 13 (4): 455- 492. |
| 4 | Gutmann H M . A radial basis function method for global optimization[J]. Journal of Global Optimization, 2001, 19 (3): 201- 227. |
| 5 | Regis R G , Shoemaker C A . Constrained global optimization of expensive black box functions using radial basis functions[J]. Journal of Global Optimization, 2005, 31, 153- 171. |
| 6 | Regis R , Shoemaker C . A stochastic radial basis function method for the global optimization of expensive functions[J]. INFORMS Journal on Computing, 2007, 19, 497- 509. |
| 7 | Xiang H , Li Y , Liao H , et al. An adaptive surrogate model based on support vector regression and its application to the optimization of railway wind barriers[J]. Structural and Multidisciplinary Optimization, 2017, 55, 701- 713. |
| 8 | Crino S , Brown D E . Global optimization with multivariate adaptive regression splines[J]. IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics), 2007, 37 (2): 333- 340. |
| 9 | Jie H , Wu Y , Ding J . An adaptive metamodel-based global optimization algorithm for blackbox type problems[J]. Engineering Optimization, 2015, 47 (11): 1459- 1480. |
| 10 | Zhou Z , Bai F S . An adaptive framework for costly black-box global optimization based on radial basis function interpolation[J]. Journal of Global Optimization, 2018, 70 (4): 757- 781. |
| 11 | Powell M J D. The theory of radial basis function approximation in 1990[D]. Oxford: Oxford University, 1992. |
| 12 | Dixon L C W , Szeg? G P . Towards Global Optimisation[M]. Amsterdam: North-Holland Publishing Company, 1978. |
| 13 | Schoen F . A wide class of test functions for global optimization[J]. Journal of Global Optimization, 1993, 3 (2): 133- 137. |
| 14 | T?rn A , Zilinskas A . Global Optimization[M]. Berlin: Springer-Verlag, 1989. |
| 15 | Surjanovic S, Bingham D. Virtual library of simulation experiments: Test functions and datasets[EB/OL]. (2020-08-25)[2013-03-23]. http://www.sfu.ca/~ssurjano. |
| 16 | Dolan E D , Moré J J . Benchmarking optimization software with performance profiles[J]. Mathematical Programming, 2001, 91 (2): 201- 213. |
| 17 | Moré J J , Wild S M . Benchmarking derivative-free optimization algorithms[J]. SIAM Journal on Optimization, 2009, 20 (1): 172- 191. |
/
| 〈 |
|
〉 |