求解昂贵黑箱全局优化问题的自适应采样组合响应面方法

展开
  • 1. 重庆师范大学数学科学学院, 重庆 401331
白富生 E-mail: fsbai@cqnu.edu.cn

收稿日期: 2020-09-17

  网络出版日期: 2021-05-06

基金资助

国家自然科学基金(11991024);国家自然科学基金(11871128);重庆市自然科学基金(cstc2019jcyj-msxmX0368);重庆市自然科学基金(cstc2018jcyjAX0172)

Combined response surface method with adaptive sampling for expensive black-box global optimization

Expand
  • 1. School of Mathematical Sciences, Chongqing Normal University, Chongqing 401331, China

Received date: 2020-09-17

  Online published: 2021-05-06

摘要

针对昂贵黑箱全局优化问题,提出了可以在迭代中进行自适应采样的组合响应面方法。在响应面方法的框架下,采用三次径向基函数和薄板样条径向基函数的凸组合作为响应面。在算法的初始迭代阶段,将响应面模型和距离指示函数的幂的乘积构成的辅助函数的全局最优点作为新采样点。在接下来的迭代中,如果连续两次迭代中响应面模型的全局最优点之间的距离小于预先给定的阈值,则将当前响应面的全局最优点作为下一个采样点,否则将采用初始迭代阶段的采样策略得到新采样点。分别在7个标准测试问题上和22个标准测试问题上进行了数值实验,计算结果说明了所提算法的有效性。

本文引用格式

白富生, 冯丹, 张柯 . 求解昂贵黑箱全局优化问题的自适应采样组合响应面方法[J]. 运筹学学报, 2021 , 25(2) : 1 -14 . DOI: 10.15960/j.cnki.issn.1007-6093.2021.02.001

Abstract

A combined response surface method is presented for expensive black-box global optimization, which can adaptively take sampling points during iterations. Under the framework of response surface method, the convex combination of the cubic radial basis function and the thin plate spline radial basis function is adopted as the response surface. In the initial phase of the algorithm, the global optimizer of the auxiliary function formed by the product of the response surface model and the power of the distance indicator function will be taken as the new sample point. In the following iterations, if the distance between the two response surface models of the two consecutive iterations is smaller than a given threshold, then the global optimizer of the current response surface model will be taken as the next sample point, otherwise the sampling strategy of the initial phase will be adopted. The effectiveness of the proposed algorithm is demonstrated by the results of the numerical experiments carried respectively on 7 standard test problems and 22 standard test problems.

参考文献

1 Myers R H , Montgomery D C . Response Surface Methodology: Process and Product Optimization Using Designed Experiments[M]. New York: Wiley, 1995.
2 Khuri A I , Cornell J A . Response Surfaces[M]. New York: Marcel Dekker Inc., 1987.
3 Jones D R , Schonlau M , Welch W J . Efficient global optimization of expensive black-box functions[J]. Journal of Global Optimization, 1998, 13 (4): 455- 492.
4 Gutmann H M . A radial basis function method for global optimization[J]. Journal of Global Optimization, 2001, 19 (3): 201- 227.
5 Regis R G , Shoemaker C A . Constrained global optimization of expensive black box functions using radial basis functions[J]. Journal of Global Optimization, 2005, 31, 153- 171.
6 Regis R , Shoemaker C . A stochastic radial basis function method for the global optimization of expensive functions[J]. INFORMS Journal on Computing, 2007, 19, 497- 509.
7 Xiang H , Li Y , Liao H , et al. An adaptive surrogate model based on support vector regression and its application to the optimization of railway wind barriers[J]. Structural and Multidisciplinary Optimization, 2017, 55, 701- 713.
8 Crino S , Brown D E . Global optimization with multivariate adaptive regression splines[J]. IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics), 2007, 37 (2): 333- 340.
9 Jie H , Wu Y , Ding J . An adaptive metamodel-based global optimization algorithm for blackbox type problems[J]. Engineering Optimization, 2015, 47 (11): 1459- 1480.
10 Zhou Z , Bai F S . An adaptive framework for costly black-box global optimization based on radial basis function interpolation[J]. Journal of Global Optimization, 2018, 70 (4): 757- 781.
11 Powell M J D. The theory of radial basis function approximation in 1990[D]. Oxford: Oxford University, 1992.
12 Dixon L C W , Szeg? G P . Towards Global Optimisation[M]. Amsterdam: North-Holland Publishing Company, 1978.
13 Schoen F . A wide class of test functions for global optimization[J]. Journal of Global Optimization, 1993, 3 (2): 133- 137.
14 T?rn A , Zilinskas A . Global Optimization[M]. Berlin: Springer-Verlag, 1989.
15 Surjanovic S, Bingham D. Virtual library of simulation experiments: Test functions and datasets[EB/OL]. (2020-08-25)[2013-03-23]. http://www.sfu.ca/~ssurjano.
16 Dolan E D , Moré J J . Benchmarking optimization software with performance profiles[J]. Mathematical Programming, 2001, 91 (2): 201- 213.
17 Moré J J , Wild S M . Benchmarking derivative-free optimization algorithms[J]. SIAM Journal on Optimization, 2009, 20 (1): 172- 191.
文章导航

/