First-order algorithms for optimization problems with orthogonality constraints

Expand
  • 1. University of Chinese Academy of Sciences,  Beijing 100190, China 2. State Key Laboratory of Scientific and Engineering Computing, Academy of Mathematics and Systems Science, Chinese Academy of Sciences, Beijing 100190, China

Received date: 2017-09-02

  Online published: 2017-12-15

Abstract

Optimization problems with orthogonality constraints have a wide range of applications in the field of materials science, statistics and data science. Many optimization algorithms on manifold can be applied to this type of problems, since the feasible region of orthogonal constraint is known as Stiefel manifold.
In recent years, with the expansion of variable scale required by practical application, the limitations of existing methods on manifold are reflected in practice. On the other hand, some efficient approaches based on new concepts are proposed recently. In this paper, we briefly introduce the main classes of methods for optimization problems with orthogonality constraints including  retraction based method, non-retraction based method and infeasible method respectively. We also discuss the main characteristics of these approaches, the scenarios in which these approaches are suitable and the possible directions for further development.
 

Cite this article

GAO Bin, LIU Xin, YUAN Yaxiang . First-order algorithms for optimization problems with orthogonality constraints[J]. Operations Research Transactions, 2017 , 21(4) : 57 -68 . DOI: 10.15960/j.cnki.issn.1007-6093.2017.04.004

Outlines

/