UOBYQA

From HandWiki

UOBYQA (Unconstrained Optimization BY Quadratic Approximation)[1][2][3] is a numerical optimization algorithm by Michael J. D. Powell. It is also the name of Powell's Fortran 77 implementation of the algorithm. UOBYQA and all the other derivative-free optimization solvers of Powell's are included in PDFO, which provides MATLAB and Python interfaces for using these solvers on Linux, Mac, and Windows. UOBYQA solves unconstrained optimization problems without using derivatives, which makes it a derivative-free algorithm. The algorithm is iterative and exploits trust-region technique. On each iteration, the algorithm establishes a quadratic model [math]\displaystyle{ Q_k }[/math] by interpolating the objective function at [math]\displaystyle{ (n+1)(n+2)/2 }[/math] points and then minimizes [math]\displaystyle{ Q_k }[/math] within a trust region.

After UOBYQA, Powell developed NEWUOA, which also solves unconstrained optimization problems without using derivatives. In general, NEWUOA is much more efficient than UOBYQA and is capable of solving much larger problems (with up to several hundreds of variables). A major difference between them is that NEWUOA constructs quadratic models by interpolating the objective function at much less than [math]\displaystyle{ (n+1)(n+2)/2 }[/math] points ([math]\displaystyle{ 2n+1 }[/math] by default[4]). For general usage, NEWUOA is recommended to replace UOBYQA.

The UOBYQA software is distributed under The GNU Lesser General Public License (LGPL).[3]

See also

References

  1. Powell, M. J. D. (December 2000). UOBYQA: unconstrained optimization by quadratic approximation (Report). Department of Applied Mathematics and Theoretical Physics, Cambridge University. DAMTP 2000/NA14. http://www.damtp.cam.ac.uk/user/na/NA_papers/NA2000_14.ps.gz. Retrieved 2015-04-06. 
  2. Powell, M. J. D. (2002). "UOBYQA: unconstrained optimization by quadratic approximation". Mathematical Programming, Series B 92 (3): 555–582. doi:10.1007/s101070100290. 
  3. 3.0 3.1 "Source code of UOBYQA software". http://zhangzk.net/software.html#uobyqa. Retrieved 2015-04-06. 
  4. "Source code of NEWUOA software". http://zhangzk.net/software.html#newuoa. Retrieved 2014-01-14. 

External links