Nelder Mead Optimizer Class
Definition
Assembly: Numerics.NET (in Numerics.NET.dll) Version: 9.0.3
public sealed class NelderMeadOptimizer : MultidimensionalOptimizer
- Inheritance
- Object → ManagedIterativeAlgorithm<Vector<Double>, Double, OptimizationSolutionReport> → MultidimensionalOptimizer → NelderMeadOptimizer
Remarks
Use the NelderMeadOptimizer class to find an extremum of an objective function for which only the objective function is available, and the objective function itself may not be smooth. The method is often called the downhill simplex method.
The main advantage of this method is that it converges for functions where other methods would fail. This may happen, for instance, when the derivative of the objective function contains discontinuities. The major drawback is that the method converges more slowly than the other methods, and performs poorly for large problems.
The objective function must be supplied as a multivariate function delegate to the ObjectiveFunction property. The gradient of the objective function is not used.
Before the algorithm is run, you must set the InitialGuess property to a vector that contains an initial estimate for the extremum. The ExtremumType property specifies whether a minimum or a maximum of the objective function is desired.
The FindExtremum() method performs the actual search for an extremum, and returns a Vector containing the best approximation. The Extremum property also returns the best approximation to the extremum. The ValueAtExtremum property returns the value of the objective function at the extremum.
The Status property is a AlgorithmStatus value that indicates the outcome of the algorithm. A value of Normal shows normal termination. A value of Divergent usually indicates that the objective function is not bounded.
The algorithm has two convergence tests. By default, the algorithm terminates when either of these is satisfied. You can deactivate either test by setting its Enabled property to false. If both tests are deactivated, then the algorithm always terminates when the maximum number of iterations or function evaluations is reached.
The first test is based on the uncertainty in the location of the approximate extremum. The test succeeds if the difference between the best and worst approximation is within the tolerance. The SolutionTest property returns a VectorConvergenceTest<T> object that allows you to specify the desired Tolerance and specific ConvergenceCriterion. See the VectorConvergenceTest<T> class for details on how to further customize this test.
The second test is based on the difference in value of the objective function at the best and at the worst current approximation. The test is successful when the difference between the two is within the tolerance. Care should be taken with this test. When the tolerance is too large, the algorithm will terminate prematurely. The ValueTest property returns a SimpleConvergenceTest<T> object that can be used to customize the test.
A third test, based on the value of the gradient at the approximate extremum, is exposed through the GradientTest property. However, this test does not apply to the Nelder-Mead method, and it's Enabled property is set to false before the algorithm is executed.
Constructors
Nelder | Constructs a new NelderMeadOptimizer object. |
Properties
Contraction | Gets or sets the factor used in a contraction step of the algorithm. |
Convergence |
Gets the collection of convergence tests for the algorithm.
(Inherited from ManagedIterativeAlgorithm<T, TError, TReport>) |
Dimensions |
Gets or sets the number of dimensions of the optimization problem.
(Inherited from MultidimensionalOptimizer) |
Estimated |
Gets a value indicating the size of the absolute
error of the result.
(Inherited from ManagedIterativeAlgorithm<T, TError, TReport>) |
Evaluations |
Gets the number of evaluations needed to execute the algorithm.
(Inherited from ManagedIterativeAlgorithm<T, TError, TReport>) |
Expansion | Gets or sets the factor by which the simplex is extended in the direction of the current best point. |
Extremum |
Gets or sets the current best approximation to the extremum.
(Inherited from MultidimensionalOptimizer) |
Extremum |
Gets or sets the type of extremum.
(Inherited from MultidimensionalOptimizer) |
Fast |
Gets or sets the function that computes the gradient of the objective funciton.
(Inherited from MultidimensionalOptimizer) |
Gradient |
Gets the number of evaluations of the gradient of the objective function.
(Inherited from MultidimensionalOptimizer) |
Gradient |
Gets or sets the function that computes the gradient of the objective funciton.
(Inherited from MultidimensionalOptimizer) |
Gradient |
Gets the VectorConvergenceTest<T> that uses the gradient of the objective function.
(Inherited from MultidimensionalOptimizer) |
Gradient |
Gets or sets the current value of the gradient.
(Inherited from MultidimensionalOptimizer) |
Has |
Indicates whether the degree of parallelism is a property that is shared
across instances.
(Inherited from ManagedIterativeAlgorithm<T, TError, TReport>) |
Initial |
Gets or sets the initial value for the iteration.
(Inherited from MultidimensionalOptimizer) |
Iterations |
Gets the number of iterations needed by the
algorithm to reach the desired accuracy.
(Inherited from ManagedIterativeAlgorithm<T, TError, TReport>) |
Max |
Gets or sets the maximum degree of parallelism enabled by this instance.
(Inherited from ManagedIterativeAlgorithm<T, TError, TReport>) |
Max |
Gets or sets the maximum number of evaluations during the calculation.
(Inherited from ManagedIterativeAlgorithm<T, TError, TReport>) |
Max | Gets or sets the maximum number of iterations
to use when approximating the roots of the target
function.
(Inherited from ManagedIterativeAlgorithm<T, TError, TReport>) |
Min |
Gets or sets the minimum iterations that have to be performed.
(Inherited from ManagedIterativeAlgorithm<T, TError, TReport>) |
Objective |
Gets or sets the objective function.
(Inherited from MultidimensionalOptimizer) |
Objective |
Gets or sets a function that evaluates the value and gradient
of the objective function.
(Inherited from MultidimensionalOptimizer) |
Parallel |
Gets or sets the configuration for the parallel behavior of the algorithm.
(Inherited from ManagedIterativeAlgorithm<T, TError, TReport>) |
Reflection | Gets or sets the factor by which the simplex is reflected away from the worst point. |
Result |
Gets the result of an algorithm after it has executed.
(Inherited from ManagedIterativeAlgorithm<T, TError, TReport>) |
Scale | Gets or sets the size of the initial simplex. |
Shrinkage | Gets or sets the factor by which the simplex is shrunk towards the best point. |
Solution |
Gets the result of an algorithm after it has executed.
(Inherited from ManagedIterativeAlgorithm<T, TError, TReport>) |
Solution |
Gets the VectorConvergenceTest<T> that uses the approximate solution.
(Inherited from MultidimensionalOptimizer) |
Status |
Gets the AlgorithmStatus following
an execution of the algorithm.
(Inherited from ManagedIterativeAlgorithm<T, TError, TReport>) |
Symbolic |
Gets or sets the objective function.
(Inherited from MultidimensionalOptimizer) |
Throw |
Gets or sets whether to throw an
exception when the algorithm fails to converge.
(Inherited from ManagedIterativeAlgorithm<T, TError, TReport>) |
Value |
Gets or sets the current value of the objective function.
(Inherited from MultidimensionalOptimizer) |
Value |
Gets the SimpleConvergenceTest<T> that uses the value of the target functions.
(Inherited from MultidimensionalOptimizer) |
Methods
Equals | Determines whether the specified object is equal to the current object. (Inherited from Object) |
Find |
Searches for an extremum.
(Inherited from MultidimensionalOptimizer) |
Get | Serves as the default hash function. (Inherited from Object) |
Get | Gets the Type of the current instance. (Inherited from Object) |
ToString | Returns a string that represents the current object. (Inherited from Object) |