16.01.2015 Views

GAMS — The Solver Manuals - Available Software

GAMS — The Solver Manuals - Available Software

GAMS — The Solver Manuals - Available Software

SHOW MORE
SHOW LESS

Create successful ePaper yourself

Turn your PDF publications into a flip-book with our unique Google optimized e-Paper software.

MINOS 353<br />

product of matrices of the form: ( I<br />

µ I)<br />

where the multipliers µ will satisfy |µ| < r i .<br />

I <strong>The</strong> default values r i = 10.0 usually strike a good compromise between stability and sparsity.<br />

II For large and relatively dense problems, r i = 25.0 (say) may give a useful improvement in sparsity<br />

without impairing stability to a serious degree.<br />

III For certain very regular structures (e.g., band matrices) it may be necessary to set r 1 and/or r 2 to<br />

values smaller than the default in order to achieve stability. For example, if the columns of A include<br />

a sub-matrix of the form:<br />

⎛<br />

⎝ 4 −1<br />

⎞<br />

−1 4 −1⎠<br />

−1 4<br />

it would be judicious to set both r 1 and r 2 to values in the range 1.0 < r i < 4.0.<br />

(Default values: r 1 = 100.0 (5 for NLP’s), r 2 = 10.0 (5 for NLP’s))<br />

LU partial pivoting<br />

LU rook pivoting<br />

LU complete pivoting<br />

<strong>The</strong> LUSOL factorization implements a Markowitz-style search for pivots that locally minimize fill-in subject<br />

to a threshold pivoting stability criterion. <strong>The</strong> rook and complete pivoting options are more expensive than<br />

partial pivoting but are more stable and better at revealing rank, as long as the LU factor tolerance is not<br />

too large (say t 1 < 2.0).<br />

(Default = LU partial pivoting)<br />

LU density tolerance r 1<br />

LU singularity tolerance r 2<br />

<strong>The</strong> density tolerance r 1 is used during LUSOL’s basis factorization B = LU. Columns of L and rows of<br />

U are formed one at a time, and the remaining rows and columns of the basis are altered appropriately.<br />

At any stage, if the density of the remaining matrix exceeds r 1 , the Markowitz strategy for choosing pivots<br />

is terminated and the remaining matrix is factored by a dense LU procedure. Raising r 1 towards 1.0 may<br />

give slightly sparser factors, with a slight increase in factorization time. <strong>The</strong> singularity tolerance r 2 helps<br />

guard against ill-conditioned basis matrices. When the basis is refactorized, the diagonal elements of U<br />

are tested as follows: if |U j,j | ≤ r 2 or |U j,j | < r 2 max i |U j,j | , the j th column of the basis is replaced by<br />

the corresponding slack variable. (This is most likely to occur after a restart, or at the start of a major<br />

iteration.) In some cases , the Jacobian matrix may converge to values that make the basis could become<br />

very ill-conditioned and the optimization could progress very slowly (if at all). Setting r 2 = 1.0 −5 , say, may<br />

help cause a judicious change of basis.<br />

(Default values: r 1 = 0.5, r 2 = ε 2/3 ≈ 10 −11 )<br />

Major damping parameter r<br />

<strong>The</strong> parameter may assist convergence on problems that have highly nonlinear constraints. It is intended<br />

to prevent large relative changes between subproblem solutions (x k , λ k ) and (x k+1 , λ k+1 ). For example, the<br />

default value 2.0 prevents the relative change in either x k or λ k from exceeding 200 percent. It will not be<br />

active on well behaved problems.<br />

<strong>The</strong> parameter is used to interpolate between the solutions at the beginning and end of each major iteration.<br />

Thus x k+1 and λ k+1 are changed to x k + σ(x k+1 − x k ) and λ k + σ(λ k+1 − λ k ) for some step-length σ < 1.<br />

In the case of nonlinear equation (where the number of constraints is the same as the number of variables)<br />

this gives a damped Newton method.<br />

This is very crude control. If the sequence of major iterations does not appear to be converging, one should<br />

first re-run the problem with a higher Penalty parameter (say 10 or 100 times the default ρ). (Skip this<br />

re-run in the case of nonlinear equations: there are no degrees of freedom and the value of ρ is irrelevant.)<br />

If the subproblem solutions continue to change violently, try reducing r to 0.2 or 0.1 (say).<br />

For implementation reason, the shortened step to σ applies to the nonlinear variables x, but not to the

Hooray! Your file is uploaded and ready to be published.

Saved successfully!

Ooh no, something went wrong!