| Class | Description |
|---|---|
| BackTrackLineSearch | |
| BaseOptimizer |
Base optimizer
|
| ConjugateGradient |
Originally based on cc.mallet.optimize.ConjugateGradient
Rewritten based on Conjugate Gradient algorithm in Bengio et al.,
Deep Learning (in preparation) Ch8.
|
| LBFGS |
LBFGS
|
| LineGradientDescent |
Stochastic Gradient Descent with Line Search
|
| StochasticGradientDescent |
Stochastic Gradient Descent
Standard fix step size
No line search
|