org.deeplearning4j.nn.conf.layers

Class GravesLSTM

java.lang.Object

org.deeplearning4j.nn.conf.layers.Layer

org.deeplearning4j.nn.conf.layers.FeedForwardLayer

org.deeplearning4j.nn.conf.layers.BaseRecurrentLayer

org.deeplearning4j.nn.conf.layers.GravesLSTM

All Implemented Interfaces:

java.io.Serializable, java.lang.Cloneable

public class GravesLSTM
extends BaseRecurrentLayer

LSTM recurrent net, based on Graves: Supervised Sequence Labelling with Recurrent Neural Networks http://www.cs.toronto.edu/~graves/phd.pdf

See Also:

Serialized Form

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
static class	GravesLSTM.Builder

Field Summary

Fields inherited from class org.deeplearning4j.nn.conf.layers.FeedForwardLayer

nIn, nOut

Fields inherited from class org.deeplearning4j.nn.conf.layers.Layer

activationFn, adamMeanDecay, adamVarDecay, biasInit, biasLearningRate, dist, dropOut, epsilon, gradientNormalization, gradientNormalizationThreshold, l1, l1Bias, l2, l2Bias, layerName, learningRate, learningRateSchedule, momentum, momentumSchedule, rho, rmsDecay, updater, weightInit

Method Summary

Modifier and Type	Method and Description
double	getL1ByParam(java.lang.String paramName) Get the L1 coefficient for the given parameter.
double	getL2ByParam(java.lang.String paramName) Get the L2 coefficient for the given parameter.
double	getLearningRateByParam(java.lang.String paramName) Get the (initial) learning rate coefficient for the given parameter.
ParamInitializer	initializer()
Layer	instantiate(NeuralNetConfiguration conf, java.util.Collection<IterationListener> iterationListeners, int layerIndex, org.nd4j.linalg.api.ndarray.INDArray layerParamsView, boolean initializeParams)

Methods inherited from class org.deeplearning4j.nn.conf.layers.BaseRecurrentLayer

getOutputType, getPreProcessorForInputType, setNIn

Methods inherited from class org.deeplearning4j.nn.conf.layers.Layer

clone, getUpdaterByParam, resetLayerDefaultConfig

Methods inherited from class java.lang.Object

equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Method Detail

instantiate

public Layer instantiate(NeuralNetConfiguration conf,
                         java.util.Collection<IterationListener> iterationListeners,
                         int layerIndex,
                         org.nd4j.linalg.api.ndarray.INDArray layerParamsView,
                         boolean initializeParams)

Specified by:

instantiate in class Layer

initializer

public ParamInitializer initializer()

Specified by:

initializer in class Layer

getL1ByParam

public double getL1ByParam(java.lang.String paramName)

Description copied from class: Layer

Get the L1 coefficient for the given parameter. Different parameters may have different L1 values, even for a single .l1(x) configuration. For example, biases generally aren't L1 regularized, even if weights are

Overrides:

getL1ByParam in class FeedForwardLayer

Parameters:

paramName - Parameter name

Returns:

L1 value for that parameter

getL2ByParam

public double getL2ByParam(java.lang.String paramName)

Description copied from class: Layer

Get the L2 coefficient for the given parameter. Different parameters may have different L2 values, even for a single .l2(x) configuration. For example, biases generally aren't L1 regularized, even if weights are

Overrides:

getL2ByParam in class FeedForwardLayer

Parameters:

paramName - Parameter name

Returns:

L2 value for that parameter

getLearningRateByParam

public double getLearningRateByParam(java.lang.String paramName)

Description copied from class: Layer

Get the (initial) learning rate coefficient for the given parameter. Different parameters may be configured to have different learning rates, though commonly all parameters will have the same learning rate

Overrides:

getLearningRateByParam in class FeedForwardLayer

Parameters:

paramName - Parameter name

Returns:

Initial learning rate value for that parameter