org.deeplearning4j.nn.conf.layers

Class BatchNormalization

java.lang.Object

org.deeplearning4j.nn.conf.layers.Layer

org.deeplearning4j.nn.conf.layers.FeedForwardLayer

org.deeplearning4j.nn.conf.layers.BatchNormalization

All Implemented Interfaces:

java.io.Serializable, java.lang.Cloneable

public class BatchNormalization
extends FeedForwardLayer

Batch normalization configuration

See Also:

Serialized Form

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
static class	BatchNormalization.Builder

Field Summary

Fields

Modifier and Type	Field and Description
protected double	beta
protected double	decay
protected double	eps
protected double	gamma
protected boolean	isMinibatch
protected boolean	lockGammaBeta

Fields inherited from class org.deeplearning4j.nn.conf.layers.FeedForwardLayer

nIn, nOut

Fields inherited from class org.deeplearning4j.nn.conf.layers.Layer

activationFn, adamMeanDecay, adamVarDecay, biasInit, biasLearningRate, dist, dropOut, epsilon, gradientNormalization, gradientNormalizationThreshold, l1, l1Bias, l2, l2Bias, layerName, learningRate, learningRateSchedule, momentum, momentumSchedule, rho, rmsDecay, updater, weightInit

Method Summary

Modifier and Type	Method and Description
BatchNormalization	clone()
double	getL1ByParam(java.lang.String paramName) Get the L1 coefficient for the given parameter.
double	getL2ByParam(java.lang.String paramName) Get the L2 coefficient for the given parameter.
double	getLearningRateByParam(java.lang.String paramName) Get the (initial) learning rate coefficient for the given parameter.
InputType	getOutputType(int layerIndex, InputType inputType) For a given type of input to this layer, what is the type of the output?
InputPreProcessor	getPreProcessorForInputType(InputType inputType) For the given type of input to this layer, what preprocessor (if any) is required? Returns null if no preprocessor is required, otherwise returns an appropriate InputPreProcessor for this layer, such as a CnnToFeedForwardPreProcessor
Updater	getUpdaterByParam(java.lang.String paramName) Get the updater for the given parameter.
ParamInitializer	initializer()
Layer	instantiate(NeuralNetConfiguration conf, java.util.Collection<IterationListener> iterationListeners, int layerIndex, org.nd4j.linalg.api.ndarray.INDArray layerParamsView, boolean initializeParams)
void	setNIn(InputType inputType, boolean override) Set the nIn value (number of inputs, or input depth for CNNs) based on the given input type

Methods inherited from class org.deeplearning4j.nn.conf.layers.Layer

resetLayerDefaultConfig

Methods inherited from class java.lang.Object

equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

decay

protected double decay

eps

protected double eps

isMinibatch

protected boolean isMinibatch

gamma

protected double gamma

beta

protected double beta

lockGammaBeta

protected boolean lockGammaBeta

Method Detail

clone

public BatchNormalization clone()

Overrides:

clone in class Layer

instantiate

public Layer instantiate(NeuralNetConfiguration conf,
                         java.util.Collection<IterationListener> iterationListeners,
                         int layerIndex,
                         org.nd4j.linalg.api.ndarray.INDArray layerParamsView,
                         boolean initializeParams)

Specified by:

instantiate in class Layer

initializer

public ParamInitializer initializer()

Specified by:

initializer in class Layer

getOutputType

public InputType getOutputType(int layerIndex,
                               InputType inputType)

Description copied from class: Layer

For a given type of input to this layer, what is the type of the output?

Overrides:

getOutputType in class FeedForwardLayer

Parameters:

layerIndex - Index of the layer

inputType - Type of input for the layer

Returns:

Type of output from the layer

setNIn

public void setNIn(InputType inputType,
                   boolean override)

Description copied from class: Layer

Set the nIn value (number of inputs, or input depth for CNNs) based on the given input type

Overrides:

setNIn in class FeedForwardLayer

Parameters:

inputType - Input type for this layer

override - If false: only set the nIn value if it's not already set. If true: set it regardless of whether it's already set or not.

getPreProcessorForInputType

public InputPreProcessor getPreProcessorForInputType(InputType inputType)

Description copied from class: Layer

For the given type of input to this layer, what preprocessor (if any) is required?
Returns null if no preprocessor is required, otherwise returns an appropriate InputPreProcessor for this layer, such as a CnnToFeedForwardPreProcessor

Overrides:

getPreProcessorForInputType in class FeedForwardLayer

Parameters:

inputType - InputType to this layer

Returns:

Null if no preprocessor is required, otherwise the type of preprocessor necessary for this layer/input combination

getL1ByParam

public double getL1ByParam(java.lang.String paramName)

Description copied from class: Layer

Get the L1 coefficient for the given parameter. Different parameters may have different L1 values, even for a single .l1(x) configuration. For example, biases generally aren't L1 regularized, even if weights are

Overrides:

getL1ByParam in class FeedForwardLayer

Parameters:

paramName - Parameter name

Returns:

L1 value for that parameter

getL2ByParam

public double getL2ByParam(java.lang.String paramName)

Description copied from class: Layer

Get the L2 coefficient for the given parameter. Different parameters may have different L2 values, even for a single .l2(x) configuration. For example, biases generally aren't L1 regularized, even if weights are

Overrides:

getL2ByParam in class FeedForwardLayer

Parameters:

paramName - Parameter name

Returns:

L2 value for that parameter

getLearningRateByParam

public double getLearningRateByParam(java.lang.String paramName)

Description copied from class: Layer

Get the (initial) learning rate coefficient for the given parameter. Different parameters may be configured to have different learning rates, though commonly all parameters will have the same learning rate

Overrides:

getLearningRateByParam in class FeedForwardLayer

Parameters:

paramName - Parameter name

Returns:

Initial learning rate value for that parameter

getUpdaterByParam

public Updater getUpdaterByParam(java.lang.String paramName)

Description copied from class: Layer

Get the updater for the given parameter. Typically the same updater will be used for all updaters, but this is not necessarily the case

Overrides:

getUpdaterByParam in class Layer

Parameters:

paramName - Parameter name

Returns:

Updater for the parameter