org.deeplearning4j.nn.conf.preprocessor

Class RnnToCnnPreProcessor

java.lang.Object

org.deeplearning4j.nn.conf.preprocessor.RnnToCnnPreProcessor

All Implemented Interfaces:

java.io.Serializable, java.lang.Cloneable, InputPreProcessor

public class RnnToCnnPreProcessor
extends java.lang.Object
implements InputPreProcessor

A preprocessor to allow RNN and CNN layers to be used together
For example, time series (video) input -> ConvolutionLayer, or conceivable GravesLSTM -> ConvolutionLayer
Functionally equivalent to combining RnnToFeedForwardPreProcessor + FeedForwardToCnnPreProcessor
Specifically, this does two things:
(a) Reshape 3d activations out of RNN layer, with shape [miniBatchSize, numChannels*inputHeight*inputWidth, timeSeriesLength]) into 4d (CNN) activations (with shape [numExamples*timeSeriesLength, numChannels, inputWidth, inputHeight])
(b) Reshapes 4d epsilons (weights.*deltas) out of CNN layer (with shape [numExamples*timeSeriesLength, numChannels, inputHeight, inputWidth]) into 3d epsilons with shape [miniBatchSize, numChannels*inputHeight*inputWidth, timeSeriesLength] suitable to feed into CNN layers. Note: numChannels is equivalent to depth or featureMaps referenced in different literature

See Also:

Serialized Form

Constructor Summary

Constructors

Constructor and Description
RnnToCnnPreProcessor(int inputHeight, int inputWidth, int numChannels)

Method Summary

Modifier and Type	Method and Description
org.nd4j.linalg.api.ndarray.INDArray	backprop(org.nd4j.linalg.api.ndarray.INDArray output, int miniBatchSize) Reverse the preProcess during backprop.
RnnToCnnPreProcessor	clone()
Pair<org.nd4j.linalg.api.ndarray.INDArray,MaskState>	feedForwardMaskArray(org.nd4j.linalg.api.ndarray.INDArray maskArray, MaskState currentMaskState, int minibatchSize)
InputType	getOutputType(InputType inputType) For a given type of input to this preprocessor, what is the type of the output?
org.nd4j.linalg.api.ndarray.INDArray	preProcess(org.nd4j.linalg.api.ndarray.INDArray input, int miniBatchSize) Pre preProcess input/activations for a multi layer network

Methods inherited from class java.lang.Object

equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

RnnToCnnPreProcessor

public RnnToCnnPreProcessor(int inputHeight,
                            int inputWidth,
                            int numChannels)

Method Detail

preProcess

public org.nd4j.linalg.api.ndarray.INDArray preProcess(org.nd4j.linalg.api.ndarray.INDArray input,
                                                       int miniBatchSize)

Description copied from interface: InputPreProcessor

Pre preProcess input/activations for a multi layer network

Specified by:

preProcess in interface InputPreProcessor

Parameters:

input - the input to pre preProcess

Returns:

the processed input

backprop

public org.nd4j.linalg.api.ndarray.INDArray backprop(org.nd4j.linalg.api.ndarray.INDArray output,
                                                     int miniBatchSize)

Description copied from interface: InputPreProcessor

Reverse the preProcess during backprop. Process Gradient/epsilons before passing them to the layer below.

Specified by:

backprop in interface InputPreProcessor

Parameters:

output - which is a pair of the gradient and epsilon

Returns:

the reverse of the pre preProcess step (if any)

clone

public RnnToCnnPreProcessor clone()

Specified by:

clone in interface InputPreProcessor

Overrides:

clone in class java.lang.Object

getOutputType

public InputType getOutputType(InputType inputType)

Description copied from interface: InputPreProcessor

For a given type of input to this preprocessor, what is the type of the output?

Specified by:

getOutputType in interface InputPreProcessor

Parameters:

inputType - Type of input for the preprocessor

Returns:

Type of input after applying the preprocessor

feedForwardMaskArray

public Pair<org.nd4j.linalg.api.ndarray.INDArray,MaskState> feedForwardMaskArray(org.nd4j.linalg.api.ndarray.INDArray maskArray,
                                                                                 MaskState currentMaskState,
                                                                                 int minibatchSize)

Specified by:

feedForwardMaskArray in interface InputPreProcessor