org.deeplearning4j.nn.conf.layers

Class EmbeddingLayer

java.lang.Object

org.deeplearning4j.nn.conf.layers.Layer

org.deeplearning4j.nn.conf.layers.FeedForwardLayer

org.deeplearning4j.nn.conf.layers.EmbeddingLayer

All Implemented Interfaces:

java.io.Serializable, java.lang.Cloneable

public class EmbeddingLayer
extends FeedForwardLayer

Embedding layer: feed-forward layer that expects single integers per example as input (class numbers, in range 0 to numClass-1) as input. This input has shape [numExamples,1] instead of [numExamples,numClasses] for the equivalent one-hot representation. Mathematically, EmbeddingLayer is equivalent to using a DenseLayer with a one-hot representation for the input; however, it can be much more efficient with a large number of classes (as a dense layer + one-hot input does a matrix multiply with all but one value being zero).
Note: can only be used as the first layer for a network
Note 2: For a given example index i, the output is activationFunction(weights.getRow(i) + bias), hence the weight rows can be considered a vector/embedding for each example.

See Also:

Serialized Form

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
static class	EmbeddingLayer.Builder

Field Summary

Fields inherited from class org.deeplearning4j.nn.conf.layers.FeedForwardLayer

nIn, nOut

Fields inherited from class org.deeplearning4j.nn.conf.layers.Layer

activationFn, adamMeanDecay, adamVarDecay, biasInit, biasLearningRate, dist, dropOut, epsilon, gradientNormalization, gradientNormalizationThreshold, l1, l1Bias, l2, l2Bias, layerName, learningRate, learningRateSchedule, momentum, momentumSchedule, rho, rmsDecay, updater, weightInit

Method Summary

Modifier and Type	Method and Description
ParamInitializer	initializer()
Layer	instantiate(NeuralNetConfiguration conf, java.util.Collection<IterationListener> iterationListeners, int layerIndex, org.nd4j.linalg.api.ndarray.INDArray layerParamsView, boolean initializeParams)

Methods inherited from class org.deeplearning4j.nn.conf.layers.FeedForwardLayer

getL1ByParam, getL2ByParam, getLearningRateByParam, getOutputType, getPreProcessorForInputType, setNIn

Methods inherited from class org.deeplearning4j.nn.conf.layers.Layer

clone, getUpdaterByParam, resetLayerDefaultConfig

Methods inherited from class java.lang.Object

equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Method Detail

instantiate

public Layer instantiate(NeuralNetConfiguration conf,
                         java.util.Collection<IterationListener> iterationListeners,
                         int layerIndex,
                         org.nd4j.linalg.api.ndarray.INDArray layerParamsView,
                         boolean initializeParams)

Specified by:

instantiate in class Layer

initializer

public ParamInitializer initializer()

Specified by:

initializer in class Layer