org.deeplearning4j.models.embeddings.learning.impl.elements

Class CBOW<T extends SequenceElement>

java.lang.Object

org.deeplearning4j.models.embeddings.learning.impl.elements.CBOW<T>

All Implemented Interfaces:

ElementsLearningAlgorithm<T>

public class CBOW<T extends SequenceElement>
extends java.lang.Object
implements ElementsLearningAlgorithm<T>

CBOW implementation for DeepLearning4j

Field Summary

Fields

Modifier and Type	Field and Description
protected java.lang.ThreadLocal<java.util.List<org.nd4j.linalg.api.ops.aggregates.Aggregate>>	batches
protected org.nd4j.linalg.util.DeviceLocalNDArray	expTable
protected static double	MAX_EXP
protected double	negative
protected double	sampling
protected org.nd4j.linalg.util.DeviceLocalNDArray	syn0
protected org.nd4j.linalg.util.DeviceLocalNDArray	syn1
protected org.nd4j.linalg.util.DeviceLocalNDArray	syn1Neg
protected org.nd4j.linalg.util.DeviceLocalNDArray	table
protected boolean	useAdaGrad
protected int[]	variableWindows
protected int	window

Constructor Summary

Constructors

Constructor and Description
CBOW()

Method Summary

Modifier and Type	Method and Description
Sequence<T>	applySubsampling(Sequence<T> sequence, java.util.concurrent.atomic.AtomicLong nextRandom)
void	cbow(int i, java.util.List<T> sentence, int b, java.util.concurrent.atomic.AtomicLong nextRandom, double alpha, int currentWindow)
void	configure(VocabCache<T> vocabCache, WeightLookupTable<T> lookupTable, VectorsConfiguration configuration)
void	finish()
java.util.List<org.nd4j.linalg.api.ops.aggregates.Aggregate>	getBatch()
java.lang.String	getCodeName()
boolean	isEarlyTerminationHit()
void	iterateSample(T currentWord, int[] windowWords, java.util.concurrent.atomic.AtomicLong nextRandom, double alpha, boolean isInference, int numLabels, boolean trainWords, org.nd4j.linalg.api.ndarray.INDArray inferenceVector)
double	learnSequence(Sequence<T> sequence, java.util.concurrent.atomic.AtomicLong nextRandom, double learningRate) This method does training over the sequence of elements passed into it
void	pretrain(SequenceIterator<T> iterator) CBOW doesn't involve any pretraining

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

MAX_EXP

protected static double MAX_EXP

window

protected int window

useAdaGrad

protected boolean useAdaGrad

negative

protected double negative

sampling

protected double sampling

variableWindows

protected int[] variableWindows

syn0

protected org.nd4j.linalg.util.DeviceLocalNDArray syn0

syn1

protected org.nd4j.linalg.util.DeviceLocalNDArray syn1

syn1Neg

protected org.nd4j.linalg.util.DeviceLocalNDArray syn1Neg

expTable

protected org.nd4j.linalg.util.DeviceLocalNDArray expTable

table

protected org.nd4j.linalg.util.DeviceLocalNDArray table

batches

protected java.lang.ThreadLocal<java.util.List<org.nd4j.linalg.api.ops.aggregates.Aggregate>> batches

Constructor Detail

CBOW

public CBOW()

Method Detail

getBatch

public java.util.List<org.nd4j.linalg.api.ops.aggregates.Aggregate> getBatch()

getCodeName

public java.lang.String getCodeName()

Specified by:

getCodeName in interface ElementsLearningAlgorithm<T extends SequenceElement>

configure

public void configure(@NonNull
                      VocabCache<T> vocabCache,
                      @NonNull
                      WeightLookupTable<T> lookupTable,
                      @NonNull
                      VectorsConfiguration configuration)

Specified by:

configure in interface ElementsLearningAlgorithm<T extends SequenceElement>

pretrain

public void pretrain(SequenceIterator<T> iterator)

CBOW doesn't involve any pretraining

Specified by:

pretrain in interface ElementsLearningAlgorithm<T extends SequenceElement>

Parameters:

iterator -

finish

public void finish()

Specified by:

finish in interface ElementsLearningAlgorithm<T extends SequenceElement>

learnSequence

public double learnSequence(Sequence<T> sequence,
                            java.util.concurrent.atomic.AtomicLong nextRandom,
                            double learningRate)

Description copied from interface: ElementsLearningAlgorithm

This method does training over the sequence of elements passed into it

Specified by:

learnSequence in interface ElementsLearningAlgorithm<T extends SequenceElement>

Returns:

average score for this sequence

isEarlyTerminationHit

public boolean isEarlyTerminationHit()

Specified by:

isEarlyTerminationHit in interface ElementsLearningAlgorithm<T extends SequenceElement>

iterateSample

public void iterateSample(T currentWord,
                          int[] windowWords,
                          java.util.concurrent.atomic.AtomicLong nextRandom,
                          double alpha,
                          boolean isInference,
                          int numLabels,
                          boolean trainWords,
                          org.nd4j.linalg.api.ndarray.INDArray inferenceVector)

cbow

public void cbow(int i,
                 java.util.List<T> sentence,
                 int b,
                 java.util.concurrent.atomic.AtomicLong nextRandom,
                 double alpha,
                 int currentWindow)

applySubsampling

public Sequence<T> applySubsampling(@NonNull
                                    Sequence<T> sequence,
                                    @NonNull
                                    java.util.concurrent.atomic.AtomicLong nextRandom)