org.deeplearning4j.spark.models.sequencevectors.learning.elements

Class BaseSparkLearningAlgorithm

java.lang.Object

org.deeplearning4j.spark.models.sequencevectors.learning.elements.BaseSparkLearningAlgorithm

All Implemented Interfaces:

ElementsLearningAlgorithm<ShallowSequenceElement>, SparkElementsLearningAlgorithm

Direct Known Subclasses:

SparkCBOW, SparkSkipGram

public abstract class BaseSparkLearningAlgorithm
extends java.lang.Object
implements SparkElementsLearningAlgorithm

Field Summary

Fields

Modifier and Type	Field and Description
protected java.util.concurrent.atomic.AtomicLong	nextRandom
protected VectorsConfiguration	vectorsConfiguration
protected VocabCache<ShallowSequenceElement>	vocabCache

Constructor Summary

Constructors

Modifier	Constructor and Description
protected	BaseSparkLearningAlgorithm()

Method Summary

Modifier and Type	Method and Description
static Sequence<ShallowSequenceElement>	applySubsampling(Sequence<ShallowSequenceElement> sequence, java.util.concurrent.atomic.AtomicLong nextRandom, long totalElementsCount, double prob)
void	configure(VocabCache<ShallowSequenceElement> vocabCache, WeightLookupTable<ShallowSequenceElement> lookupTable, VectorsConfiguration configuration)
void	finish()
boolean	isEarlyTerminationHit()
double	learnSequence(Sequence<ShallowSequenceElement> sequence, java.util.concurrent.atomic.AtomicLong nextRandom, double learningRate) This method does training over the sequence of elements passed into it
void	pretrain(SequenceIterator<ShallowSequenceElement> iterator)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface org.deeplearning4j.spark.models.sequencevectors.learning.SparkElementsLearningAlgorithm

frameSequence, getTrainingDriver

Methods inherited from interface org.deeplearning4j.models.embeddings.learning.ElementsLearningAlgorithm

getCodeName

Field Detail

vocabCache

protected transient VocabCache<ShallowSequenceElement> vocabCache

vectorsConfiguration

protected transient VectorsConfiguration vectorsConfiguration

nextRandom

protected transient java.util.concurrent.atomic.AtomicLong nextRandom

Constructor Detail

BaseSparkLearningAlgorithm

protected BaseSparkLearningAlgorithm()

Method Detail

learnSequence

public double learnSequence(Sequence<ShallowSequenceElement> sequence,
                            java.util.concurrent.atomic.AtomicLong nextRandom,
                            double learningRate)

Description copied from interface: ElementsLearningAlgorithm

This method does training over the sequence of elements passed into it

Specified by:

learnSequence in interface ElementsLearningAlgorithm<ShallowSequenceElement>

Returns:

average score for this sequence

configure

public void configure(VocabCache<ShallowSequenceElement> vocabCache,
                      WeightLookupTable<ShallowSequenceElement> lookupTable,
                      VectorsConfiguration configuration)

Specified by:

configure in interface ElementsLearningAlgorithm<ShallowSequenceElement>

pretrain

public void pretrain(SequenceIterator<ShallowSequenceElement> iterator)

Specified by:

pretrain in interface ElementsLearningAlgorithm<ShallowSequenceElement>

isEarlyTerminationHit

public boolean isEarlyTerminationHit()

Specified by:

isEarlyTerminationHit in interface ElementsLearningAlgorithm<ShallowSequenceElement>

finish

public void finish()

Specified by:

finish in interface ElementsLearningAlgorithm<ShallowSequenceElement>

applySubsampling

public static Sequence<ShallowSequenceElement> applySubsampling(@NonNull
                                                                Sequence<ShallowSequenceElement> sequence,
                                                                @NonNull
                                                                java.util.concurrent.atomic.AtomicLong nextRandom,
                                                                long totalElementsCount,
                                                                double prob)