org.deeplearning4j.spark.models.sequencevectors.functions

Class DistributedFunction<T extends SequenceElement>

java.lang.Object

org.deeplearning4j.spark.models.sequencevectors.functions.DistributedFunction<T>

All Implemented Interfaces:

java.io.Serializable, org.apache.spark.api.java.function.Function<T,ExportContainer<T>>

public class DistributedFunction<T extends SequenceElement>
extends java.lang.Object
implements org.apache.spark.api.java.function.Function<T,ExportContainer<T>>

See Also:

Serialized Form

Field Summary

Fields

Modifier and Type	Field and Description
protected org.apache.spark.broadcast.Broadcast<org.nd4j.parameterserver.distributed.conf.VoidConfiguration>	configurationBroadcast
protected org.apache.spark.broadcast.Broadcast<VocabCache<ShallowSequenceElement>>	shallowVocabBroadcast
protected VocabCache<ShallowSequenceElement>	shallowVocabCache
protected org.apache.spark.broadcast.Broadcast<VectorsConfiguration>	vectorsConfigurationBroadcast

Constructor Summary

Constructors

Constructor and Description
DistributedFunction(org.apache.spark.broadcast.Broadcast<org.nd4j.parameterserver.distributed.conf.VoidConfiguration> configurationBroadcast, org.apache.spark.broadcast.Broadcast<VectorsConfiguration> vectorsConfigurationBroadcast, org.apache.spark.broadcast.Broadcast<VocabCache<ShallowSequenceElement>> shallowVocabBroadcast)

Method Summary

Modifier and Type	Method and Description
ExportContainer<T>	call(T word)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

configurationBroadcast

protected org.apache.spark.broadcast.Broadcast<org.nd4j.parameterserver.distributed.conf.VoidConfiguration> configurationBroadcast

vectorsConfigurationBroadcast

protected org.apache.spark.broadcast.Broadcast<VectorsConfiguration> vectorsConfigurationBroadcast

shallowVocabBroadcast

protected org.apache.spark.broadcast.Broadcast<VocabCache<ShallowSequenceElement>> shallowVocabBroadcast

shallowVocabCache

protected transient VocabCache<ShallowSequenceElement> shallowVocabCache

Constructor Detail

DistributedFunction

public DistributedFunction(@NonNull
                           org.apache.spark.broadcast.Broadcast<org.nd4j.parameterserver.distributed.conf.VoidConfiguration> configurationBroadcast,
                           @NonNull
                           org.apache.spark.broadcast.Broadcast<VectorsConfiguration> vectorsConfigurationBroadcast,
                           @NonNull
                           org.apache.spark.broadcast.Broadcast<VocabCache<ShallowSequenceElement>> shallowVocabBroadcast)

Method Detail

call

public ExportContainer<T> call(T word)
                        throws java.lang.Exception

Specified by:

call in interface org.apache.spark.api.java.function.Function<T extends SequenceElement,ExportContainer<T extends SequenceElement>>

Throws:

java.lang.Exception