org.deeplearning4j.spark.models.sequencevectors.functions

Class CountFunction<T extends SequenceElement>

java.lang.Object

org.deeplearning4j.spark.models.sequencevectors.functions.CountFunction<T>

All Implemented Interfaces:

java.io.Serializable, org.apache.spark.api.java.function.Function<Sequence<T>,Pair<Sequence<T>,java.lang.Long>>

public class CountFunction<T extends SequenceElement>
extends java.lang.Object
implements org.apache.spark.api.java.function.Function<Sequence<T>,Pair<Sequence<T>,java.lang.Long>>

This accumulator function does count individual elements, using provided Accumulator

See Also:

Serialized Form

Field Summary

Fields

Modifier and Type	Field and Description
protected org.apache.spark.Accumulator<Counter<java.lang.Long>>	accumulator
protected org.nd4j.parameterserver.distributed.training.TrainingDriver<? extends org.nd4j.parameterserver.distributed.messages.TrainingMessage>	driver
protected SparkElementsLearningAlgorithm	ela
protected boolean	fetchLabels
protected org.apache.spark.broadcast.Broadcast<VectorsConfiguration>	vectorsConfigurationBroadcast
protected org.apache.spark.broadcast.Broadcast<org.nd4j.parameterserver.distributed.conf.VoidConfiguration>	voidConfigurationBroadcast

Constructor Summary

Constructors

Constructor and Description
CountFunction(org.apache.spark.broadcast.Broadcast<VectorsConfiguration> vectorsConfigurationBroadcast, org.apache.spark.broadcast.Broadcast<org.nd4j.parameterserver.distributed.conf.VoidConfiguration> voidConfigurationBroadcast, org.apache.spark.Accumulator<Counter<java.lang.Long>> accumulator, boolean fetchLabels)

Method Summary

Modifier and Type	Method and Description
Pair<Sequence<T>,java.lang.Long>	call(Sequence<T> sequence)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

accumulator

protected org.apache.spark.Accumulator<Counter<java.lang.Long>> accumulator

fetchLabels

protected boolean fetchLabels

voidConfigurationBroadcast

protected org.apache.spark.broadcast.Broadcast<org.nd4j.parameterserver.distributed.conf.VoidConfiguration> voidConfigurationBroadcast

vectorsConfigurationBroadcast

protected org.apache.spark.broadcast.Broadcast<VectorsConfiguration> vectorsConfigurationBroadcast

ela

protected transient SparkElementsLearningAlgorithm ela

driver

protected transient org.nd4j.parameterserver.distributed.training.TrainingDriver<? extends org.nd4j.parameterserver.distributed.messages.TrainingMessage> driver

Constructor Detail

CountFunction

public CountFunction(@NonNull
                     org.apache.spark.broadcast.Broadcast<VectorsConfiguration> vectorsConfigurationBroadcast,
                     @NonNull
                     org.apache.spark.broadcast.Broadcast<org.nd4j.parameterserver.distributed.conf.VoidConfiguration> voidConfigurationBroadcast,
                     @NonNull
                     org.apache.spark.Accumulator<Counter<java.lang.Long>> accumulator,
                     boolean fetchLabels)

Method Detail

call

public Pair<Sequence<T>,java.lang.Long> call(Sequence<T> sequence)
                                      throws java.lang.Exception

Specified by:

call in interface org.apache.spark.api.java.function.Function<Sequence<T extends SequenceElement>,Pair<Sequence<T extends SequenceElement>,java.lang.Long>>

Throws:

java.lang.Exception