org.deeplearning4j.spark.impl.common

Class CountPartitionsFunction<T>

java.lang.Object

org.deeplearning4j.spark.impl.common.CountPartitionsFunction<T>

All Implemented Interfaces:

java.io.Serializable, org.apache.spark.api.java.function.Function2<java.lang.Integer,java.util.Iterator<T>,java.util.Iterator<scala.Tuple2<java.lang.Integer,java.lang.Integer>>>

public class CountPartitionsFunction<T>
extends java.lang.Object
implements org.apache.spark.api.java.function.Function2<java.lang.Integer,java.util.Iterator<T>,java.util.Iterator<scala.Tuple2<java.lang.Integer,java.lang.Integer>>>

This is a function use to count the number of elements in each partition. It is used as part of SparkUtils.repartitionBalanceIfRequired(JavaRDD, Repartition, int, int)

See Also:

Serialized Form

Constructor Summary

Constructors

Constructor and Description
CountPartitionsFunction()

Method Summary

Modifier and Type	Method and Description
java.util.Iterator<scala.Tuple2<java.lang.Integer,java.lang.Integer>>	call(java.lang.Integer v1, java.util.Iterator<T> v2)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

CountPartitionsFunction

public CountPartitionsFunction()

Method Detail

call

public java.util.Iterator<scala.Tuple2<java.lang.Integer,java.lang.Integer>> call(java.lang.Integer v1,
                                                                                  java.util.Iterator<T> v2)
                                                                           throws java.lang.Exception

Specified by:

call in interface org.apache.spark.api.java.function.Function2<java.lang.Integer,java.util.Iterator<T>,java.util.Iterator<scala.Tuple2<java.lang.Integer,java.lang.Integer>>>

Throws:

java.lang.Exception