org.deeplearning4j.spark.api

Enum RepartitionStrategy

java.lang.Object

java.lang.Enum<RepartitionStrategy>

org.deeplearning4j.spark.api.RepartitionStrategy

All Implemented Interfaces:

java.io.Serializable, java.lang.Comparable<RepartitionStrategy>

public enum RepartitionStrategy
extends java.lang.Enum<RepartitionStrategy>

RepartitionStrategy: different strategies for conducting repartitioning on training data, when repartitioning is required.
SparkDefault: repartition using Spark's standard RDD.repartition(int) method. This results in each value being randomly mapped to a new partition. This results in approximately equal partitions, though random sampling issues can be problematic when the number of elements in a RDD is small
Balanced: a custom repartitioning strategy that attempts to ensure that each partition ends up with the correct number of elements. It has a slightly higher overhead (need to count the number of values in each partition) but should be less prone to random sampling variance than the SparkDefault strategy

Enum Constant Summary

Enum Constants

Enum Constant and Description
Balanced
SparkDefault

Method Summary

Modifier and Type	Method and Description
static RepartitionStrategy	valueOf(java.lang.String name) Returns the enum constant of this type with the specified name.
static RepartitionStrategy[]	values() Returns an array containing the constants of this enum type, in the order they are declared.

Methods inherited from class java.lang.Enum

clone, compareTo, equals, finalize, getDeclaringClass, hashCode, name, ordinal, toString, valueOf

Methods inherited from class java.lang.Object

getClass, notify, notifyAll, wait, wait, wait

Enum Constant Detail

SparkDefault

public static final RepartitionStrategy SparkDefault

Balanced

public static final RepartitionStrategy Balanced

Method Detail

values

public static RepartitionStrategy[] values()

Returns an array containing the constants of this enum type, in the order they are declared. This method may be used to iterate over the constants as follows:

for (RepartitionStrategy c : RepartitionStrategy.values())
    System.out.println(c);

Returns:

an array containing the constants of this enum type, in the order they are declared

valueOf

public static RepartitionStrategy valueOf(java.lang.String name)

Returns the enum constant of this type with the specified name. The string must match exactly an identifier used to declare an enum constant in this type. (Extraneous whitespace characters are not permitted.)

Parameters:

name - the name of the enum constant to be returned.

Returns:

the enum constant with the specified name

Throws:

java.lang.IllegalArgumentException - if this enum type has no constant with the specified name

java.lang.NullPointerException - if the argument is null