org.deeplearning4j.spark.data

Class PathToDataSetFunction

java.lang.Object

org.deeplearning4j.spark.data.PathToDataSetFunction

All Implemented Interfaces:

java.io.Serializable, org.apache.spark.api.java.function.Function<java.lang.String,org.nd4j.linalg.dataset.DataSet>

public class PathToDataSetFunction
extends java.lang.Object
implements org.apache.spark.api.java.function.Function<java.lang.String,org.nd4j.linalg.dataset.DataSet>

Simple function used to load DataSets (serialized with DataSet.save()) from a given Path (as a String) to a DataSet object - i.e., RDD<String> to RDD<DataSet>

See Also:

Serialized Form

Field Summary

Fields

Modifier and Type	Field and Description
static int	BUFFER_SIZE

Constructor Summary

Constructors

Constructor and Description
PathToDataSetFunction()

Method Summary

Modifier and Type	Method and Description
org.nd4j.linalg.dataset.DataSet	call(java.lang.String path)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

BUFFER_SIZE

public static final int BUFFER_SIZE

See Also:

Constant Field Values

Constructor Detail

PathToDataSetFunction

public PathToDataSetFunction()

Method Detail

call

public org.nd4j.linalg.dataset.DataSet call(java.lang.String path)
                                     throws java.lang.Exception

Specified by:

call in interface org.apache.spark.api.java.function.Function<java.lang.String,org.nd4j.linalg.dataset.DataSet>

Throws:

java.lang.Exception