org.deeplearning4j.spark.data

Class MultiDataSetExportFunction

java.lang.Object

org.deeplearning4j.spark.data.MultiDataSetExportFunction

All Implemented Interfaces:

java.io.Serializable, org.apache.spark.api.java.function.VoidFunction<java.util.Iterator<org.nd4j.linalg.dataset.api.MultiDataSet>>

public class MultiDataSetExportFunction
extends java.lang.Object
implements org.apache.spark.api.java.function.VoidFunction<java.util.Iterator<org.nd4j.linalg.dataset.api.MultiDataSet>>

A function (used in forEachPartition) to save MultiDataSet objects to disk/HDFS. Each MultiDataSet object is given a random and (probably) unique name, starting with "mds_" and ending with ".bin".
Use with JavaRDD<MultiDataSet>.foreachPartition()

See Also:

Serialized Form

Constructor Summary

Constructors

Constructor and Description
MultiDataSetExportFunction(java.net.URI outputDir)

Method Summary

Modifier and Type	Method and Description
void	call(java.util.Iterator<org.nd4j.linalg.dataset.api.MultiDataSet> iter)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

MultiDataSetExportFunction

public MultiDataSetExportFunction(java.net.URI outputDir)

Method Detail

call

public void call(java.util.Iterator<org.nd4j.linalg.dataset.api.MultiDataSet> iter)
          throws java.lang.Exception

Specified by:

call in interface org.apache.spark.api.java.function.VoidFunction<java.util.Iterator<org.nd4j.linalg.dataset.api.MultiDataSet>>

Throws:

java.lang.Exception