org.deeplearning4j.spark.datavec.export

Class StringToDataSetExportFunction

java.lang.Object

org.deeplearning4j.spark.datavec.export.StringToDataSetExportFunction

All Implemented Interfaces:

java.io.Serializable, org.apache.spark.api.java.function.VoidFunction<java.util.Iterator<java.lang.String>>

public class StringToDataSetExportFunction
extends java.lang.Object
implements org.apache.spark.api.java.function.VoidFunction<java.util.Iterator<java.lang.String>>

A function (used in forEachPartition) to convert Strings to DataSet objects using a RecordReader (such as a CSVRecordReader). Use with JavaRDD<String>.foreachPartition()

See Also:

Serialized Form

Constructor Summary

Constructors

Constructor and Description
StringToDataSetExportFunction(java.net.URI outputDir, org.datavec.api.records.reader.RecordReader recordReader, int batchSize, boolean regression, int labelIndex, int numPossibleLabels)

Method Summary

Modifier and Type	Method and Description
void	call(java.util.Iterator<java.lang.String> stringIterator)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

StringToDataSetExportFunction

public StringToDataSetExportFunction(java.net.URI outputDir,
                                     org.datavec.api.records.reader.RecordReader recordReader,
                                     int batchSize,
                                     boolean regression,
                                     int labelIndex,
                                     int numPossibleLabels)

Method Detail

call

public void call(java.util.Iterator<java.lang.String> stringIterator)
          throws java.lang.Exception

Specified by:

call in interface org.apache.spark.api.java.function.VoidFunction<java.util.Iterator<java.lang.String>>

Throws:

java.lang.Exception