org.deeplearning4j.spark.models.sequencevectors.export.impl

Class HdfsModelExporter<T extends SequenceElement>

java.lang.Object

org.deeplearning4j.spark.models.sequencevectors.export.impl.HdfsModelExporter<T>

All Implemented Interfaces:

SparkModelExporter<T>

public class HdfsModelExporter<T extends SequenceElement>
extends java.lang.Object
implements SparkModelExporter<T>

Simple exporter, that will persist your SequenceVectors model into HDFS using TSV format

Field Summary

Fields

Modifier and Type	Field and Description
protected org.apache.hadoop.io.compress.CompressionCodec	codec
protected java.lang.String	path

Constructor Summary

Constructors

Modifier	Constructor and Description
protected	HdfsModelExporter()
	HdfsModelExporter(java.lang.String path)
	HdfsModelExporter(java.lang.String path, org.apache.hadoop.io.compress.CompressionCodec codec)

Method Summary

Modifier and Type	Method and Description
void	export(org.apache.spark.api.java.JavaRDD<ExportContainer<T>> rdd) This method will be called at final stage of SequenceVectors training, and JavaRDD being passed as argument will

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

path

protected java.lang.String path

codec

protected org.apache.hadoop.io.compress.CompressionCodec codec

Constructor Detail

HdfsModelExporter

protected HdfsModelExporter()

HdfsModelExporter

public HdfsModelExporter(@NonNull
                         java.lang.String path)

HdfsModelExporter

public HdfsModelExporter(@NonNull
                         java.lang.String path,
                         org.apache.hadoop.io.compress.CompressionCodec codec)

Method Detail

export

public void export(org.apache.spark.api.java.JavaRDD<ExportContainer<T>> rdd)

Description copied from interface: SparkModelExporter

This method will be called at final stage of SequenceVectors training, and JavaRDD being passed as argument will

Specified by:

export in interface SparkModelExporter<T extends SequenceElement>