org.deeplearning4j.spark.models.sequencevectors.export.impl

Class VocabCacheExporter

java.lang.Object

org.deeplearning4j.spark.models.sequencevectors.export.impl.VocabCacheExporter

All Implemented Interfaces:

SparkModelExporter<VocabWord>

public class VocabCacheExporter
extends java.lang.Object
implements SparkModelExporter<VocabWord>

This model exporter is suitable for debug/testing only. PLEASE NOTE: Never use this exporter in real environment if your model won't fit into memory of driver.

Field Summary

Fields

Modifier and Type	Field and Description
protected InMemoryLookupTable<VocabWord>	lookupTable
protected VocabCache<VocabWord>	vocabCache
protected Word2Vec	word2Vec

Constructor Summary

Constructors

Constructor and Description
VocabCacheExporter()

Method Summary

Modifier and Type	Method and Description
void	export(org.apache.spark.api.java.JavaRDD<ExportContainer<VocabWord>> rdd) This method will be called at final stage of SequenceVectors training, and JavaRDD being passed as argument will

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

vocabCache

protected VocabCache<VocabWord> vocabCache

lookupTable

protected InMemoryLookupTable<VocabWord> lookupTable

word2Vec

protected Word2Vec word2Vec

Constructor Detail

VocabCacheExporter

public VocabCacheExporter()

Method Detail

export

public void export(org.apache.spark.api.java.JavaRDD<ExportContainer<VocabWord>> rdd)

Description copied from interface: SparkModelExporter

This method will be called at final stage of SequenceVectors training, and JavaRDD being passed as argument will

Specified by:

export in interface SparkModelExporter<VocabWord>