org.deeplearning4j.models.word2vec

Class Word2Vec

java.lang.Object

org.deeplearning4j.models.embeddings.wordvectors.WordVectorsImpl<T>

org.deeplearning4j.models.sequencevectors.SequenceVectors<VocabWord>

org.deeplearning4j.models.word2vec.Word2Vec

All Implemented Interfaces:

java.io.Serializable, WordVectors

Direct Known Subclasses:

ParagraphVectors

public class Word2Vec
extends SequenceVectors<VocabWord>

This is Word2Vec implementation based on SequenceVectors

See Also:

Serialized Form

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
static class	Word2Vec.Builder

Nested classes/interfaces inherited from class org.deeplearning4j.models.sequencevectors.SequenceVectors

SequenceVectors.AsyncSequencer

Field Summary

Fields

Modifier and Type	Field and Description
protected SentenceIterator	sentenceIter
protected TokenizerFactory	tokenizerFactory

Fields inherited from class org.deeplearning4j.models.sequencevectors.SequenceVectors

configuration, configured, elementsLearningAlgorithm, enableScavenger, eventListeners, existingModel, iterator, log, scoreElements, scoreSequences, sequenceLearningAlgorithm, unknownElement

Fields inherited from class org.deeplearning4j.models.embeddings.wordvectors.WordVectorsImpl

batchSize, DEFAULT_UNK, layerSize, learningRate, learningRateDecayWords, lookupTable, minLearningRate, minWordFrequency, modelUtils, negative, numEpochs, numIterations, resetModel, sampling, seed, stopWords, trainElementsVectors, trainSequenceVectors, useAdeGrad, useUnknown, variableWindows, vocab, window, workers

Constructor Summary

Constructors

Constructor and Description
Word2Vec()

Method Summary

Modifier and Type	Method and Description
void	setSentenceIterator(SentenceIterator iterator) This method defines SentenceIterator instance, that will be used as training corpus source
void	setSequenceIterator(SequenceIterator<VocabWord> iterator) This method defines SequenceIterator instance, that will be used as training corpus source.
void	setTokenizerFactory(TokenizerFactory tokenizerFactory) This method defines TokenizerFactory instance to be using during model building

Methods inherited from class org.deeplearning4j.models.sequencevectors.SequenceVectors

buildVocab, fit, getElementsScore, getSequencesScore, getUNK, getWordVectorMatrix, initLearners, trainSequence

Methods inherited from class org.deeplearning4j.models.embeddings.wordvectors.WordVectorsImpl

accuracy, getLayerSize, getWordVector, getWordVectorMatrixNormalized, getWordVectors, getWordVectorsMean, hasWord, indexOf, lookupTable, setLookupTable, setModelUtils, setVocab, similarity, similarWordsInVocabTo, update, update, vocab, wordsNearest, wordsNearest, wordsNearest, wordsNearestSum, wordsNearestSum, wordsNearestSum

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface org.deeplearning4j.models.embeddings.wordvectors.WordVectors

accuracy, getWordVector, getWordVectorMatrixNormalized, getWordVectors, getWordVectorsMean, hasWord, indexOf, lookupTable, setModelUtils, setUNK, similarity, similarWordsInVocabTo, vocab, wordsNearest, wordsNearest, wordsNearest, wordsNearestSum, wordsNearestSum, wordsNearestSum

Field Detail

sentenceIter

protected transient SentenceIterator sentenceIter

tokenizerFactory

protected transient TokenizerFactory tokenizerFactory

Constructor Detail

Word2Vec

public Word2Vec()

Method Detail

setTokenizerFactory

public void setTokenizerFactory(@NonNull
                                TokenizerFactory tokenizerFactory)

This method defines TokenizerFactory instance to be using during model building

Parameters:

tokenizerFactory - TokenizerFactory instance

setSentenceIterator

public void setSentenceIterator(@NonNull
                                SentenceIterator iterator)

This method defines SentenceIterator instance, that will be used as training corpus source

Parameters:

iterator - SentenceIterator instance

setSequenceIterator

public void setSequenceIterator(@NonNull
                                SequenceIterator<VocabWord> iterator)

This method defines SequenceIterator instance, that will be used as training corpus source. Main difference with other iterators here: it allows you to pass already tokenized Sequence for training

Parameters:

iterator -