Package org.datavec.nlp.tokenization.tokenizerfactory

Interface Summary

Interface	Description
TokenizerFactory	Generates a tokenizer for a given string

Class Summary

Class	Description
DefaultTokenizerFactory	Default tokenizer based on string tokenizer or stream tokenizer
PosUimaTokenizerFactory	Creates a tokenizer that filters by part of speech tags
UimaTokenizerFactory	Uses a uima AnalysisEngine to tokenize text.