| Interface | Description |
|---|---|
| TokenizerFactory |
Generates a tokenizer for a given string
|
| Class | Description |
|---|---|
| DefaultTokenizerFactory |
Default tokenizer based on string tokenizer or stream tokenizer
|
| JapaneseTokenizerFactory | |
| KoreanTokenizerFactory |
Created by kepricon on 16.
|
| NGramTokenizerFactory | |
| PosUimaTokenizerFactory |
Creates a tokenizer that filters by
part of speech tags
|
| PosUimaTokenizerFactoryTest | |
| UimaTokenizerFactory |
Uses a uima
AnalysisEngine to
tokenize text. |