org.datavec.nlp.annotator

Class TokenizerAnnotator

java.lang.Object

org.cleartk.opennlp.tools.Tokenizer

org.datavec.nlp.annotator.TokenizerAnnotator

public class TokenizerAnnotator
extends org.cleartk.opennlp.tools.Tokenizer

Overrides OpenNLP tokenizer to be thread safe

Constructor Summary

Constructors

Constructor and Description
TokenizerAnnotator()

Method Summary

Modifier and Type	Method and Description
static org.apache.uima.analysis_engine.AnalysisEngineDescription	getDescription()
static org.apache.uima.analysis_engine.AnalysisEngineDescription	getDescription(java.lang.String languageCode)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

TokenizerAnnotator

public TokenizerAnnotator()

Method Detail

getDescription

public static org.apache.uima.analysis_engine.AnalysisEngineDescription getDescription(java.lang.String languageCode)
                                                                                throws org.apache.uima.resource.ResourceInitializationException

Throws:

org.apache.uima.resource.ResourceInitializationException

getDescription

public static org.apache.uima.analysis_engine.AnalysisEngineDescription getDescription()
                                                                                throws org.apache.uima.resource.ResourceInitializationException

Throws:

org.apache.uima.resource.ResourceInitializationException