org.deeplearning4j.spark.text.functions

Class TokenizerFunction

java.lang.Object

org.deeplearning4j.spark.text.functions.TokenizerFunction

All Implemented Interfaces:

java.io.Serializable, org.apache.spark.api.java.function.Function<java.lang.String,java.util.List<java.lang.String>>

public class TokenizerFunction
extends java.lang.Object
implements org.apache.spark.api.java.function.Function<java.lang.String,java.util.List<java.lang.String>>

Tokenizer function

See Also:

Serialized Form

Constructor Summary

Constructors

Constructor and Description
TokenizerFunction(java.lang.String tokenizer, java.lang.String tokenizerPreprocessor, int nGrams)

Method Summary

Modifier and Type	Method and Description
java.util.List<java.lang.String>	call(java.lang.String v1)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

TokenizerFunction

public TokenizerFunction(java.lang.String tokenizer,
                         java.lang.String tokenizerPreprocessor,
                         int nGrams)

Method Detail

call

public java.util.List<java.lang.String> call(java.lang.String v1)
                                      throws java.lang.Exception

Specified by:

call in interface org.apache.spark.api.java.function.Function<java.lang.String,java.util.List<java.lang.String>>

Throws:

java.lang.Exception