org.datavec.spark.functions

Class SequenceRecordReaderFunction

java.lang.Object

org.datavec.spark.functions.SequenceRecordReaderFunction

All Implemented Interfaces:

java.io.Serializable, org.apache.spark.api.java.function.Function<scala.Tuple2<java.lang.String,org.apache.spark.input.PortableDataStream>,java.util.List<java.util.List<Writable>>>

public class SequenceRecordReaderFunction
extends java.lang.Object
implements org.apache.spark.api.java.function.Function<scala.Tuple2<java.lang.String,org.apache.spark.input.PortableDataStream>,java.util.List<java.util.List<Writable>>>

RecordReaderFunction: Given a SequenceRecordReader and a file (via Spark PortableDataStream), load and parse the sequence data into a List<List<Writable>>

See Also:

Serialized Form

Field Summary

Fields

Modifier and Type	Field and Description
protected SequenceRecordReader	sequenceRecordReader

Constructor Summary

Constructors

Constructor and Description
SequenceRecordReaderFunction(SequenceRecordReader sequenceRecordReader)

Method Summary

Modifier and Type	Method and Description
java.util.List<java.util.List<Writable>>	call(scala.Tuple2<java.lang.String,org.apache.spark.input.PortableDataStream> value)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

sequenceRecordReader

protected SequenceRecordReader sequenceRecordReader

Constructor Detail

SequenceRecordReaderFunction

public SequenceRecordReaderFunction(SequenceRecordReader sequenceRecordReader)

Method Detail

call

public java.util.List<java.util.List<Writable>> call(scala.Tuple2<java.lang.String,org.apache.spark.input.PortableDataStream> value)
                                              throws java.lang.Exception

Specified by:

call in interface org.apache.spark.api.java.function.Function<scala.Tuple2<java.lang.String,org.apache.spark.input.PortableDataStream>,java.util.List<java.util.List<Writable>>>

Throws:

java.lang.Exception