org.datavec.spark.functions.pairdata

Class PairSequenceRecordReaderBytesFunction

java.lang.Object

org.datavec.spark.functions.pairdata.PairSequenceRecordReaderBytesFunction

All Implemented Interfaces:

java.io.Serializable, org.apache.spark.api.java.function.Function<scala.Tuple2<org.apache.hadoop.io.Text,BytesPairWritable>,scala.Tuple2<java.util.List<java.util.List<Writable>>,java.util.List<java.util.List<Writable>>>>

public class PairSequenceRecordReaderBytesFunction
extends java.lang.Object
implements org.apache.spark.api.java.function.Function<scala.Tuple2<org.apache.hadoop.io.Text,BytesPairWritable>,scala.Tuple2<java.util.List<java.util.List<Writable>>,java.util.List<java.util.List<Writable>>>>

SequenceRecordReaderBytesFunction: Converts two sets of binary data (in the form of a BytesPairWritable) to DataVec format data (Tuple2<List<List<<Writable>>,List<List<Writable>>) using two SequenceRecordReaders. Used for example when network input and output data comes from different files

See Also:

Serialized Form

Constructor Summary

Constructors

Constructor and Description
PairSequenceRecordReaderBytesFunction(SequenceRecordReader recordReaderFirst, SequenceRecordReader recordReaderSecond)

Method Summary

Modifier and Type	Method and Description
scala.Tuple2<java.util.List<java.util.List<Writable>>,java.util.List<java.util.List<Writable>>>	call(scala.Tuple2<org.apache.hadoop.io.Text,BytesPairWritable> v1)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

PairSequenceRecordReaderBytesFunction

public PairSequenceRecordReaderBytesFunction(SequenceRecordReader recordReaderFirst,
                                             SequenceRecordReader recordReaderSecond)

Method Detail

call

public scala.Tuple2<java.util.List<java.util.List<Writable>>,java.util.List<java.util.List<Writable>>> call(scala.Tuple2<org.apache.hadoop.io.Text,BytesPairWritable> v1)
                                                                                                     throws java.lang.Exception

Specified by:

call in interface org.apache.spark.api.java.function.Function<scala.Tuple2<org.apache.hadoop.io.Text,BytesPairWritable>,scala.Tuple2<java.util.List<java.util.List<Writable>>,java.util.List<java.util.List<Writable>>>>

Throws:

java.lang.Exception