org.datavec.api.records.reader

Interface SequenceRecordReader

All Superinterfaces:

java.lang.AutoCloseable, java.io.Closeable, Configurable, RecordReader, java.io.Serializable

All Known Implementing Classes:

BaseCodecRecordReader, CodecRecordReader, CollectionSequenceRecordReader, CSVNLinesSequenceRecordReader, CSVSequenceRecordReader, NativeCodecRecordReader, RegexSequenceRecordReader, VideoRecordReader

public interface SequenceRecordReader
extends RecordReader

A sequence of records. sequenceRecord() is used locally. sequenceRecord(URI uri, DataInputStream dataInputStream) is used for spark etc.

Field Summary

Fields inherited from interface org.datavec.api.records.reader.RecordReader

APPEND_LABEL, LABELS, NAME_SPACE

Method Summary

Modifier and Type	Method and Description
java.util.List<SequenceRecord>	loadSequenceFromMetaData(java.util.List<RecordMetaData> recordMetaDatas) Load multiple sequence records from the given a list of RecordMetaData instances
SequenceRecord	loadSequenceFromMetaData(RecordMetaData recordMetaData) Load a single sequence record from the given RecordMetaData instance Note: that for data that isn't splittable (i.e., text data that needs to be scanned/split), it is more efficient to load multiple records at once using loadSequenceFromMetaData(List)
SequenceRecord	nextSequence() Similar to sequenceRecord(), but returns a Record object, that may include metadata such as the source of the data
java.util.List<java.util.List<Writable>>	sequenceRecord() Returns a sequence record.
java.util.List<java.util.List<Writable>>	sequenceRecord(java.net.URI uri, java.io.DataInputStream dataInputStream) Load a sequence record from the given DataInputStream Unlike RecordReader.next() the internal state of the RecordReader is not modified Implementations of this method should not close the DataInputStream

Methods inherited from interface org.datavec.api.records.reader.RecordReader

getLabels, getListeners, hasNext, initialize, initialize, loadFromMetaData, loadFromMetaData, next, nextRecord, record, reset, setListeners, setListeners

Methods inherited from interface java.io.Closeable

close

Methods inherited from interface org.datavec.api.conf.Configurable

getConf, setConf

Method Detail

sequenceRecord

java.util.List<java.util.List<Writable>> sequenceRecord()

Returns a sequence record.

Returns:

a sequence of records

sequenceRecord

java.util.List<java.util.List<Writable>> sequenceRecord(java.net.URI uri,
                                                        java.io.DataInputStream dataInputStream)
                                                 throws java.io.IOException

Load a sequence record from the given DataInputStream Unlike RecordReader.next() the internal state of the RecordReader is not modified Implementations of this method should not close the DataInputStream

Throws:

java.io.IOException - if error occurs during reading from the input stream

nextSequence

SequenceRecord nextSequence()

Similar to sequenceRecord(), but returns a Record object, that may include metadata such as the source of the data

Returns:

next sequence record

loadSequenceFromMetaData

SequenceRecord loadSequenceFromMetaData(RecordMetaData recordMetaData)
                                 throws java.io.IOException

Load a single sequence record from the given RecordMetaData instance
Note: that for data that isn't splittable (i.e., text data that needs to be scanned/split), it is more efficient to load multiple records at once using loadSequenceFromMetaData(List)

Parameters:

recordMetaData - Metadata for the sequence record that we want to load from

Returns:

Single sequence record for the given RecordMetaData instance

Throws:

java.io.IOException - If I/O error occurs during loading

loadSequenceFromMetaData

java.util.List<SequenceRecord> loadSequenceFromMetaData(java.util.List<RecordMetaData> recordMetaDatas)
                                                 throws java.io.IOException

Load multiple sequence records from the given a list of RecordMetaData instances

Parameters:

recordMetaDatas - Metadata for the records that we want to load from

Returns:

Multiple sequence record for the given RecordMetaData instances

Throws:

java.io.IOException - If I/O error occurs during loading