org.datavec.api.split

Class FileSplit

java.lang.Object

org.datavec.api.split.BaseInputSplit

org.datavec.api.split.FileSplit

All Implemented Interfaces:

java.io.Serializable, InputSplit, Writable

public class FileSplit
extends BaseInputSplit

File input split. Splits up a root directory in to files.

See Also:

Serialized Form

Field Summary

Fields

Modifier and Type	Field and Description
protected java.lang.String[]	allowFormat
protected java.util.Random	random
protected boolean	randomize
protected boolean	recursive
protected java.io.File	rootDir

Fields inherited from class org.datavec.api.split.BaseInputSplit

iterationOrder, length, uriStrings

Constructor Summary

Constructors

Modifier	Constructor and Description
	FileSplit(java.io.File rootDir)
	FileSplit(java.io.File rootDir, java.util.Random rng)
	FileSplit(java.io.File rootDir, java.lang.String[] allowFormat)
	FileSplit(java.io.File rootDir, java.lang.String[] allowFormat, boolean recursive)
protected	FileSplit(java.io.File rootDir, java.lang.String[] allowFormat, boolean recursive, java.util.Random random, boolean runMain)
	FileSplit(java.io.File rootDir, java.lang.String[] allowFormat, java.util.Random rng)

Method Summary

Modifier and Type	Method and Description
java.io.File	getRootDir()
protected void	initialize()
long	length() Length of the split
void	readFields(java.io.DataInput in) Deserialize the fields of this object from in.
void	reset() Reset the InputSplit without reinitializing it from scratch.
void	write(java.io.DataOutput out) Serialize the fields of this object to out.

Methods inherited from class org.datavec.api.split.BaseInputSplit

locations, locationsIterator, locationsPathIterator, sample, toDouble, toFloat, toInt, toLong

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

rootDir

protected java.io.File rootDir

allowFormat

protected java.lang.String[] allowFormat

recursive

protected boolean recursive

random

protected java.util.Random random

randomize

protected boolean randomize

Constructor Detail

FileSplit

protected FileSplit(java.io.File rootDir,
                    java.lang.String[] allowFormat,
                    boolean recursive,
                    java.util.Random random,
                    boolean runMain)

FileSplit

public FileSplit(java.io.File rootDir)

FileSplit

public FileSplit(java.io.File rootDir,
                 java.util.Random rng)

FileSplit

public FileSplit(java.io.File rootDir,
                 java.lang.String[] allowFormat)

FileSplit

public FileSplit(java.io.File rootDir,
                 java.lang.String[] allowFormat,
                 java.util.Random rng)

FileSplit

public FileSplit(java.io.File rootDir,
                 java.lang.String[] allowFormat,
                 boolean recursive)

Method Detail

initialize

protected void initialize()

length

public long length()

Description copied from interface: InputSplit

Length of the split

Specified by:

length in interface InputSplit

Overrides:

length in class BaseInputSplit

Returns:

reset

public void reset()

Description copied from interface: InputSplit

Reset the InputSplit without reinitializing it from scratch. In many cases, this is a no-op. For InputSplits that have randomization: reset should shuffle the order.

write

public void write(java.io.DataOutput out)
           throws java.io.IOException

Description copied from interface: Writable

Serialize the fields of this object to out.

Parameters:

out - DataOuput to serialize this object into.

Throws:

java.io.IOException

readFields

public void readFields(java.io.DataInput in)
                throws java.io.IOException

Description copied from interface: Writable

Deserialize the fields of this object from in.

For efficiency, implementations should attempt to re-use storage in the existing object where possible.

Parameters:

in - DataInput to deseriablize this object from.

Throws:

java.io.IOException

getRootDir

public java.io.File getRootDir()