org.deeplearning4j.datasets.fetchers

Class BaseDataFetcher

java.lang.Object

org.deeplearning4j.datasets.fetchers.BaseDataFetcher

All Implemented Interfaces:

java.io.Serializable, DataSetFetcher

Direct Known Subclasses:

CurvesDataFetcher, IrisDataFetcher, MnistDataFetcher, MovingWindowDataSetFetcher

public abstract class BaseDataFetcher
extends java.lang.Object
implements DataSetFetcher

A base class for assisting with creation of matrices with the data applyTransformToDestination fetcher

See Also:

Serialized Form

Field Summary

Fields

Modifier and Type	Field and Description
protected org.nd4j.linalg.dataset.DataSet	curr
protected int	cursor
protected int	inputColumns
protected static org.slf4j.Logger	log
protected int	numOutcomes
protected int	totalExamples

Constructor Summary

Constructors

Constructor and Description
BaseDataFetcher()

Method Summary

Modifier and Type	Method and Description
protected org.nd4j.linalg.api.ndarray.INDArray	createInputMatrix(int numRows) Creates a feature vector
protected org.nd4j.linalg.api.ndarray.INDArray	createOutputMatrix(int numRows)
protected org.nd4j.linalg.api.ndarray.INDArray	createOutputVector(int outcomeLabel) Creates an output label matrix
int	cursor() Direct access to a number represenative of iterating through a dataset
java.lang.String	getLabelName(int i)
boolean	hasMore() Whether the dataset has more to load
protected void	initializeCurrFromList(java.util.List<org.nd4j.linalg.dataset.DataSet> examples) Initializes this data transform fetcher from the passed in datasets
int	inputColumns() The length of a feature vector for an individual example
org.nd4j.linalg.dataset.DataSet	next() Returns the next data applyTransformToDestination
void	reset() Returns the fetcher back to the beginning of the dataset
void	setLabelNames(java.util.List<java.lang.String> names) Sets a list of label names to the curr dataset
int	totalExamples() The total number of examples
int	totalOutcomes() The number of labels for a dataset

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface org.deeplearning4j.datasets.iterator.DataSetFetcher

fetch

Field Detail

cursor

protected int cursor

numOutcomes

protected int numOutcomes

inputColumns

protected int inputColumns

curr

protected org.nd4j.linalg.dataset.DataSet curr

totalExamples

protected int totalExamples

log

protected static final org.slf4j.Logger log

Constructor Detail

BaseDataFetcher

public BaseDataFetcher()

Method Detail

createInputMatrix

protected org.nd4j.linalg.api.ndarray.INDArray createInputMatrix(int numRows)

Creates a feature vector

Parameters:

numRows - the number of examples

Returns:

a feature vector

createOutputVector

protected org.nd4j.linalg.api.ndarray.INDArray createOutputVector(int outcomeLabel)

Creates an output label matrix

Parameters:

outcomeLabel - the outcome label to use

Returns:

a binary vector where 1 is transform to the index specified by outcomeLabel

createOutputMatrix

protected org.nd4j.linalg.api.ndarray.INDArray createOutputMatrix(int numRows)

initializeCurrFromList

protected void initializeCurrFromList(java.util.List<org.nd4j.linalg.dataset.DataSet> examples)

Initializes this data transform fetcher from the passed in datasets

Parameters:

examples - the examples to use

setLabelNames

public void setLabelNames(java.util.List<java.lang.String> names)

Sets a list of label names to the curr dataset

getLabelName

public java.lang.String getLabelName(int i)

hasMore

public boolean hasMore()

Description copied from interface: DataSetFetcher

Whether the dataset has more to load

Specified by:

hasMore in interface DataSetFetcher

Returns:

whether the data applyTransformToDestination has more to load

next

public org.nd4j.linalg.dataset.DataSet next()

Description copied from interface: DataSetFetcher

Returns the next data applyTransformToDestination

Specified by:

next in interface DataSetFetcher

Returns:

the next dataset

totalOutcomes

public int totalOutcomes()

Description copied from interface: DataSetFetcher

The number of labels for a dataset

Specified by:

totalOutcomes in interface DataSetFetcher

Returns:

the number of labels for a dataset

inputColumns

public int inputColumns()

Description copied from interface: DataSetFetcher

The length of a feature vector for an individual example

Specified by:

inputColumns in interface DataSetFetcher

Returns:

the length of a feature vector for an individual example

totalExamples

public int totalExamples()

Description copied from interface: DataSetFetcher

The total number of examples

Specified by:

totalExamples in interface DataSetFetcher

Returns:

the total number of examples

reset

public void reset()

Description copied from interface: DataSetFetcher

Returns the fetcher back to the beginning of the dataset

Specified by:

reset in interface DataSetFetcher

cursor

public int cursor()

Description copied from interface: DataSetFetcher

Direct access to a number represenative of iterating through a dataset

Specified by:

cursor in interface DataSetFetcher

Returns:

a cursor similar to an index