org.deeplearning4j.datasets.iterator.impl

Class CifarDataSetIterator

java.lang.Object

org.deeplearning4j.datasets.datavec.RecordReaderDataSetIterator

org.deeplearning4j.datasets.iterator.impl.CifarDataSetIterator

All Implemented Interfaces:

java.io.Serializable, java.util.Iterator<org.nd4j.linalg.dataset.DataSet>, org.nd4j.linalg.dataset.api.iterator.DataSetIterator

public class CifarDataSetIterator
extends RecordReaderDataSetIterator

CifarDataSetIterator is an iterator for Cifar10 dataset explicitly There is a special preProcessor used to normalize the dataset based on Sergey Zagoruyko example https://github.com/szagoruyko/cifar.torch

See Also:

Serialized Form

Field Summary

Fields

Modifier and Type	Field and Description
protected static int	channels
protected int	exampleCount
protected static int	height
protected org.datavec.image.transform.ImageTransform	imageTransform
protected static org.datavec.image.loader.CifarLoader	loader
protected int	numExamples
protected boolean	overshot
protected int	totalExamples
protected static boolean	train
protected static boolean	useSpecialPreProcessCifar
protected static int	width

Fields inherited from class org.deeplearning4j.datasets.datavec.RecordReaderDataSetIterator

batchNum, batchSize, converter, labelIndex, labelIndexTo, last, maxNumBatches, numPossibleLabels, preProcessor, recordReader, regression, sequenceIter, useCurrent

Constructor Summary

Constructors

Constructor and Description
CifarDataSetIterator(int batchSize, int numExamples) Loads images with given batchSize & numExamples returned by the generator.
CifarDataSetIterator(int batchSize, int[] imgDim) Loads images with given batchSize & imgDim returned by the generator.
CifarDataSetIterator(int batchSize, int numExamples, boolean train) Loads images with given batchSize, numExamples, & version returned by the generator.
CifarDataSetIterator(int batchSize, int numExamples, int[] imgDim) Loads images with given batchSize, numExamples, & imgDim returned by the generator.
CifarDataSetIterator(int batchSize, int numExamples, int[] imgDim, boolean train) Loads images with given batchSize, numExamples, imgDim & version returned by the generator.
CifarDataSetIterator(int batchSize, int numExamples, int[] imgDim, boolean useSpecialPreProcessCifar, boolean train) Loads images with given batchSize, numExamples, imgDim & version returned by the generator.
CifarDataSetIterator(int batchSize, int numExamples, int[] imgDim, int numPossibleLables, org.datavec.image.transform.ImageTransform imageTransform, boolean useSpecialPreProcessCifar, boolean train) Create Cifar data specific iterator

Method Summary

Modifier and Type	Method and Description
boolean	asyncSupported()
java.util.List<java.lang.String>	getLabels()
boolean	hasNext()
org.nd4j.linalg.dataset.DataSet	next(int batchSize)
void	reset()
void	test()
void	test(int numExamples)
void	test(int numExamples, int batchSize)
int	totalExamples()
void	train()

Methods inherited from class org.deeplearning4j.datasets.datavec.RecordReaderDataSetIterator

batch, cursor, inputColumns, loadFromMetaData, loadFromMetaData, next, numExamples, remove, resetSupported, setPreProcessor, totalOutcomes

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface org.nd4j.linalg.dataset.api.iterator.DataSetIterator

getPreProcessor

Methods inherited from interface java.util.Iterator

forEachRemaining

Field Detail

height

protected static int height

width

protected static int width

channels

protected static int channels

loader

protected static org.datavec.image.loader.CifarLoader loader

totalExamples

protected int totalExamples

numExamples

protected int numExamples

exampleCount

protected int exampleCount

overshot

protected boolean overshot

imageTransform

protected org.datavec.image.transform.ImageTransform imageTransform

useSpecialPreProcessCifar

protected static boolean useSpecialPreProcessCifar

train

protected static boolean train

Constructor Detail

CifarDataSetIterator

public CifarDataSetIterator(int batchSize,
                            int numExamples,
                            boolean train)

Loads images with given batchSize, numExamples, & version returned by the generator.

CifarDataSetIterator

public CifarDataSetIterator(int batchSize,
                            int numExamples,
                            int[] imgDim)

Loads images with given batchSize, numExamples, & imgDim returned by the generator.

CifarDataSetIterator

public CifarDataSetIterator(int batchSize,
                            int numExamples,
                            int[] imgDim,
                            boolean train)

Loads images with given batchSize, numExamples, imgDim & version returned by the generator.

CifarDataSetIterator

public CifarDataSetIterator(int batchSize,
                            int numExamples)

Loads images with given batchSize & numExamples returned by the generator.

CifarDataSetIterator

public CifarDataSetIterator(int batchSize,
                            int[] imgDim)

Loads images with given batchSize & imgDim returned by the generator.

CifarDataSetIterator

public CifarDataSetIterator(int batchSize,
                            int numExamples,
                            int[] imgDim,
                            boolean useSpecialPreProcessCifar,
                            boolean train)

Loads images with given batchSize, numExamples, imgDim & version returned by the generator.

CifarDataSetIterator

public CifarDataSetIterator(int batchSize,
                            int numExamples,
                            int[] imgDim,
                            int numPossibleLables,
                            org.datavec.image.transform.ImageTransform imageTransform,
                            boolean useSpecialPreProcessCifar,
                            boolean train)

Create Cifar data specific iterator

Parameters:

batchSize - the batch size of the examples

imgDim - an array of height, width and channels

numExamples - the overall number of examples

imageTransform - the transformation to apply to the images

useSpecialPreProcessCifar - use Zagoruyko's preprocess for Cifar

train - true if use training set and false for test

Method Detail

next

public org.nd4j.linalg.dataset.DataSet next(int batchSize)

Specified by:

next in interface org.nd4j.linalg.dataset.api.iterator.DataSetIterator

Overrides:

next in class RecordReaderDataSetIterator

hasNext

public boolean hasNext()

Specified by:

hasNext in interface java.util.Iterator<org.nd4j.linalg.dataset.DataSet>

Overrides:

hasNext in class RecordReaderDataSetIterator

totalExamples

public int totalExamples()

Specified by:

totalExamples in interface org.nd4j.linalg.dataset.api.iterator.DataSetIterator

Overrides:

totalExamples in class RecordReaderDataSetIterator

reset

public void reset()

Specified by:

reset in interface org.nd4j.linalg.dataset.api.iterator.DataSetIterator

Overrides:

reset in class RecordReaderDataSetIterator

getLabels

public java.util.List<java.lang.String> getLabels()

Specified by:

getLabels in interface org.nd4j.linalg.dataset.api.iterator.DataSetIterator

Overrides:

getLabels in class RecordReaderDataSetIterator

asyncSupported

public boolean asyncSupported()

Specified by:

asyncSupported in interface org.nd4j.linalg.dataset.api.iterator.DataSetIterator

Overrides:

asyncSupported in class RecordReaderDataSetIterator

train

public void train()

test

public void test()

test

public void test(int numExamples)

test

public void test(int numExamples,
                 int batchSize)