org.deeplearning4j.parallelism

Class ParallelWrapper

java.lang.Object

org.deeplearning4j.parallelism.ParallelWrapper

All Implemented Interfaces:

java.lang.AutoCloseable

public class ParallelWrapper
extends java.lang.Object
implements java.lang.AutoCloseable

This is simple data-parallel wrapper suitable for multi-cpu/multi-gpu environments. PLEASE NOTE: This implementation is NOT NUMA-aware.

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
static class	ParallelWrapper.Builder<T extends Model>

Field Summary

Fields

Modifier and Type	Field and Description
protected boolean	averageUpdaters
protected int	averagingFrequency
protected boolean	isMQ
protected java.util.concurrent.atomic.AtomicLong	iterationsCounter
protected boolean	legacyAveraging
protected java.util.List<IterationListener>	listeners
protected Model	model
protected int	prefetchSize
protected boolean	reportScore
protected java.util.concurrent.atomic.AtomicBoolean	stopFit
protected StatsStorageRouter	storageRouter
protected boolean	wasAveraged
protected int	workers
protected Trainer[]	zoo

Constructor Summary

Constructors

Modifier	Constructor and Description
protected	ParallelWrapper(Model model, int workers, int prefetchSize)

Method Summary

Modifier and Type	Method and Description
void	close()
void	fit(org.nd4j.linalg.dataset.api.iterator.DataSetIterator source) This method takes DataSetIterator, and starts training over it by scheduling DataSets to different executors
void	fit(org.nd4j.linalg.dataset.api.iterator.MultiDataSetIterator source)
void	setListeners(java.util.Collection<IterationListener> listeners) This method allows you to specify IterationListeners for this model.
void	setListeners(IterationListener... listeners) This method allows you to specify IterationListeners for this model.
void	setListeners(StatsStorageRouter statsStorage, java.util.Collection<? extends IterationListener> listeners) Set the listeners, along with a StatsStorageRouter that the results will be shuffled to (in the case of any listeners that implement the RoutingIterationListener interface)
void	setListeners(StatsStorageRouter statsStorage, IterationListener... listeners) Set the listeners, along with a StatsStorageRouter that the results will be shuffled to (in the case of any listeners that implement the RoutingIterationListener interface)
void	shutdown() This method causes all threads used for parallel training to stop
void	stopFit() Will stop a fit operation from continuing to iterate.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

model

protected Model model

workers

protected int workers

prefetchSize

protected int prefetchSize

averagingFrequency

protected int averagingFrequency

zoo

protected Trainer[] zoo

iterationsCounter

protected java.util.concurrent.atomic.AtomicLong iterationsCounter

reportScore

protected boolean reportScore

averageUpdaters

protected boolean averageUpdaters

legacyAveraging

protected boolean legacyAveraging

wasAveraged

protected boolean wasAveraged

stopFit

protected java.util.concurrent.atomic.AtomicBoolean stopFit

listeners

protected java.util.List<IterationListener> listeners

storageRouter

protected StatsStorageRouter storageRouter

isMQ

protected boolean isMQ

Constructor Detail

ParallelWrapper

protected ParallelWrapper(Model model,
                          int workers,
                          int prefetchSize)

Method Detail

close

public void close()
           throws java.lang.Exception

Specified by:

close in interface java.lang.AutoCloseable

Throws:

java.lang.Exception

shutdown

public void shutdown()

This method causes all threads used for parallel training to stop

stopFit

public void stopFit()

Will stop a fit operation from continuing to iterate.

fit

public void fit(@NonNull
                org.nd4j.linalg.dataset.api.iterator.MultiDataSetIterator source)

Parameters:

source -

setListeners

public void setListeners(@NonNull
                         java.util.Collection<IterationListener> listeners)

This method allows you to specify IterationListeners for this model. Note that for listeners like StatsListener (that have state that will be sent somewhere), consider instead using setListeners(StatsStorageRouter, Collection)

Parameters:

listeners - Listeners to set

setListeners

public void setListeners(@NonNull
                         IterationListener... listeners)

This method allows you to specify IterationListeners for this model. Note that for listeners like StatsListener (that have state that will be sent somewhere), consider instead using setListeners(StatsStorageRouter, Collection)

Parameters:

listeners - Listeners to set

setListeners

public void setListeners(StatsStorageRouter statsStorage,
                         IterationListener... listeners)

Set the listeners, along with a StatsStorageRouter that the results will be shuffled to (in the case of any listeners that implement the RoutingIterationListener interface)

Parameters:

statsStorage - Stats storage router to place the results into

listeners - Listeners to set

setListeners

public void setListeners(StatsStorageRouter statsStorage,
                         java.util.Collection<? extends IterationListener> listeners)

Set the listeners, along with a StatsStorageRouter that the results will be shuffled to (in the case of any listeners that implement the RoutingIterationListener interface)

Parameters:

statsStorage - Stats storage router to place the results into

listeners - Listeners to set

fit

public void fit(@NonNull
                org.nd4j.linalg.dataset.api.iterator.DataSetIterator source)

This method takes DataSetIterator, and starts training over it by scheduling DataSets to different executors

Parameters:

source -