org.deeplearning4j.parallelism.trainer

Class DefaultTrainer

java.lang.Object

java.lang.Thread

org.deeplearning4j.parallelism.trainer.DefaultTrainer

All Implemented Interfaces:

java.lang.Runnable, Trainer

Direct Known Subclasses:

ParameterServerTrainer

public class DefaultTrainer
extends java.lang.Thread
implements Trainer

Trains datasets using a standard in memory parameter averaging technique. Think of this worker as the simplest form of doing parameter averaging

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
static class	DefaultTrainer.DefaultTrainerBuilder

Nested classes/interfaces inherited from class java.lang.Thread

java.lang.Thread.State, java.lang.Thread.UncaughtExceptionHandler

Field Summary

Fields

Modifier and Type	Field and Description
protected boolean	onRootModel
protected Model	originalModel
protected ParallelWrapper	parallelWrapper
protected java.util.concurrent.LinkedBlockingQueue<org.nd4j.linalg.dataset.api.DataSet>	queue
protected java.util.concurrent.LinkedBlockingQueue<org.nd4j.linalg.dataset.api.MultiDataSet>	queueMDS
protected Model	replicatedModel
protected java.util.concurrent.atomic.AtomicInteger	running
protected java.util.concurrent.atomic.AtomicBoolean	shouldStop
protected java.util.concurrent.atomic.AtomicBoolean	shouldUpdate
protected int	threadId
protected java.lang.Exception	thrownException
protected boolean	useMDS
protected java.lang.String	uuid

Fields inherited from class java.lang.Thread

MAX_PRIORITY, MIN_PRIORITY, NORM_PRIORITY

Constructor Summary

Constructors

Constructor and Description
DefaultTrainer()

Method Summary

Modifier and Type	Method and Description
protected static IterationListener	cloneListener(IterationListener original)
protected void	configureListeners(java.lang.String workerUUID, java.util.Collection<IterationListener> oldListeners, java.util.Collection<IterationListener> replicatedListeners)
void	feedDataSet(org.nd4j.linalg.dataset.api.DataSet dataSet) Train on a DataSet
void	feedMultiDataSet(org.nd4j.linalg.dataset.api.MultiDataSet dataSet) Train on a MultiDataSet
Model	getModel() THe current model for the trainer
boolean	isRunning()
void	run()
protected void	setupIfNeccessary()
void	shutdown() Shutdown this worker
void	updateModel(Model model) Update the current Model for the worker
void	waitTillRunning() Block the main thread till the trainer is up and running.

Methods inherited from class java.lang.Thread

activeCount, checkAccess, clone, countStackFrames, currentThread, destroy, dumpStack, enumerate, getAllStackTraces, getContextClassLoader, getDefaultUncaughtExceptionHandler, getId, getName, getPriority, getStackTrace, getState, getThreadGroup, getUncaughtExceptionHandler, holdsLock, interrupt, interrupted, isAlive, isDaemon, isInterrupted, join, join, join, resume, setContextClassLoader, setDaemon, setDefaultUncaughtExceptionHandler, setName, setPriority, setUncaughtExceptionHandler, sleep, sleep, start, stop, stop, suspend, toString, yield

Methods inherited from class java.lang.Object

equals, finalize, getClass, hashCode, notify, notifyAll, wait, wait, wait

Methods inherited from interface org.deeplearning4j.parallelism.trainer.Trainer

setUncaughtExceptionHandler, start

Field Detail

originalModel

protected Model originalModel

replicatedModel

protected Model replicatedModel

queue

protected java.util.concurrent.LinkedBlockingQueue<org.nd4j.linalg.dataset.api.DataSet> queue

queueMDS

protected java.util.concurrent.LinkedBlockingQueue<org.nd4j.linalg.dataset.api.MultiDataSet> queueMDS

running

protected java.util.concurrent.atomic.AtomicInteger running

threadId

protected int threadId

shouldUpdate

protected java.util.concurrent.atomic.AtomicBoolean shouldUpdate

shouldStop

protected java.util.concurrent.atomic.AtomicBoolean shouldStop

thrownException

protected java.lang.Exception thrownException

useMDS

protected volatile boolean useMDS

uuid

protected final java.lang.String uuid

onRootModel

protected boolean onRootModel

parallelWrapper

protected ParallelWrapper parallelWrapper

Constructor Detail

DefaultTrainer

public DefaultTrainer()

Method Detail

feedMultiDataSet

public void feedMultiDataSet(@NonNull
                             org.nd4j.linalg.dataset.api.MultiDataSet dataSet)

Description copied from interface: Trainer

Train on a MultiDataSet

Specified by:

feedMultiDataSet in interface Trainer

Parameters:

dataSet - the data set to train on

feedDataSet

public void feedDataSet(@NonNull
                        org.nd4j.linalg.dataset.api.DataSet dataSet)

Description copied from interface: Trainer

Train on a DataSet

Specified by:

feedDataSet in interface Trainer

Parameters:

dataSet - the data set to train on

getModel

public Model getModel()

Description copied from interface: Trainer

THe current model for the trainer

Specified by:

getModel in interface Trainer

Returns:

the current Model for the worker

updateModel

public void updateModel(@NonNull
                        Model model)

Description copied from interface: Trainer

Update the current Model for the worker

Specified by:

updateModel in interface Trainer

Parameters:

model - the new model for this worker

setupIfNeccessary

protected void setupIfNeccessary()

isRunning

public boolean isRunning()

Specified by:

isRunning in interface Trainer

shutdown

public void shutdown()

Description copied from interface: Trainer

Shutdown this worker

Specified by:

shutdown in interface Trainer

run

public void run()

Specified by:

run in interface java.lang.Runnable

Overrides:

run in class java.lang.Thread

waitTillRunning

public void waitTillRunning()

Description copied from interface: Trainer

Block the main thread till the trainer is up and running.

Specified by:

waitTillRunning in interface Trainer

cloneListener

protected static IterationListener cloneListener(IterationListener original)

configureListeners

protected void configureListeners(java.lang.String workerUUID,
                                  java.util.Collection<IterationListener> oldListeners,
                                  java.util.Collection<IterationListener> replicatedListeners)