org.deeplearning4j.parallelism

Class MagicQueue

java.lang.Object

org.deeplearning4j.parallelism.MagicQueue

All Implemented Interfaces:

java.lang.Iterable<org.nd4j.linalg.dataset.DataSet>, java.util.Collection<org.nd4j.linalg.dataset.DataSet>, java.util.concurrent.BlockingQueue<org.nd4j.linalg.dataset.DataSet>, java.util.Queue<org.nd4j.linalg.dataset.DataSet>

public class MagicQueue
extends java.lang.Object
implements java.util.concurrent.BlockingQueue<org.nd4j.linalg.dataset.DataSet>

Limited Queue implementation, suited for multi-gpu prefetch. Basic idea is simple: DataSets are coming from DataSetIterator, and their device location is unknown. So, for better performance DataSets should be transparently moved to the devices where they will be used later, and this should be done in background.

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
static class	MagicQueue.Builder
static class	MagicQueue.Mode

Field Summary

Fields

Modifier and Type	Field and Description
protected java.util.List<java.util.concurrent.LinkedBlockingQueue<org.nd4j.linalg.dataset.DataSet>>	backingQueues
protected int	capacity
protected java.util.concurrent.atomic.AtomicLong	cntGet
protected java.util.concurrent.atomic.AtomicLong	cntPut
protected java.util.List<org.deeplearning4j.parallelism.MagicQueue.QueueHandler>	handlers
protected java.util.concurrent.atomic.AtomicInteger	interleavedCounter
protected java.util.concurrent.atomic.AtomicInteger	interleavedPutter
protected MagicQueue.Mode	mode
protected java.util.concurrent.atomic.AtomicInteger	nextBucket
protected int	numberOfBuckets

Constructor Summary

Constructors

Modifier	Constructor and Description
protected	MagicQueue(int numberOfFlows, int capacity)

Method Summary

Modifier and Type	Method and Description
boolean	add(org.nd4j.linalg.dataset.DataSet dataSet)
boolean	addAll(java.util.Collection<? extends org.nd4j.linalg.dataset.DataSet> c)
void	clear()
boolean	contains(java.lang.Object o) This method isn't supported
boolean	containsAll(java.util.Collection<?> c) This method isn't supported
int	drainTo(java.util.Collection<? super org.nd4j.linalg.dataset.DataSet> c)
int	drainTo(java.util.Collection<? super org.nd4j.linalg.dataset.DataSet> c, int maxElements)
org.nd4j.linalg.dataset.DataSet	element()
boolean	isEmpty()
java.util.Iterator<org.nd4j.linalg.dataset.DataSet>	iterator() This method isn't supported
boolean	offer(org.nd4j.linalg.dataset.DataSet dataSet)
boolean	offer(org.nd4j.linalg.dataset.DataSet dataSet, long timeout, java.util.concurrent.TimeUnit unit)
org.nd4j.linalg.dataset.DataSet	peek()
org.nd4j.linalg.dataset.DataSet	poll() This method is supposed to be called from managed thread, attached to specific device.
org.nd4j.linalg.dataset.DataSet	poll(long time, java.util.concurrent.TimeUnit timeUnit) This method is supposed to be called from managed thread, attached to specific device.
void	put(org.nd4j.linalg.dataset.DataSet dataSet)
int	remainingCapacity()
org.nd4j.linalg.dataset.DataSet	remove()
boolean	remove(java.lang.Object o) This method isn't supported
boolean	removeAll(java.util.Collection<?> c) This method isn't supported
boolean	retainAll(java.util.Collection<?> c) This method isn't supported
int	size() This method returns average queue size for all devices
protected int	size(int deviceId)
org.nd4j.linalg.dataset.DataSet	take()
java.lang.Object[]	toArray() This method isn't supported
<T> T[]	toArray(T[] a) This method isn't supported

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface java.util.Collection

equals, hashCode, parallelStream, removeIf, spliterator, stream

Methods inherited from interface java.lang.Iterable

forEach

Field Detail

backingQueues

protected final java.util.List<java.util.concurrent.LinkedBlockingQueue<org.nd4j.linalg.dataset.DataSet>> backingQueues

nextBucket

protected final java.util.concurrent.atomic.AtomicInteger nextBucket

numberOfBuckets

protected final int numberOfBuckets

handlers

protected final java.util.List<org.deeplearning4j.parallelism.MagicQueue.QueueHandler> handlers

capacity

protected int capacity

mode

protected MagicQueue.Mode mode

interleavedCounter

protected java.util.concurrent.atomic.AtomicInteger interleavedCounter

interleavedPutter

protected java.util.concurrent.atomic.AtomicInteger interleavedPutter

cntPut

protected java.util.concurrent.atomic.AtomicLong cntPut

cntGet

protected java.util.concurrent.atomic.AtomicLong cntGet

Constructor Detail

MagicQueue

protected MagicQueue(int numberOfFlows,
                     int capacity)

Method Detail

size

public int size()

This method returns average queue size for all devices

Specified by:

size in interface java.util.Collection<org.nd4j.linalg.dataset.DataSet>

Returns:

size

protected int size(int deviceId)

isEmpty

public boolean isEmpty()

Specified by:

isEmpty in interface java.util.Collection<org.nd4j.linalg.dataset.DataSet>

contains

public boolean contains(java.lang.Object o)

This method isn't supported

Specified by:

contains in interface java.util.Collection<org.nd4j.linalg.dataset.DataSet>

Specified by:

contains in interface java.util.concurrent.BlockingQueue<org.nd4j.linalg.dataset.DataSet>

Parameters:

o -

Returns:

drainTo

public int drainTo(java.util.Collection<? super org.nd4j.linalg.dataset.DataSet> c)

Specified by:

drainTo in interface java.util.concurrent.BlockingQueue<org.nd4j.linalg.dataset.DataSet>

drainTo

public int drainTo(java.util.Collection<? super org.nd4j.linalg.dataset.DataSet> c,
                   int maxElements)

Specified by:

drainTo in interface java.util.concurrent.BlockingQueue<org.nd4j.linalg.dataset.DataSet>

iterator

public java.util.Iterator<org.nd4j.linalg.dataset.DataSet> iterator()

This method isn't supported

Specified by:

iterator in interface java.lang.Iterable<org.nd4j.linalg.dataset.DataSet>

Specified by:

iterator in interface java.util.Collection<org.nd4j.linalg.dataset.DataSet>

Returns:

toArray

public java.lang.Object[] toArray()

This method isn't supported

Specified by:

toArray in interface java.util.Collection<org.nd4j.linalg.dataset.DataSet>

Returns:

toArray

public <T> T[] toArray(T[] a)

This method isn't supported

Specified by:

toArray in interface java.util.Collection<org.nd4j.linalg.dataset.DataSet>

Type Parameters:

T -

Parameters:

a -

Returns:

add

public boolean add(org.nd4j.linalg.dataset.DataSet dataSet)

Specified by:

add in interface java.util.Collection<org.nd4j.linalg.dataset.DataSet>

Specified by:

add in interface java.util.concurrent.BlockingQueue<org.nd4j.linalg.dataset.DataSet>

Specified by:

add in interface java.util.Queue<org.nd4j.linalg.dataset.DataSet>

remove

public boolean remove(java.lang.Object o)

This method isn't supported

Specified by:

remove in interface java.util.Collection<org.nd4j.linalg.dataset.DataSet>

Specified by:

remove in interface java.util.concurrent.BlockingQueue<org.nd4j.linalg.dataset.DataSet>

Parameters:

o -

Returns:

containsAll

public boolean containsAll(java.util.Collection<?> c)

This method isn't supported

Specified by:

containsAll in interface java.util.Collection<org.nd4j.linalg.dataset.DataSet>

Parameters:

c -

Returns:

addAll

public boolean addAll(java.util.Collection<? extends org.nd4j.linalg.dataset.DataSet> c)

Specified by:

addAll in interface java.util.Collection<org.nd4j.linalg.dataset.DataSet>

removeAll

public boolean removeAll(java.util.Collection<?> c)

This method isn't supported

Specified by:

removeAll in interface java.util.Collection<org.nd4j.linalg.dataset.DataSet>

Parameters:

c -

Returns:

retainAll

public boolean retainAll(java.util.Collection<?> c)

This method isn't supported

Specified by:

retainAll in interface java.util.Collection<org.nd4j.linalg.dataset.DataSet>

Parameters:

c -

Returns:

clear

public void clear()

Specified by:

clear in interface java.util.Collection<org.nd4j.linalg.dataset.DataSet>

offer

public boolean offer(org.nd4j.linalg.dataset.DataSet dataSet)

Specified by:

offer in interface java.util.concurrent.BlockingQueue<org.nd4j.linalg.dataset.DataSet>

Specified by:

offer in interface java.util.Queue<org.nd4j.linalg.dataset.DataSet>

put

public void put(org.nd4j.linalg.dataset.DataSet dataSet)
         throws java.lang.InterruptedException

Specified by:

put in interface java.util.concurrent.BlockingQueue<org.nd4j.linalg.dataset.DataSet>

Throws:

java.lang.InterruptedException

offer

public boolean offer(org.nd4j.linalg.dataset.DataSet dataSet,
                     long timeout,
                     java.util.concurrent.TimeUnit unit)
              throws java.lang.InterruptedException

Specified by:

offer in interface java.util.concurrent.BlockingQueue<org.nd4j.linalg.dataset.DataSet>

Throws:

java.lang.InterruptedException

take

public org.nd4j.linalg.dataset.DataSet take()
                                     throws java.lang.InterruptedException

Specified by:

take in interface java.util.concurrent.BlockingQueue<org.nd4j.linalg.dataset.DataSet>

Throws:

java.lang.InterruptedException

remove

public org.nd4j.linalg.dataset.DataSet remove()

Specified by:

remove in interface java.util.Queue<org.nd4j.linalg.dataset.DataSet>

poll

public org.nd4j.linalg.dataset.DataSet poll(long time,
                                            java.util.concurrent.TimeUnit timeUnit)
                                     throws java.lang.InterruptedException

This method is supposed to be called from managed thread, attached to specific device. It returns 1 DataSet element from head of the queue, and deletes that element from Queue. If queue is empty, Please note: if there's nothing available in Queue - NULL will be returned

Specified by:

poll in interface java.util.concurrent.BlockingQueue<org.nd4j.linalg.dataset.DataSet>

Parameters:

time - time to wait for something appear in queue

timeUnit - TimeUnit for time param

Returns:

Throws:

java.lang.InterruptedException

remainingCapacity

public int remainingCapacity()

Specified by:

remainingCapacity in interface java.util.concurrent.BlockingQueue<org.nd4j.linalg.dataset.DataSet>

poll

public org.nd4j.linalg.dataset.DataSet poll()

This method is supposed to be called from managed thread, attached to specific device. It returns 1 DataSet element from head of the queue, and deletes that element from Queue Please note: if there's nothing available in Queue - NULL will be returned

Specified by:

poll in interface java.util.Queue<org.nd4j.linalg.dataset.DataSet>

Returns:

element

public org.nd4j.linalg.dataset.DataSet element()

Specified by:

element in interface java.util.Queue<org.nd4j.linalg.dataset.DataSet>

peek

public org.nd4j.linalg.dataset.DataSet peek()

Specified by:

peek in interface java.util.Queue<org.nd4j.linalg.dataset.DataSet>