Package org.apache.hadoop.util

Class SemaphoredDelegatingExecutor

java.lang.Object

org.apache.hadoop.thirdparty.com.google.common.collect.ForwardingObject

org.apache.hadoop.thirdparty.com.google.common.util.concurrent.ForwardingExecutorService

org.apache.hadoop.util.SemaphoredDelegatingExecutor

All Implemented Interfaces:

java.util.concurrent.Executor, java.util.concurrent.ExecutorService

Direct Known Subclasses:

BlockingThreadPoolExecutorService

@Private
public class SemaphoredDelegatingExecutor
extends org.apache.hadoop.thirdparty.com.google.common.util.concurrent.ForwardingExecutorService

This ExecutorService blocks the submission of new tasks when its queue is already full by using a semaphore. Task submissions require permits, task completions release permits.

This is a refactoring of BlockingThreadPoolExecutorService; that code contains the thread pool logic, whereas this isolates the semaphore and submit logic for use with other thread pools and delegation models.

This is inspired by this s4 threadpool

Constructor Summary

Constructors

Constructor	Description
SemaphoredDelegatingExecutor(java.util.concurrent.ExecutorService executorDelegatee, int permitCount, boolean fair)	Instantiate without collecting executor aquisition duration information.
SemaphoredDelegatingExecutor(java.util.concurrent.ExecutorService executorDelegatee, int permitCount, boolean fair, DurationTrackerFactory trackerFactory)	Instantiate.

Method Summary

Modifier and Type	Method	Description
protected java.util.concurrent.ExecutorService	delegate()
void	execute(java.lang.Runnable command)
int	getAvailablePermits()	Get the number of permits available; guaranteed to be 0 <= availablePermits <= size.
int	getPermitCount()	Total number of permits.
int	getWaitingCount()	Get the number of threads waiting to acquire a permit.
<T> java.util.List<java.util.concurrent.Future<T>>	invokeAll(java.util.Collection<? extends java.util.concurrent.Callable<T>> tasks)
<T> java.util.List<java.util.concurrent.Future<T>>	invokeAll(java.util.Collection<? extends java.util.concurrent.Callable<T>> tasks, long timeout, java.util.concurrent.TimeUnit unit)
<T> T	invokeAny(java.util.Collection<? extends java.util.concurrent.Callable<T>> tasks)
<T> T	invokeAny(java.util.Collection<? extends java.util.concurrent.Callable<T>> tasks, long timeout, java.util.concurrent.TimeUnit unit)
java.util.concurrent.Future<?>	submit(java.lang.Runnable task)
<T> java.util.concurrent.Future<T>	submit(java.lang.Runnable task, T result)
<T> java.util.concurrent.Future<T>	submit(java.util.concurrent.Callable<T> task)
java.lang.String	toString()

Methods inherited from class org.apache.hadoop.thirdparty.com.google.common.util.concurrent.ForwardingExecutorService

awaitTermination, isShutdown, isTerminated, shutdown, shutdownNow

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, wait, wait, wait

Constructor Detail

SemaphoredDelegatingExecutor

public SemaphoredDelegatingExecutor(java.util.concurrent.ExecutorService executorDelegatee,
                                    int permitCount,
                                    boolean fair,
                                    DurationTrackerFactory trackerFactory)

Instantiate.

Parameters:

executorDelegatee - Executor to delegate to

permitCount - number of permits into the queue permitted

fair - should the semaphore be "fair"

trackerFactory - duration tracker factory.

SemaphoredDelegatingExecutor

public SemaphoredDelegatingExecutor(java.util.concurrent.ExecutorService executorDelegatee,
                                    int permitCount,
                                    boolean fair)

Instantiate without collecting executor aquisition duration information.

Parameters:

executorDelegatee - Executor to delegate to

permitCount - number of permits into the queue permitted

fair - should the semaphore be "fair"

Method Detail

delegate

protected java.util.concurrent.ExecutorService delegate()

Specified by:

delegate in class org.apache.hadoop.thirdparty.com.google.common.util.concurrent.ForwardingExecutorService

invokeAll

public <T> java.util.List<java.util.concurrent.Future<T>> invokeAll(java.util.Collection<? extends java.util.concurrent.Callable<T>> tasks)
                                                             throws java.lang.InterruptedException

Specified by:

invokeAll in interface java.util.concurrent.ExecutorService

Overrides:

invokeAll in class org.apache.hadoop.thirdparty.com.google.common.util.concurrent.ForwardingExecutorService

Throws:

java.lang.InterruptedException

invokeAll

public <T> java.util.List<java.util.concurrent.Future<T>> invokeAll(java.util.Collection<? extends java.util.concurrent.Callable<T>> tasks,
                                                                    long timeout,
                                                                    java.util.concurrent.TimeUnit unit)
                                                             throws java.lang.InterruptedException

Specified by:

invokeAll in interface java.util.concurrent.ExecutorService

Overrides:

invokeAll in class org.apache.hadoop.thirdparty.com.google.common.util.concurrent.ForwardingExecutorService

Throws:

java.lang.InterruptedException

invokeAny

public <T> T invokeAny(java.util.Collection<? extends java.util.concurrent.Callable<T>> tasks)
                throws java.lang.InterruptedException,
                       java.util.concurrent.ExecutionException

Specified by:

invokeAny in interface java.util.concurrent.ExecutorService

Overrides:

invokeAny in class org.apache.hadoop.thirdparty.com.google.common.util.concurrent.ForwardingExecutorService

Throws:

java.lang.InterruptedException

java.util.concurrent.ExecutionException

invokeAny

public <T> T invokeAny(java.util.Collection<? extends java.util.concurrent.Callable<T>> tasks,
                       long timeout,
                       java.util.concurrent.TimeUnit unit)
                throws java.lang.InterruptedException,
                       java.util.concurrent.ExecutionException,
                       java.util.concurrent.TimeoutException

Specified by:

invokeAny in interface java.util.concurrent.ExecutorService

Overrides:

invokeAny in class org.apache.hadoop.thirdparty.com.google.common.util.concurrent.ForwardingExecutorService

Throws:

java.lang.InterruptedException

java.util.concurrent.ExecutionException

java.util.concurrent.TimeoutException

submit

public <T> java.util.concurrent.Future<T> submit(java.util.concurrent.Callable<T> task)

Specified by:

submit in interface java.util.concurrent.ExecutorService

Overrides:

submit in class org.apache.hadoop.thirdparty.com.google.common.util.concurrent.ForwardingExecutorService

submit

public <T> java.util.concurrent.Future<T> submit(java.lang.Runnable task,
                                                 T result)

Specified by:

submit in interface java.util.concurrent.ExecutorService

Overrides:

submit in class org.apache.hadoop.thirdparty.com.google.common.util.concurrent.ForwardingExecutorService

submit

public java.util.concurrent.Future<?> submit(java.lang.Runnable task)

Specified by:

submit in interface java.util.concurrent.ExecutorService

Overrides:

submit in class org.apache.hadoop.thirdparty.com.google.common.util.concurrent.ForwardingExecutorService

execute

public void execute(java.lang.Runnable command)

Specified by:

execute in interface java.util.concurrent.Executor

Overrides:

execute in class org.apache.hadoop.thirdparty.com.google.common.util.concurrent.ForwardingExecutorService

getAvailablePermits

public int getAvailablePermits()

Get the number of permits available; guaranteed to be 0 <= availablePermits <= size.

Returns:

the number of permits available at the time of invocation.

getWaitingCount

public int getWaitingCount()

Get the number of threads waiting to acquire a permit.

Returns:

snapshot of the length of the queue of blocked threads.

getPermitCount

public int getPermitCount()

Total number of permits.

Returns:

the number of permits as set in the constructor

toString

public java.lang.String toString()

Overrides:

toString in class org.apache.hadoop.thirdparty.com.google.common.collect.ForwardingObject