Package org.apache.hadoop.yarn.server.resourcemanager.scheduler.distributed

Class CentralizedOpportunisticContainerAllocator

java.lang.Object

org.apache.hadoop.yarn.server.scheduler.OpportunisticContainerAllocator

org.apache.hadoop.yarn.server.resourcemanager.scheduler.distributed.CentralizedOpportunisticContainerAllocator

public class CentralizedOpportunisticContainerAllocator
extends org.apache.hadoop.yarn.server.scheduler.OpportunisticContainerAllocator

The CentralizedOpportunisticContainerAllocator allocates opportunistic containers by considering all the nodes present in the cluster, after modifying the container sizes to respect the limits set by the ResourceManager. It tries to distribute the containers as evenly as possible.

Nested Class Summary

Nested classes/interfaces inherited from class org.apache.hadoop.yarn.server.scheduler.OpportunisticContainerAllocator

org.apache.hadoop.yarn.server.scheduler.OpportunisticContainerAllocator.Allocation, org.apache.hadoop.yarn.server.scheduler.OpportunisticContainerAllocator.AllocationParams, org.apache.hadoop.yarn.server.scheduler.OpportunisticContainerAllocator.ContainerIdGenerator, org.apache.hadoop.yarn.server.scheduler.OpportunisticContainerAllocator.EnrichedResourceRequest, org.apache.hadoop.yarn.server.scheduler.OpportunisticContainerAllocator.PartitionedResourceRequests

Constructor Summary

Constructors

Constructor	Description
CentralizedOpportunisticContainerAllocator(org.apache.hadoop.yarn.server.security.BaseContainerTokenSecretManager tokenSecretManager)	Create a new Centralized Opportunistic Container Allocator.
CentralizedOpportunisticContainerAllocator(org.apache.hadoop.yarn.server.security.BaseContainerTokenSecretManager tokenSecretManager, int maxAllocationsPerAMHeartbeat, NodeQueueLoadMonitor nodeQueueLoadMonitor)	Create a new Centralized Opportunistic Container Allocator.

Method Summary

Modifier and Type	Method	Description
java.util.List<org.apache.hadoop.yarn.api.records.Container>	allocateContainers(org.apache.hadoop.yarn.api.records.ResourceBlacklistRequest blackList, java.util.List<org.apache.hadoop.yarn.api.records.ResourceRequest> oppResourceReqs, org.apache.hadoop.yarn.api.records.ApplicationAttemptId applicationAttemptId, org.apache.hadoop.yarn.server.scheduler.OpportunisticContainerContext opportContext, long rmIdentifier, java.lang.String appSubmitter)

Methods inherited from class org.apache.hadoop.yarn.server.scheduler.OpportunisticContainerAllocator

createContainer, getMaxAllocationsPerAMHeartbeat, getRemoteNodePartition, getRequestPartition, getTotalAllocations, matchAllocation, partitionAskList, setMaxAllocationsPerAMHeartbeat, updateBlacklist

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

CentralizedOpportunisticContainerAllocator

public CentralizedOpportunisticContainerAllocator(org.apache.hadoop.yarn.server.security.BaseContainerTokenSecretManager tokenSecretManager)

Create a new Centralized Opportunistic Container Allocator.

Parameters:

tokenSecretManager - TokenSecretManager

CentralizedOpportunisticContainerAllocator

public CentralizedOpportunisticContainerAllocator(org.apache.hadoop.yarn.server.security.BaseContainerTokenSecretManager tokenSecretManager,
                                                  int maxAllocationsPerAMHeartbeat,
                                                  NodeQueueLoadMonitor nodeQueueLoadMonitor)

Create a new Centralized Opportunistic Container Allocator.

Parameters:

tokenSecretManager - TokenSecretManager

maxAllocationsPerAMHeartbeat - max number of containers to be allocated in one AM heartbeat

nodeQueueLoadMonitor - NodeQueueLoadMonitor.

Method Detail

allocateContainers

public java.util.List<org.apache.hadoop.yarn.api.records.Container> allocateContainers(org.apache.hadoop.yarn.api.records.ResourceBlacklistRequest blackList,
                                                                                       java.util.List<org.apache.hadoop.yarn.api.records.ResourceRequest> oppResourceReqs,
                                                                                       org.apache.hadoop.yarn.api.records.ApplicationAttemptId applicationAttemptId,
                                                                                       org.apache.hadoop.yarn.server.scheduler.OpportunisticContainerContext opportContext,
                                                                                       long rmIdentifier,
                                                                                       java.lang.String appSubmitter)
                                                                                throws org.apache.hadoop.yarn.exceptions.YarnException

Specified by:

allocateContainers in class org.apache.hadoop.yarn.server.scheduler.OpportunisticContainerAllocator

Throws:

org.apache.hadoop.yarn.exceptions.YarnException