Package org.apache.hadoop.yarn.server.resourcemanager.monitor.capacity

Class CapacitySchedulerPreemptionUtils

java.lang.Object

org.apache.hadoop.yarn.server.resourcemanager.monitor.capacity.CapacitySchedulerPreemptionUtils

public class CapacitySchedulerPreemptionUtils
extends java.lang.Object

Constructor Summary

Constructors

Constructor	Description
CapacitySchedulerPreemptionUtils()

Method Summary

Modifier and Type	Method	Description
protected static void	addToPreemptMap(java.util.Map<org.apache.hadoop.yarn.api.records.ApplicationAttemptId,java.util.Set<RMContainer>> preemptMap, java.util.Map<org.apache.hadoop.yarn.api.records.ApplicationAttemptId,java.util.Set<RMContainer>> curCandidates, org.apache.hadoop.yarn.api.records.ApplicationAttemptId appAttemptId, RMContainer containerToPreempt)
static void	deductPreemptableResourcesBasedSelectedCandidates(CapacitySchedulerPreemptionContext context, java.util.Map<org.apache.hadoop.yarn.api.records.ApplicationAttemptId,java.util.Set<RMContainer>> selectedCandidates)
static java.util.Map<java.lang.String,org.apache.hadoop.yarn.api.records.Resource>	getResToObtainByPartitionForLeafQueue(CapacitySchedulerPreemptionContext context, java.lang.String queueName, org.apache.hadoop.yarn.api.records.Resource clusterResource)
static boolean	isContainerAlreadySelected(RMContainer container, java.util.Map<org.apache.hadoop.yarn.api.records.ApplicationAttemptId,java.util.Set<RMContainer>> selectedCandidates)
static boolean	tryPreemptContainerAndDeductResToObtain(org.apache.hadoop.yarn.util.resource.ResourceCalculator rc, CapacitySchedulerPreemptionContext context, java.util.Map<java.lang.String,org.apache.hadoop.yarn.api.records.Resource> resourceToObtainByPartitions, RMContainer rmContainer, org.apache.hadoop.yarn.api.records.Resource clusterResource, java.util.Map<org.apache.hadoop.yarn.api.records.ApplicationAttemptId,java.util.Set<RMContainer>> preemptMap, java.util.Map<org.apache.hadoop.yarn.api.records.ApplicationAttemptId,java.util.Set<RMContainer>> curCandidates, org.apache.hadoop.yarn.api.records.Resource totalPreemptionAllowed, boolean conservativeDRF)	Invoke this method to preempt container based on resToObtain.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

CapacitySchedulerPreemptionUtils

public CapacitySchedulerPreemptionUtils()

Method Detail

getResToObtainByPartitionForLeafQueue

public static java.util.Map<java.lang.String,org.apache.hadoop.yarn.api.records.Resource> getResToObtainByPartitionForLeafQueue(CapacitySchedulerPreemptionContext context,
                                                                                                                                      java.lang.String queueName,
                                                                                                                                      org.apache.hadoop.yarn.api.records.Resource clusterResource)

isContainerAlreadySelected

public static boolean isContainerAlreadySelected(RMContainer container,
                                                 java.util.Map<org.apache.hadoop.yarn.api.records.ApplicationAttemptId,java.util.Set<RMContainer>> selectedCandidates)

deductPreemptableResourcesBasedSelectedCandidates

public static void deductPreemptableResourcesBasedSelectedCandidates(CapacitySchedulerPreemptionContext context,
                                                                     java.util.Map<org.apache.hadoop.yarn.api.records.ApplicationAttemptId,java.util.Set<RMContainer>> selectedCandidates)

tryPreemptContainerAndDeductResToObtain

public static boolean tryPreemptContainerAndDeductResToObtain(org.apache.hadoop.yarn.util.resource.ResourceCalculator rc,
                                                              CapacitySchedulerPreemptionContext context,
                                                              java.util.Map<java.lang.String,org.apache.hadoop.yarn.api.records.Resource> resourceToObtainByPartitions,
                                                              RMContainer rmContainer,
                                                              org.apache.hadoop.yarn.api.records.Resource clusterResource,
                                                              java.util.Map<org.apache.hadoop.yarn.api.records.ApplicationAttemptId,java.util.Set<RMContainer>> preemptMap,
                                                              java.util.Map<org.apache.hadoop.yarn.api.records.ApplicationAttemptId,java.util.Set<RMContainer>> curCandidates,
                                                              org.apache.hadoop.yarn.api.records.Resource totalPreemptionAllowed,
                                                              boolean conservativeDRF)

Invoke this method to preempt container based on resToObtain.

Parameters:

rc - resource calculator

context - preemption context

resourceToObtainByPartitions - map to hold resource to obtain per partition

rmContainer - container

clusterResource - total resource

preemptMap - map to hold preempted containers

totalPreemptionAllowed - total preemption allowed per round

conservativeDRF - should we do conservativeDRF preemption or not. When true: stop preempt container when any major resource type <= 0 for to-preempt. This is default preemption behavior of intra-queue preemption When false: stop preempt container when: all major resource type <= 0 for to-preempt. This is default preemption behavior of inter-queue preemption

curCandidates - RMContainer Set.

Returns:

should we preempt rmContainer. If we should, deduct from resourceToObtainByPartition

addToPreemptMap

protected static void addToPreemptMap(java.util.Map<org.apache.hadoop.yarn.api.records.ApplicationAttemptId,java.util.Set<RMContainer>> preemptMap,
                                      java.util.Map<org.apache.hadoop.yarn.api.records.ApplicationAttemptId,java.util.Set<RMContainer>> curCandidates,
                                      org.apache.hadoop.yarn.api.records.ApplicationAttemptId appAttemptId,
                                      RMContainer containerToPreempt)