Package org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity

Class ManagedParentQueue

java.lang.Object

org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.AbstractCSQueue

org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.AbstractParentQueue

org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.AbstractManagedParentQueue

org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ManagedParentQueue

All Implemented Interfaces:

CSQueue, Queue, SchedulerQueue<CSQueue>

public class ManagedParentQueue
extends AbstractManagedParentQueue

Auto Creation enabled Parent queue. This queue initially does not have any children to start with and all child leaf queues will be auto created. Currently this does not allow other pre-configured leaf or parent queues to co-exist along with auto-created leaf queues. The auto creation is limited to leaf queues currently.

Nested Class Summary

Nested classes/interfaces inherited from class org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.AbstractParentQueue

AbstractParentQueue.QueueCapacityType

Nested classes/interfaces inherited from class org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.AbstractCSQueue

AbstractCSQueue.CapacityConfigType

Field Summary

Fields inherited from class org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.AbstractManagedParentQueue

leafQueueTemplate, queueManagementPolicy

Fields inherited from class org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.AbstractParentQueue

childQueues

Fields inherited from class org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.AbstractCSQueue

activitiesManager, authorizer, capacityConfigType, configuredCapacityVectors, configuredMaxCapacityVectors, queueAllocationSettings, queueContext, queueEntity, queueNodeLabelsSettings, queuePath, readLock, writeLock

Constructor Summary

Constructors

Constructor	Description
ManagedParentQueue(CapacitySchedulerQueueContext queueContext, java.lang.String queueName, CSQueue parent, CSQueue old)

Method Summary

Modifier and Type	Method	Description
void	addChildQueue(CSQueue childQueue)	Add the specified child queue.
java.util.List<FiCaSchedulerApp>	getAllApplications()
java.lang.String	getLeafQueueConfigPrefix(CapacitySchedulerConfiguration conf)
java.util.List<FiCaSchedulerApp>	getPendingApplications()
java.util.List<FiCaSchedulerApp>	getScheduleableApplications()
protected AutoCreatedLeafQueueConfig.Builder	initializeLeafQueueConfigs()
void	reinitialize(CSQueue newlyParsedQueue, org.apache.hadoop.yarn.api.records.Resource clusterResource)	Reinitialize the queue.
void	setLeafQueueConfigs(java.lang.String leafQueueName)
boolean	shouldFailAutoCreationWhenGuaranteedCapacityExceeded()
protected void	validate(CSQueue newlyParsedQueue)
void	validateAndApplyQueueManagementChanges(java.util.List<QueueManagementChange> queueManagementChanges)	Asynchronously called from scheduler to apply queue management changes.
void	validateQueueManagementChanges(java.util.List<QueueManagementChange> queueManagementChanges)

Methods inherited from class org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.AbstractManagedParentQueue

getAutoCreatedQueueManagementPolicy, getLeafQueueTemplate, initializeLeafQueueConfigs, removeChildQueue, removeChildQueue, sumOfChildAbsCapacities, sumOfChildCapacities, validateQueueEntitlementChange

Methods inherited from class org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.AbstractParentQueue

apply, assignContainers, attachContainer, collectSchedulerApplications, completedContainer, createNewQueue, detachContainer, finishApplication, finishApplicationAttempt, getAbstractUsersManager, getAutoCreatedQueueTemplate, getCapacityConfigurationTypeForQueues, getChildQueues, getChildQueuesByTryLock, getNumApplications, getQueueInfo, getQueueOrderingPolicy, getQueueUserAclInfo, getResourceLimitsOfChild, hasChildQueues, isEligibleForAutoDeletion, isEligibleForAutoQueueCreation, recoverContainer, refreshAfterResourceCalculation, setDynamicQueueACLProperties, setupQueueConfigs, stopQueue, submitApplication, submitApplicationAttempt, submitApplicationAttempt, toString, updateClusterResource, updateClusterResourceLegacyMode, validateSubmitApplication

Methods inherited from class org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.AbstractCSQueue

accept, activateQueue, appFinished, assignContainers, checkConfigTypeIsAbsoluteResource, decPendingResource, decReservedResource, decUsedResource, getAbsoluteCapacity, getAbsoluteMaximumCapacity, getAbsoluteUsedCapacity, getAccessibleNodeLabels, getACLs, getCapacity, getCapacityConfigType, getCapacityOrWeightString, getConfiguredCapacityVector, getConfiguredMaxCapacityVector, getConfiguredNodeLabels, getDefaultApplicationLifetime, getDefaultApplicationPriority, getDefaultAppLifetimeWasSpecifiedInConfig, getDefaultNodeLabelExpression, getEffectiveCapacity, getEffectiveCapacityDown, getEffectiveMaxCapacity, getEffectiveMaxCapacityDown, getIntraQueuePreemptionDisabled, getIntraQueuePreemptionDisabledInHierarchy, getKillableContainers, getLabel, getMaximumAbsoluteResource, getMaximumAllocation, getMaximumApplicationLifetime, getMaximumCapacity, getMaxParallelApps, getMetrics, getMinimumAbsoluteResource, getMinimumAllocation, getMultiNodeSortingPolicyName, getNodeLabelsForQueue, getNumContainers, getParent, getPreemptionDisabled, getPriority, getPrivilegedEntity, getQueueCapacities, getQueueContext, getQueueInfo, getQueueName, getQueuePath, getQueuePathObject, getQueueResourceQuotas, getQueueResourceUsage, getQueueShortName, getReadLock, getState, getTotalKillableResource, getUsedCapacity, getUsedResources, getUserWeights, getWriteLock, hasAccess, incPendingResource, incReservedResource, incUsedResource, isDynamicQueue, isInactiveDynamicQueue, isReservationsContinueLooking, overrideCapacityVectorsForSpecialQueues, parseAndSetDynamicTemplates, recoverDrainingState, releaseResource, setConfiguredMaxCapacityVector, setConfiguredMinCapacityVector, setDynamicQueue, setMaxParallelApps, setMultiNodeSortingPolicyName, setParent, setupConfigurableCapacities, updateAbsoluteCapacities, updateCapacityConfigType, updateConfigurableResourceLimits, updateQueueState

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, wait, wait, wait

Constructor Detail

ManagedParentQueue

public ManagedParentQueue(CapacitySchedulerQueueContext queueContext,
                          java.lang.String queueName,
                          CSQueue parent,
                          CSQueue old)
                   throws java.io.IOException

Throws:

java.io.IOException

Method Detail

reinitialize

public void reinitialize(CSQueue newlyParsedQueue,
                         org.apache.hadoop.yarn.api.records.Resource clusterResource)
                  throws java.io.IOException

Description copied from interface: CSQueue

Reinitialize the queue.

Specified by:

reinitialize in interface CSQueue

Overrides:

reinitialize in class AbstractManagedParentQueue

Parameters:

newlyParsedQueue - new queue to re-initalize from

clusterResource - resources in the cluster

Throws:

java.io.IOException - an I/O exception has occurred.

initializeLeafQueueConfigs

protected AutoCreatedLeafQueueConfig.Builder initializeLeafQueueConfigs()
                                                                 throws java.io.IOException

Throws:

java.io.IOException

validate

protected void validate(CSQueue newlyParsedQueue)
                 throws java.io.IOException

Throws:

java.io.IOException

addChildQueue

public void addChildQueue(CSQueue childQueue)
                   throws SchedulerDynamicEditException,
                          java.io.IOException

Description copied from class: AbstractManagedParentQueue

Add the specified child queue.

Overrides:

addChildQueue in class AbstractManagedParentQueue

Parameters:

childQueue - reference to the child queue to be added

Throws:

SchedulerDynamicEditException - when addChildQueue fails.

java.io.IOException - an I/O exception has occurred.

getScheduleableApplications

public java.util.List<FiCaSchedulerApp> getScheduleableApplications()

getPendingApplications

public java.util.List<FiCaSchedulerApp> getPendingApplications()

getAllApplications

public java.util.List<FiCaSchedulerApp> getAllApplications()

getLeafQueueConfigPrefix

public java.lang.String getLeafQueueConfigPrefix(CapacitySchedulerConfiguration conf)

shouldFailAutoCreationWhenGuaranteedCapacityExceeded

public boolean shouldFailAutoCreationWhenGuaranteedCapacityExceeded()

validateAndApplyQueueManagementChanges

public void validateAndApplyQueueManagementChanges(java.util.List<QueueManagementChange> queueManagementChanges)
                                            throws java.io.IOException,
                                                   SchedulerDynamicEditException

Asynchronously called from scheduler to apply queue management changes.

Parameters:

queueManagementChanges - QueueManagementChange List.

Throws:

java.io.IOException - an I/O exception has occurred.

SchedulerDynamicEditException - when validate and apply QueueManagementChanges fails.

validateQueueManagementChanges

public void validateQueueManagementChanges(java.util.List<QueueManagementChange> queueManagementChanges)
                                    throws SchedulerDynamicEditException

Throws:

SchedulerDynamicEditException

setLeafQueueConfigs

public void setLeafQueueConfigs(java.lang.String leafQueueName)