Package org.apache.hadoop.yarn.server.resourcemanager.scheduler

Class SchedulerApplicationAttempt

java.lang.Object

org.apache.hadoop.yarn.server.resourcemanager.scheduler.SchedulerApplicationAttempt

All Implemented Interfaces:

SchedulableEntity

Direct Known Subclasses:

FiCaSchedulerApp, FSAppAttempt

@Private
@Unstable
public class SchedulerApplicationAttempt
extends java.lang.Object
implements SchedulableEntity

Represents an application attempt from the viewpoint of the scheduler. Each running app attempt in the RM corresponds to one instance of this class.

Nested Class Summary

Nested Classes

Modifier and Type	Class	Description
static class	SchedulerApplicationAttempt.AMState	Different state for Application Master, user can see this state from web UI

Field Summary

Fields

Modifier and Type	Field	Description
protected java.lang.String	appAMNodePartitionName
protected AppSchedulingInfo	appSchedulingInfo
protected org.apache.hadoop.yarn.api.records.ApplicationAttemptId	attemptId
protected ResourceUsage	attemptOpportunisticResourceUsage	Resource usage of opportunistic containers.
protected ResourceUsage	attemptResourceUsage
protected ResourceUsage	attemptResourceUsageAllocatedRemotely	Scheduled by a remote scheduler.
protected boolean	isStopped
protected long	lastMemoryAggregateAllocationUpdateTime
protected java.util.Map<org.apache.hadoop.yarn.server.scheduler.SchedulerRequestKey,java.lang.Long>	lastScheduledContainer
protected java.util.Map<org.apache.hadoop.yarn.api.records.ContainerId,RMContainer>	liveContainers
protected java.util.List<RMContainer>	newlyAllocatedContainers
protected java.util.Map<org.apache.hadoop.yarn.api.records.ContainerId,RMContainer>	newlyDecreasedContainers
protected java.util.Map<org.apache.hadoop.yarn.api.records.ContainerId,RMContainer>	newlyDemotedContainers
protected java.util.Map<org.apache.hadoop.yarn.api.records.ContainerId,RMContainer>	newlyIncreasedContainers
protected java.util.Map<org.apache.hadoop.yarn.api.records.ContainerId,RMContainer>	newlyPromotedContainers
protected Queue	queue
protected java.util.concurrent.locks.ReentrantReadWriteLock.ReadLock	readLock
protected java.util.Map<org.apache.hadoop.yarn.server.scheduler.SchedulerRequestKey,java.util.Map<org.apache.hadoop.yarn.api.records.NodeId,RMContainer>>	reservedContainers
protected RMContext	rmContext
protected java.util.List<RMContainer>	tempContainerToKill
protected java.util.List<org.apache.hadoop.yarn.api.records.UpdateContainerError>	updateContainerErrors
protected java.util.Set<org.apache.hadoop.yarn.api.records.NMToken>	updatedNMTokens
protected java.util.concurrent.locks.ReentrantReadWriteLock.WriteLock	writeLock

Constructor Summary

Constructors

Constructor	Description
SchedulerApplicationAttempt(org.apache.hadoop.yarn.api.records.ApplicationAttemptId applicationAttemptId, java.lang.String user, Queue queue, AbstractUsersManager abstractUsersManager, RMContext rmContext)

Method Summary

Modifier and Type	Method	Description
int	addMissedNonPartitionedRequestSchedulingOpportunity(org.apache.hadoop.yarn.server.scheduler.SchedulerRequestKey schedulerKey)
protected void	addReReservation(org.apache.hadoop.yarn.server.scheduler.SchedulerRequestKey schedulerKey)
void	addRMContainer(org.apache.hadoop.yarn.api.records.ContainerId id, RMContainer rmContainer)
void	addSchedulingOpportunity(org.apache.hadoop.yarn.server.scheduler.SchedulerRequestKey schedulerKey)
protected void	addToNewlyAllocatedContainers(SchedulerNode node, RMContainer rmContainer)
void	addToNewlyDecreasedContainers(org.apache.hadoop.yarn.api.records.ContainerId containerId, RMContainer rmContainer)
void	addToNewlyDemotedContainers(org.apache.hadoop.yarn.api.records.ContainerId containerId, RMContainer rmContainer)
protected void	addToUpdateContainerErrors(org.apache.hadoop.yarn.api.records.UpdateContainerError error)
int	compareInputOrderTo(SchedulableEntity other)	Compare the passed SchedulableEntity to this one for input order.
void	containerLaunchedOnNode(org.apache.hadoop.yarn.api.records.ContainerId containerId, org.apache.hadoop.yarn.api.records.NodeId nodeId)
void	decUnconfirmedRes(org.apache.hadoop.yarn.api.records.Resource res)
boolean	equals(java.lang.Object o)
protected void	getActivedAppDiagnosticMessage(java.lang.StringBuilder diagnosticMessage)
org.apache.hadoop.yarn.api.records.Resource	getAMResource()
org.apache.hadoop.yarn.api.records.Resource	getAMResource(java.lang.String label)
java.lang.String	getAppAMNodePartitionName()
ResourceUsage	getAppAttemptResourceUsage()
org.apache.hadoop.yarn.api.records.ApplicationAttemptId	getApplicationAttemptId()	Get ApplicationAttemptId of the application master.
org.apache.hadoop.yarn.api.records.ApplicationId	getApplicationId()
java.util.Map<java.lang.String,java.lang.String>	getApplicationSchedulingEnvs()
<N extends SchedulerNode> AppPlacementAllocator<N>	getAppPlacementAllocator(org.apache.hadoop.yarn.server.scheduler.SchedulerRequestKey schedulerRequestKey)
AppSchedulingInfo	getAppSchedulingInfo()
java.util.Set<java.lang.String>	getBlacklistedNodes()
org.apache.hadoop.yarn.api.records.Resource	getCurrentConsumption()
org.apache.hadoop.yarn.api.records.Resource	getCurrentReservation()	Get total current reservations.
org.apache.hadoop.yarn.api.records.Resource	getHeadroom()	Get available headroom in terms of resources for the application's user.
java.lang.String	getId()	Id - each entity must have a unique id.
java.util.Map<org.apache.hadoop.yarn.server.scheduler.SchedulerRequestKey,java.lang.Long>	getLastScheduledContainer()
java.util.Collection<RMContainer>	getLiveContainers()	Get the live containers of the application.
java.util.Map<org.apache.hadoop.yarn.api.records.ContainerId,RMContainer>	getLiveContainersMap()
long	getNewContainerId()
int	getNumReservedContainers(org.apache.hadoop.yarn.server.scheduler.SchedulerRequestKey schedulerKey)
org.apache.hadoop.yarn.server.scheduler.OpportunisticContainerContext	getOpportunisticContainerContext()
int	getOutstandingAsksCount(org.apache.hadoop.yarn.server.scheduler.SchedulerRequestKey schedulerKey)
int	getOutstandingAsksCount(org.apache.hadoop.yarn.server.scheduler.SchedulerRequestKey schedulerKey, java.lang.String resourceName)
java.lang.String	getPartition()	Get partition corresponding to this entity.
protected void	getPendingAppDiagnosticMessage(java.lang.StringBuilder diagnosticMessage)
PendingAsk	getPendingAsk(org.apache.hadoop.yarn.server.scheduler.SchedulerRequestKey schedulerKey, java.lang.String resourceName)
java.util.Set<org.apache.hadoop.yarn.api.records.ContainerId>	getPendingRelease()
org.apache.hadoop.yarn.api.records.Priority	getPriority()	Get the priority of the application.
Queue	getQueue()
java.lang.String	getQueueName()
int	getReReservations(org.apache.hadoop.yarn.server.scheduler.SchedulerRequestKey schedulerKey)
java.util.List<RMContainer>	getReservedContainers()	Get the list of reserved containers
org.apache.hadoop.yarn.api.records.ApplicationResourceUsageReport	getResourceUsageReport()
RMContainer	getRMContainer(org.apache.hadoop.yarn.api.records.ContainerId id)
java.util.Collection<org.apache.hadoop.yarn.server.scheduler.SchedulerRequestKey>	getSchedulerKeys()
int	getSchedulingOpportunities(org.apache.hadoop.yarn.server.scheduler.SchedulerRequestKey schedulerKey)	Return the number of times the application has been given an opportunity to schedule a task at the given priority since the last time it successfully did so.
ResourceUsage	getSchedulingResourceUsage()	View of Resources wanted and consumed by the entity.
long	getStartTime()	Start time of the job.
boolean	getUnmanagedAM()
ContainerUpdateContext	getUpdateContext()
java.lang.String	getUser()
java.util.concurrent.locks.ReentrantReadWriteLock.WriteLock	getWriteLock()
int	hashCode()
boolean	hasPendingResourceRequest(java.lang.String nodePartition, SchedulingMode schedulingMode)
void	incNumAllocatedContainers(NodeType containerType, NodeType requestType)
void	incUnconfirmedRes(org.apache.hadoop.yarn.api.records.Resource res)
boolean	isAmRunning()
boolean	isPending()	Is this application pending?
boolean	isPlaceBlacklisted(java.lang.String resourceName)
boolean	isPlaceBlackListedBasedOnLabels(java.lang.String resourceName)
boolean	isRecovering()	Whether application was running before RM restart.
boolean	isStopped()
boolean	isWaitingForAMContainer()
void	move(Queue newQueue)
java.util.List<org.apache.hadoop.yarn.api.records.Container>	pullNewlyAllocatedContainers()
java.util.List<org.apache.hadoop.yarn.api.records.Container>	pullNewlyDecreasedContainers()
java.util.List<org.apache.hadoop.yarn.api.records.Container>	pullNewlyDemotedContainers()
java.util.List<org.apache.hadoop.yarn.api.records.Container>	pullNewlyIncreasedContainers()
java.util.List<org.apache.hadoop.yarn.api.records.Container>	pullNewlyPromotedContainers()
java.util.List<org.apache.hadoop.yarn.api.records.Container>	pullPreviousAttemptContainers()	Called when AM heartbeats.
java.util.List<org.apache.hadoop.yarn.api.records.UpdateContainerError>	pullUpdateContainerErrors()
java.util.List<org.apache.hadoop.yarn.api.records.NMToken>	pullUpdatedNMTokens()
void	recordContainerAllocationTime(long value)
void	recordContainerRequestTime(long value)
boolean	recoverContainer(SchedulerNode node, RMContainer rmContainer)
void	recoverResourceRequestsForContainer(ContainerRequest containerRequest)
boolean	removeRMContainer(org.apache.hadoop.yarn.api.records.ContainerId containerId)	Removes an RM container from the map of live containers related to this application attempt.
RMContainer	reserve(SchedulerNode node, org.apache.hadoop.yarn.server.scheduler.SchedulerRequestKey schedulerKey, RMContainer rmContainer, org.apache.hadoop.yarn.api.records.Container container)
boolean	reserveIncreasedContainer(SchedulerNode node, org.apache.hadoop.yarn.server.scheduler.SchedulerRequestKey schedulerKey, RMContainer rmContainer, org.apache.hadoop.yarn.api.records.Resource reservedResource)
void	resetMissedNonPartitionedRequestSchedulingOpportunity(org.apache.hadoop.yarn.server.scheduler.SchedulerRequestKey schedulerKey)
protected void	resetReReservations(org.apache.hadoop.yarn.server.scheduler.SchedulerRequestKey schedulerKey)
void	resetSchedulingOpportunities(org.apache.hadoop.yarn.server.scheduler.SchedulerRequestKey schedulerKey)	Should be called when an application has successfully scheduled a container, or when the scheduling locality threshold is relaxed.
void	resetSchedulingOpportunities(org.apache.hadoop.yarn.server.scheduler.SchedulerRequestKey schedulerKey, long currentTimeMs)
void	setAMResource(java.lang.String label, org.apache.hadoop.yarn.api.records.Resource amResource)
void	setAMResource(org.apache.hadoop.yarn.api.records.Resource amResource)
void	setAmRunning(boolean bool)
void	setAppAMNodePartitionName(java.lang.String partitionName)
void	setApplicationHeadroomForMetrics(org.apache.hadoop.yarn.api.records.Resource headroom)
protected void	setAttemptRecovering(boolean isRecovering)
void	setHeadroom(org.apache.hadoop.yarn.api.records.Resource globalLimit)
void	setOpportunisticContainerContext(org.apache.hadoop.yarn.server.scheduler.OpportunisticContainerContext oppContext)
void	setPriority(org.apache.hadoop.yarn.api.records.Priority appPriority)
void	showRequests()
void	stop(RMAppAttemptState rmAppAttemptFinalState)
void	subtractSchedulingOpportunity(org.apache.hadoop.yarn.server.scheduler.SchedulerRequestKey schedulerKey)
void	transferStateFromPreviousAttempt(SchedulerApplicationAttempt appAttempt)
void	updateAMContainerDiagnostics(SchedulerApplicationAttempt.AMState state, java.lang.String diagnosticMessage)
void	updateBlacklist(java.util.List<java.lang.String> blacklistAdditions, java.util.List<java.lang.String> blacklistRemovals)
void	updateNMTokens(java.util.Collection<org.apache.hadoop.yarn.api.records.Container> containers)
boolean	updateResourceRequests(java.util.List<org.apache.hadoop.yarn.api.records.ResourceRequest> requests)
boolean	updateSchedulingRequests(java.util.List<org.apache.hadoop.yarn.api.records.SchedulingRequest> requests)

Methods inherited from class java.lang.Object

clone, finalize, getClass, notify, notifyAll, toString, wait, wait, wait

Field Detail

lastMemoryAggregateAllocationUpdateTime

protected long lastMemoryAggregateAllocationUpdateTime

appSchedulingInfo

protected final AppSchedulingInfo appSchedulingInfo

attemptId

protected org.apache.hadoop.yarn.api.records.ApplicationAttemptId attemptId

liveContainers

protected java.util.Map<org.apache.hadoop.yarn.api.records.ContainerId,RMContainer> liveContainers

reservedContainers

protected final java.util.Map<org.apache.hadoop.yarn.server.scheduler.SchedulerRequestKey,java.util.Map<org.apache.hadoop.yarn.api.records.NodeId,RMContainer>> reservedContainers

attemptResourceUsage

protected ResourceUsage attemptResourceUsage

attemptOpportunisticResourceUsage

protected ResourceUsage attemptOpportunisticResourceUsage

Resource usage of opportunistic containers.

attemptResourceUsageAllocatedRemotely

protected ResourceUsage attemptResourceUsageAllocatedRemotely

Scheduled by a remote scheduler.

newlyAllocatedContainers

protected java.util.List<RMContainer> newlyAllocatedContainers

tempContainerToKill

protected java.util.List<RMContainer> tempContainerToKill

newlyPromotedContainers

protected java.util.Map<org.apache.hadoop.yarn.api.records.ContainerId,RMContainer> newlyPromotedContainers

newlyDemotedContainers

protected java.util.Map<org.apache.hadoop.yarn.api.records.ContainerId,RMContainer> newlyDemotedContainers

newlyDecreasedContainers

protected java.util.Map<org.apache.hadoop.yarn.api.records.ContainerId,RMContainer> newlyDecreasedContainers

newlyIncreasedContainers

protected java.util.Map<org.apache.hadoop.yarn.api.records.ContainerId,RMContainer> newlyIncreasedContainers

updatedNMTokens

protected java.util.Set<org.apache.hadoop.yarn.api.records.NMToken> updatedNMTokens

updateContainerErrors

protected java.util.List<org.apache.hadoop.yarn.api.records.UpdateContainerError> updateContainerErrors

lastScheduledContainer

protected java.util.Map<org.apache.hadoop.yarn.server.scheduler.SchedulerRequestKey,java.lang.Long> lastScheduledContainer

queue

protected volatile Queue queue

isStopped

protected volatile boolean isStopped

appAMNodePartitionName

protected java.lang.String appAMNodePartitionName

rmContext

protected final RMContext rmContext

readLock

protected java.util.concurrent.locks.ReentrantReadWriteLock.ReadLock readLock

writeLock

protected java.util.concurrent.locks.ReentrantReadWriteLock.WriteLock writeLock

Constructor Detail

SchedulerApplicationAttempt

public SchedulerApplicationAttempt(org.apache.hadoop.yarn.api.records.ApplicationAttemptId applicationAttemptId,
                                   java.lang.String user,
                                   Queue queue,
                                   AbstractUsersManager abstractUsersManager,
                                   RMContext rmContext)

Method Detail

setOpportunisticContainerContext

public void setOpportunisticContainerContext(org.apache.hadoop.yarn.server.scheduler.OpportunisticContainerContext oppContext)

getOpportunisticContainerContext

public org.apache.hadoop.yarn.server.scheduler.OpportunisticContainerContext getOpportunisticContainerContext()

getLiveContainers

public java.util.Collection<RMContainer> getLiveContainers()

Get the live containers of the application.

Returns:

live containers of the application

getAppSchedulingInfo

public AppSchedulingInfo getAppSchedulingInfo()

getUpdateContext

public ContainerUpdateContext getUpdateContext()

isPending

public boolean isPending()

Is this application pending?

Returns:

true if it is else false.

getApplicationAttemptId

public org.apache.hadoop.yarn.api.records.ApplicationAttemptId getApplicationAttemptId()

Get ApplicationAttemptId of the application master.

Returns:

ApplicationAttemptId of the application master

getApplicationId

public org.apache.hadoop.yarn.api.records.ApplicationId getApplicationId()

getUser

public java.lang.String getUser()

getPendingRelease

public java.util.Set<org.apache.hadoop.yarn.api.records.ContainerId> getPendingRelease()

getNewContainerId

public long getNewContainerId()

getSchedulerKeys

public java.util.Collection<org.apache.hadoop.yarn.server.scheduler.SchedulerRequestKey> getSchedulerKeys()

getPendingAsk

public PendingAsk getPendingAsk(org.apache.hadoop.yarn.server.scheduler.SchedulerRequestKey schedulerKey,
                                java.lang.String resourceName)

getOutstandingAsksCount

public int getOutstandingAsksCount(org.apache.hadoop.yarn.server.scheduler.SchedulerRequestKey schedulerKey)

getOutstandingAsksCount

public int getOutstandingAsksCount(org.apache.hadoop.yarn.server.scheduler.SchedulerRequestKey schedulerKey,
                                   java.lang.String resourceName)

getQueueName

public java.lang.String getQueueName()

getAMResource

public org.apache.hadoop.yarn.api.records.Resource getAMResource()

getAMResource

public org.apache.hadoop.yarn.api.records.Resource getAMResource(java.lang.String label)

setAMResource

public void setAMResource(org.apache.hadoop.yarn.api.records.Resource amResource)

setAMResource

public void setAMResource(java.lang.String label,
                          org.apache.hadoop.yarn.api.records.Resource amResource)

isAmRunning

public boolean isAmRunning()

setAmRunning

public void setAmRunning(boolean bool)

getUnmanagedAM

public boolean getUnmanagedAM()

getRMContainer

public RMContainer getRMContainer(org.apache.hadoop.yarn.api.records.ContainerId id)

addRMContainer

public void addRMContainer(org.apache.hadoop.yarn.api.records.ContainerId id,
                           RMContainer rmContainer)

removeRMContainer

public boolean removeRMContainer(org.apache.hadoop.yarn.api.records.ContainerId containerId)

Removes an RM container from the map of live containers related to this application attempt.

Parameters:

containerId - The container ID of the RMContainer to remove

Returns:

true if the container is in the map

resetReReservations

protected void resetReReservations(org.apache.hadoop.yarn.server.scheduler.SchedulerRequestKey schedulerKey)

addReReservation

protected void addReReservation(org.apache.hadoop.yarn.server.scheduler.SchedulerRequestKey schedulerKey)

getReReservations

public int getReReservations(org.apache.hadoop.yarn.server.scheduler.SchedulerRequestKey schedulerKey)

getCurrentReservation

@Stable
@Private
public org.apache.hadoop.yarn.api.records.Resource getCurrentReservation()

Get total current reservations. Used only by unit tests

Returns:

total current reservations

getQueue

public Queue getQueue()

updateResourceRequests

public boolean updateResourceRequests(java.util.List<org.apache.hadoop.yarn.api.records.ResourceRequest> requests)

updateSchedulingRequests

public boolean updateSchedulingRequests(java.util.List<org.apache.hadoop.yarn.api.records.SchedulingRequest> requests)

recoverResourceRequestsForContainer

public void recoverResourceRequestsForContainer(ContainerRequest containerRequest)

stop

public void stop(RMAppAttemptState rmAppAttemptFinalState)

isStopped

public boolean isStopped()

getReservedContainers

public java.util.List<RMContainer> getReservedContainers()

Get the list of reserved containers

Returns:

All of the reserved containers.

reserveIncreasedContainer

public boolean reserveIncreasedContainer(SchedulerNode node,
                                         org.apache.hadoop.yarn.server.scheduler.SchedulerRequestKey schedulerKey,
                                         RMContainer rmContainer,
                                         org.apache.hadoop.yarn.api.records.Resource reservedResource)

reserve

public RMContainer reserve(SchedulerNode node,
                           org.apache.hadoop.yarn.server.scheduler.SchedulerRequestKey schedulerKey,
                           RMContainer rmContainer,
                           org.apache.hadoop.yarn.api.records.Container container)

setHeadroom

public void setHeadroom(org.apache.hadoop.yarn.api.records.Resource globalLimit)

getHeadroom

public org.apache.hadoop.yarn.api.records.Resource getHeadroom()

Get available headroom in terms of resources for the application's user.

Returns:

available resource headroom

getNumReservedContainers

public int getNumReservedContainers(org.apache.hadoop.yarn.server.scheduler.SchedulerRequestKey schedulerKey)

containerLaunchedOnNode

public void containerLaunchedOnNode(org.apache.hadoop.yarn.api.records.ContainerId containerId,
                                    org.apache.hadoop.yarn.api.records.NodeId nodeId)

showRequests

public void showRequests()

getCurrentConsumption

public org.apache.hadoop.yarn.api.records.Resource getCurrentConsumption()

updateNMTokens

public void updateNMTokens(java.util.Collection<org.apache.hadoop.yarn.api.records.Container> containers)

pullPreviousAttemptContainers

public java.util.List<org.apache.hadoop.yarn.api.records.Container> pullPreviousAttemptContainers()

Called when AM heartbeats. These containers were recovered by the RM after the AM had registered. They are reported to the AM in the AllocateResponse#containersFromPreviousAttempts.

Returns:

Container List.

pullNewlyAllocatedContainers

public java.util.List<org.apache.hadoop.yarn.api.records.Container> pullNewlyAllocatedContainers()

addToNewlyDemotedContainers

public void addToNewlyDemotedContainers(org.apache.hadoop.yarn.api.records.ContainerId containerId,
                                        RMContainer rmContainer)

addToNewlyDecreasedContainers

public void addToNewlyDecreasedContainers(org.apache.hadoop.yarn.api.records.ContainerId containerId,
                                          RMContainer rmContainer)

addToUpdateContainerErrors

protected void addToUpdateContainerErrors(org.apache.hadoop.yarn.api.records.UpdateContainerError error)

addToNewlyAllocatedContainers

protected void addToNewlyAllocatedContainers(SchedulerNode node,
                                             RMContainer rmContainer)

pullNewlyPromotedContainers

public java.util.List<org.apache.hadoop.yarn.api.records.Container> pullNewlyPromotedContainers()

pullNewlyDemotedContainers

public java.util.List<org.apache.hadoop.yarn.api.records.Container> pullNewlyDemotedContainers()

pullNewlyIncreasedContainers

public java.util.List<org.apache.hadoop.yarn.api.records.Container> pullNewlyIncreasedContainers()

pullNewlyDecreasedContainers

public java.util.List<org.apache.hadoop.yarn.api.records.Container> pullNewlyDecreasedContainers()

pullUpdateContainerErrors

public java.util.List<org.apache.hadoop.yarn.api.records.UpdateContainerError> pullUpdateContainerErrors()

pullUpdatedNMTokens

public java.util.List<org.apache.hadoop.yarn.api.records.NMToken> pullUpdatedNMTokens()

isWaitingForAMContainer

public boolean isWaitingForAMContainer()

updateBlacklist

public void updateBlacklist(java.util.List<java.lang.String> blacklistAdditions,
                            java.util.List<java.lang.String> blacklistRemovals)

isPlaceBlacklisted

public boolean isPlaceBlacklisted(java.lang.String resourceName)

isPlaceBlackListedBasedOnLabels

public boolean isPlaceBlackListedBasedOnLabels(java.lang.String resourceName)

addMissedNonPartitionedRequestSchedulingOpportunity

public int addMissedNonPartitionedRequestSchedulingOpportunity(org.apache.hadoop.yarn.server.scheduler.SchedulerRequestKey schedulerKey)

resetMissedNonPartitionedRequestSchedulingOpportunity

public void resetMissedNonPartitionedRequestSchedulingOpportunity(org.apache.hadoop.yarn.server.scheduler.SchedulerRequestKey schedulerKey)

addSchedulingOpportunity

public void addSchedulingOpportunity(org.apache.hadoop.yarn.server.scheduler.SchedulerRequestKey schedulerKey)

subtractSchedulingOpportunity

public void subtractSchedulingOpportunity(org.apache.hadoop.yarn.server.scheduler.SchedulerRequestKey schedulerKey)

getSchedulingOpportunities

public int getSchedulingOpportunities(org.apache.hadoop.yarn.server.scheduler.SchedulerRequestKey schedulerKey)

Return the number of times the application has been given an opportunity to schedule a task at the given priority since the last time it successfully did so.

Parameters:

schedulerKey - Scheduler Key

Returns:

number of scheduling opportunities

resetSchedulingOpportunities

public void resetSchedulingOpportunities(org.apache.hadoop.yarn.server.scheduler.SchedulerRequestKey schedulerKey)

Should be called when an application has successfully scheduled a container, or when the scheduling locality threshold is relaxed. Reset various internal counters which affect delay scheduling

Parameters:

schedulerKey - The priority of the container scheduled.

resetSchedulingOpportunities

public void resetSchedulingOpportunities(org.apache.hadoop.yarn.server.scheduler.SchedulerRequestKey schedulerKey,
                                         long currentTimeMs)

getResourceUsageReport

public org.apache.hadoop.yarn.api.records.ApplicationResourceUsageReport getResourceUsageReport()

getLiveContainersMap

@VisibleForTesting
public java.util.Map<org.apache.hadoop.yarn.api.records.ContainerId,RMContainer> getLiveContainersMap()

getLastScheduledContainer

public java.util.Map<org.apache.hadoop.yarn.server.scheduler.SchedulerRequestKey,java.lang.Long> getLastScheduledContainer()

transferStateFromPreviousAttempt

public void transferStateFromPreviousAttempt(SchedulerApplicationAttempt appAttempt)

move

public void move(Queue newQueue)

recoverContainer

public boolean recoverContainer(SchedulerNode node,
                                RMContainer rmContainer)

incNumAllocatedContainers

public void incNumAllocatedContainers(NodeType containerType,
                                      NodeType requestType)

setApplicationHeadroomForMetrics

public void setApplicationHeadroomForMetrics(org.apache.hadoop.yarn.api.records.Resource headroom)

recordContainerRequestTime

public void recordContainerRequestTime(long value)

recordContainerAllocationTime

public void recordContainerAllocationTime(long value)

getBlacklistedNodes

public java.util.Set<java.lang.String> getBlacklistedNodes()

hasPendingResourceRequest

@Private
public boolean hasPendingResourceRequest(java.lang.String nodePartition,
                                         SchedulingMode schedulingMode)

getAppAttemptResourceUsage

@VisibleForTesting
public ResourceUsage getAppAttemptResourceUsage()

getPriority

public org.apache.hadoop.yarn.api.records.Priority getPriority()

Description copied from interface: SchedulableEntity

Get the priority of the application.

Specified by:

getPriority in interface SchedulableEntity

Returns:

priority of the application.

setPriority

public void setPriority(org.apache.hadoop.yarn.api.records.Priority appPriority)

getId

public java.lang.String getId()

Description copied from interface: SchedulableEntity

Id - each entity must have a unique id.

Specified by:

getId in interface SchedulableEntity

Returns:

id.

compareInputOrderTo

public int compareInputOrderTo(SchedulableEntity other)

Description copied from interface: SchedulableEntity

Compare the passed SchedulableEntity to this one for input order. Input order is implementation defined and should reflect the correct ordering for first-in first-out processing.

Specified by:

compareInputOrderTo in interface SchedulableEntity

Parameters:

other - SchedulableEntity.

Returns:

correct ordering.

getSchedulingResourceUsage

public ResourceUsage getSchedulingResourceUsage()

Description copied from interface: SchedulableEntity

View of Resources wanted and consumed by the entity.

Specified by:

getSchedulingResourceUsage in interface SchedulableEntity

Returns:

ResourceUsage.

setAppAMNodePartitionName

public void setAppAMNodePartitionName(java.lang.String partitionName)

getAppAMNodePartitionName

public java.lang.String getAppAMNodePartitionName()

updateAMContainerDiagnostics

public void updateAMContainerDiagnostics(SchedulerApplicationAttempt.AMState state,
                                         java.lang.String diagnosticMessage)

getPendingAppDiagnosticMessage

protected void getPendingAppDiagnosticMessage(java.lang.StringBuilder diagnosticMessage)

getActivedAppDiagnosticMessage

protected void getActivedAppDiagnosticMessage(java.lang.StringBuilder diagnosticMessage)

getWriteLock

public java.util.concurrent.locks.ReentrantReadWriteLock.WriteLock getWriteLock()

isRecovering

public boolean isRecovering()

Description copied from interface: SchedulableEntity

Whether application was running before RM restart.

Specified by:

isRecovering in interface SchedulableEntity

Returns:

true, application was running before RM restart; otherwise false.

setAttemptRecovering

protected void setAttemptRecovering(boolean isRecovering)

getAppPlacementAllocator

public <N extends SchedulerNode> AppPlacementAllocator<N> getAppPlacementAllocator(org.apache.hadoop.yarn.server.scheduler.SchedulerRequestKey schedulerRequestKey)

incUnconfirmedRes

public void incUnconfirmedRes(org.apache.hadoop.yarn.api.records.Resource res)

decUnconfirmedRes

public void decUnconfirmedRes(org.apache.hadoop.yarn.api.records.Resource res)

hashCode

public int hashCode()

Overrides:

hashCode in class java.lang.Object

equals

public boolean equals(java.lang.Object o)

Overrides:

equals in class java.lang.Object

getApplicationSchedulingEnvs

public java.util.Map<java.lang.String,java.lang.String> getApplicationSchedulingEnvs()

getPartition

public java.lang.String getPartition()

Description copied from interface: SchedulableEntity

Get partition corresponding to this entity.

Specified by:

getPartition in interface SchedulableEntity

Returns:

partition node label.

getStartTime

public long getStartTime()

Description copied from interface: SchedulableEntity

Start time of the job.

Specified by:

getStartTime in interface SchedulableEntity

Returns:

start time