Package org.apache.hadoop.yarn.server.resourcemanager.scheduler

Class ClusterNodeTracker<N extends SchedulerNode>

java.lang.Object

org.apache.hadoop.yarn.server.resourcemanager.scheduler.ClusterNodeTracker<N>

@Private
public class ClusterNodeTracker<N extends SchedulerNode>
extends java.lang.Object

Helper library that: - tracks the state of all cluster SchedulerNodes - provides convenience methods to filter and sort nodes

Constructor Summary

Constructors

Constructor	Description
ClusterNodeTracker()

Method Summary

Modifier and Type	Method	Description
void	addNode(N node)
boolean	exists(org.apache.hadoop.yarn.api.records.NodeId nodeId)
java.util.List<org.apache.hadoop.yarn.api.records.NodeId>	getAllNodeIds()
java.util.List<N>	getAllNodes()
org.apache.hadoop.yarn.api.records.Resource	getClusterCapacity()
org.apache.hadoop.yarn.api.records.Resource	getClusterCapacity(java.util.Set<org.apache.hadoop.yarn.api.records.NodeId> nodesByLabel)
org.apache.hadoop.yarn.api.records.Resource	getMaxAllowedAllocation()
N	getNode(org.apache.hadoop.yarn.api.records.NodeId nodeId)
java.util.List<org.apache.hadoop.yarn.api.records.NodeId>	getNodeIds(NodeFilter nodeFilter)	Convenience method to filter nodes based on a condition.
java.util.List<org.apache.hadoop.yarn.api.records.NodeId>	getNodeIdsByResourceName(java.lang.String resourceName)	Convenience method to return list of NodeId corresponding to resourceName passed in the ResourceRequest.
SchedulerNodeReport	getNodeReport(org.apache.hadoop.yarn.api.records.NodeId nodeId)
java.util.List<N>	getNodes(NodeFilter nodeFilter)	Convenience method to filter nodes based on a condition.
java.util.List<N>	getNodesByResourceName(java.lang.String resourceName)	Convenience method to return list of nodes corresponding to resourceName passed in the ResourceRequest.
java.util.List<N>	getNodesPerPartition(java.lang.String partition)
java.util.List<java.lang.String>	getPartitions()
int	nodeCount()
int	nodeCount(java.lang.String rackName)
N	removeNode(org.apache.hadoop.yarn.api.records.NodeId nodeId)
void	setConfiguredMaxAllocation(org.apache.hadoop.yarn.api.records.Resource resource)
void	setConfiguredMaxAllocationWaitTime(long configuredMaxAllocationWaitTime)
void	setForceConfiguredMaxAllocation(boolean flag)
java.util.TreeSet<N>	sortedNodeSet(java.util.Comparator<N> comparator)	Convenience method to sort nodes.
void	updateNodesPerPartition(java.lang.String partition, java.util.Set<org.apache.hadoop.yarn.api.records.NodeId> nodeIds)	update cached nodes per partition on a node label change event.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

ClusterNodeTracker

public ClusterNodeTracker()

Method Detail

addNode

public void addNode(N node)

exists

public boolean exists(org.apache.hadoop.yarn.api.records.NodeId nodeId)

getNode

public N getNode(org.apache.hadoop.yarn.api.records.NodeId nodeId)

getNodeReport

public SchedulerNodeReport getNodeReport(org.apache.hadoop.yarn.api.records.NodeId nodeId)

nodeCount

public int nodeCount()

nodeCount

public int nodeCount(java.lang.String rackName)

getClusterCapacity

public org.apache.hadoop.yarn.api.records.Resource getClusterCapacity()

getClusterCapacity

public org.apache.hadoop.yarn.api.records.Resource getClusterCapacity(java.util.Set<org.apache.hadoop.yarn.api.records.NodeId> nodesByLabel)

removeNode

public N removeNode(org.apache.hadoop.yarn.api.records.NodeId nodeId)

setConfiguredMaxAllocation

public void setConfiguredMaxAllocation(org.apache.hadoop.yarn.api.records.Resource resource)

setConfiguredMaxAllocationWaitTime

public void setConfiguredMaxAllocationWaitTime(long configuredMaxAllocationWaitTime)

getMaxAllowedAllocation

public org.apache.hadoop.yarn.api.records.Resource getMaxAllowedAllocation()

setForceConfiguredMaxAllocation

@VisibleForTesting
public void setForceConfiguredMaxAllocation(boolean flag)

getAllNodes

public java.util.List<N> getAllNodes()

getNodes

public java.util.List<N> getNodes(NodeFilter nodeFilter)

Convenience method to filter nodes based on a condition.

Parameters:

nodeFilter - A NodeFilter for filtering the nodes

Returns:

A list of filtered nodes

getAllNodeIds

public java.util.List<org.apache.hadoop.yarn.api.records.NodeId> getAllNodeIds()

getNodeIds

public java.util.List<org.apache.hadoop.yarn.api.records.NodeId> getNodeIds(NodeFilter nodeFilter)

Convenience method to filter nodes based on a condition.

Parameters:

nodeFilter - A NodeFilter for filtering the nodes

Returns:

A list of filtered nodes

sortedNodeSet

public java.util.TreeSet<N> sortedNodeSet(java.util.Comparator<N> comparator)

Convenience method to sort nodes. Nodes can change while being sorted. Using a standard sort will fail without locking each node, the TreeSet handles this without locks.

Parameters:

comparator - the comparator to sort the nodes with

Returns:

sorted set of nodes in the form of a TreeSet

getNodesByResourceName

public java.util.List<N> getNodesByResourceName(java.lang.String resourceName)

Convenience method to return list of nodes corresponding to resourceName passed in the ResourceRequest.

Parameters:

resourceName - Host/rack name of the resource, or ResourceRequest.ANY

Returns:

list of nodes that match the resourceName

getNodeIdsByResourceName

public java.util.List<org.apache.hadoop.yarn.api.records.NodeId> getNodeIdsByResourceName(java.lang.String resourceName)

Convenience method to return list of NodeId corresponding to resourceName passed in the ResourceRequest.

Parameters:

resourceName - Host/rack name of the resource, or ResourceRequest.ANY

Returns:

list of NodeId that match the resourceName

updateNodesPerPartition

public void updateNodesPerPartition(java.lang.String partition,
                                    java.util.Set<org.apache.hadoop.yarn.api.records.NodeId> nodeIds)

update cached nodes per partition on a node label change event.

Parameters:

partition - nodeLabel

nodeIds - List of Node IDs

getNodesPerPartition

public java.util.List<N> getNodesPerPartition(java.lang.String partition)

getPartitions

public java.util.List<java.lang.String> getPartitions()