Package org.apache.hadoop.yarn.server.resourcemanager.scheduler.activities

Class ActivitiesManager

java.lang.Object

org.apache.hadoop.service.AbstractService

org.apache.hadoop.yarn.server.resourcemanager.scheduler.activities.ActivitiesManager

All Implemented Interfaces:

java.io.Closeable, java.lang.AutoCloseable, org.apache.hadoop.service.Service

public class ActivitiesManager
extends org.apache.hadoop.service.AbstractService

A class to store node or application allocations. It mainly contains operations for allocation start, add, update and finish.

Nested Class Summary

Nested Classes

Modifier and Type	Class	Description
static class	ActivitiesManager.DiagnosticsCollectorManager	Class to manage the diagnostics collector.

Nested classes/interfaces inherited from interface org.apache.hadoop.service.Service

org.apache.hadoop.service.Service.STATE

Field Summary

Fields

Modifier and Type	Field	Description
static char	DIAGNOSTICS_DETAILS_SEPARATOR
static java.lang.String	EMPTY_DIAGNOSTICS
static org.apache.hadoop.yarn.api.records.NodeId	EMPTY_NODE_ID

Constructor Summary

Constructors

Constructor	Description
ActivitiesManager(RMContext rmContext)

Method Summary

Modifier and Type	Method	Description
ActivitiesInfo	getActivitiesInfo(java.lang.String nodeId, RMWSConsts.ActivitiesGroupBy groupBy)
AppActivitiesInfo	getAppActivitiesInfo(org.apache.hadoop.yarn.api.records.ApplicationId applicationId, java.util.Set<java.lang.Integer> requestPriorities, java.util.Set<java.lang.Long> allocationRequestIds, RMWSConsts.ActivitiesGroupBy groupBy, int limit, boolean summarize, double maxTimeInSeconds)
int	getAppActivitiesMaxQueueLength()
static java.lang.String	getDiagnostics(java.util.Optional<DiagnosticsCollector> dcOpt)
java.util.Optional<DiagnosticsCollector>	getOptionalDiagnosticsCollector()
org.apache.hadoop.yarn.api.records.NodeId	getRecordingNodeId(SchedulerNode node)	Get recording node id: 1.
java.lang.String	getResourceDiagnostics(org.apache.hadoop.yarn.util.resource.ResourceCalculator rc, org.apache.hadoop.yarn.api.records.Resource required, org.apache.hadoop.yarn.api.records.Resource available)
boolean	isRecordingMultiNodes()
java.util.List<ActivitiesInfo>	recordAndGetBulkActivitiesInfo(int activitiesCount, RMWSConsts.ActivitiesGroupBy groupBy)
void	recordNextNodeUpdateActivities(java.lang.String nodeId)
protected void	serviceStart()
protected void	serviceStop()
void	turnOnAppActivitiesRecording(org.apache.hadoop.yarn.api.records.ApplicationId applicationId, double maxTime)

Methods inherited from class org.apache.hadoop.service.AbstractService

close, getBlockers, getConfig, getFailureCause, getFailureState, getLifecycleHistory, getName, getServiceState, getStartTime, init, isInState, noteFailure, putBlocker, registerGlobalListener, registerServiceListener, removeBlocker, serviceInit, setConfig, start, stop, toString, unregisterGlobalListener, unregisterServiceListener, waitForServiceToStop

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, wait, wait, wait

Field Detail

EMPTY_NODE_ID

public static final org.apache.hadoop.yarn.api.records.NodeId EMPTY_NODE_ID

DIAGNOSTICS_DETAILS_SEPARATOR

public static final char DIAGNOSTICS_DETAILS_SEPARATOR

See Also:

Constant Field Values

EMPTY_DIAGNOSTICS

public static final java.lang.String EMPTY_DIAGNOSTICS

See Also:

Constant Field Values

Constructor Detail

ActivitiesManager

public ActivitiesManager(RMContext rmContext)

Method Detail

getAppActivitiesInfo

public AppActivitiesInfo getAppActivitiesInfo(org.apache.hadoop.yarn.api.records.ApplicationId applicationId,
                                              java.util.Set<java.lang.Integer> requestPriorities,
                                              java.util.Set<java.lang.Long> allocationRequestIds,
                                              RMWSConsts.ActivitiesGroupBy groupBy,
                                              int limit,
                                              boolean summarize,
                                              double maxTimeInSeconds)

getActivitiesInfo

public ActivitiesInfo getActivitiesInfo(java.lang.String nodeId,
                                        RMWSConsts.ActivitiesGroupBy groupBy)

recordAndGetBulkActivitiesInfo

public java.util.List<ActivitiesInfo> recordAndGetBulkActivitiesInfo(int activitiesCount,
                                                                     RMWSConsts.ActivitiesGroupBy groupBy)
                                                              throws java.lang.InterruptedException

Throws:

java.lang.InterruptedException

recordNextNodeUpdateActivities

public void recordNextNodeUpdateActivities(java.lang.String nodeId)

turnOnAppActivitiesRecording

public void turnOnAppActivitiesRecording(org.apache.hadoop.yarn.api.records.ApplicationId applicationId,
                                         double maxTime)

serviceStart

protected void serviceStart()
                     throws java.lang.Exception

Overrides:

serviceStart in class org.apache.hadoop.service.AbstractService

Throws:

java.lang.Exception

serviceStop

protected void serviceStop()
                    throws java.lang.Exception

Overrides:

serviceStop in class org.apache.hadoop.service.AbstractService

Throws:

java.lang.Exception

isRecordingMultiNodes

public boolean isRecordingMultiNodes()

getRecordingNodeId

public org.apache.hadoop.yarn.api.records.NodeId getRecordingNodeId(SchedulerNode node)

Get recording node id: 1. node id of the input node if it is not null. 2. EMPTY_NODE_ID if input node is null and activities manager is recording multi-nodes. 3. null otherwise.

Parameters:

node - - input node

Returns:

recording nodeId

getOptionalDiagnosticsCollector

public java.util.Optional<DiagnosticsCollector> getOptionalDiagnosticsCollector()

getResourceDiagnostics

public java.lang.String getResourceDiagnostics(org.apache.hadoop.yarn.util.resource.ResourceCalculator rc,
                                               org.apache.hadoop.yarn.api.records.Resource required,
                                               org.apache.hadoop.yarn.api.records.Resource available)

getDiagnostics

public static java.lang.String getDiagnostics(java.util.Optional<DiagnosticsCollector> dcOpt)

getAppActivitiesMaxQueueLength

@VisibleForTesting
public int getAppActivitiesMaxQueueLength()