Package org.apache.hadoop.yarn.server.globalpolicygenerator.policygenerator

Class PolicyGenerator

java.lang.Object

org.apache.hadoop.yarn.server.globalpolicygenerator.policygenerator.PolicyGenerator

All Implemented Interfaces:

java.lang.Runnable, org.apache.hadoop.conf.Configurable

public class PolicyGenerator
extends java.lang.Object
implements java.lang.Runnable, org.apache.hadoop.conf.Configurable

The PolicyGenerator runs periodically and updates the policy configuration for each queue into the FederationStateStore. The policy update behavior is defined by the GlobalPolicy instance that is used.

Constructor Summary

Constructors

Constructor	Description
PolicyGenerator(org.apache.hadoop.conf.Configuration conf, GPGContext context)	The PolicyGenerator periodically reads SubCluster load and updates policies into the FederationStateStore.

Method Summary

Modifier and Type	Method	Description
org.apache.hadoop.conf.Configuration	getConf()
protected java.util.Map<org.apache.hadoop.yarn.server.federation.store.records.SubClusterId,java.util.Map<java.lang.Class,java.lang.Object>>	getInfos(java.util.Map<org.apache.hadoop.yarn.server.federation.store.records.SubClusterId,org.apache.hadoop.yarn.server.federation.store.records.SubClusterInfo> activeSubClusters)	Helper to retrieve metrics from the RM REST endpoints.
GlobalPolicy	getPolicy()
protected java.util.Map<org.apache.hadoop.yarn.server.federation.store.records.SubClusterId,org.apache.hadoop.yarn.server.resourcemanager.webapp.dao.SchedulerInfo>	getSchedulerInfo(java.util.Map<org.apache.hadoop.yarn.server.federation.store.records.SubClusterId,org.apache.hadoop.yarn.server.federation.store.records.SubClusterInfo> activeSubClusters)	Helper to retrieve SchedulerInfos.
void	run()
void	setConf(org.apache.hadoop.conf.Configuration conf)
void	setPolicy(GlobalPolicy policy)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

PolicyGenerator

public PolicyGenerator(org.apache.hadoop.conf.Configuration conf,
                       GPGContext context)

The PolicyGenerator periodically reads SubCluster load and updates policies into the FederationStateStore.

Parameters:

conf - Configuration.

context - GPG Context.

Method Detail

setConf

public void setConf(org.apache.hadoop.conf.Configuration conf)

Specified by:

setConf in interface org.apache.hadoop.conf.Configurable

getConf

public org.apache.hadoop.conf.Configuration getConf()

Specified by:

getConf in interface org.apache.hadoop.conf.Configurable

run

public final void run()

Specified by:

run in interface java.lang.Runnable

getInfos

@VisibleForTesting
protected java.util.Map<org.apache.hadoop.yarn.server.federation.store.records.SubClusterId,java.util.Map<java.lang.Class,java.lang.Object>> getInfos(java.util.Map<org.apache.hadoop.yarn.server.federation.store.records.SubClusterId,org.apache.hadoop.yarn.server.federation.store.records.SubClusterInfo> activeSubClusters)

Helper to retrieve metrics from the RM REST endpoints.

Parameters:

activeSubClusters - A map of active SubCluster IDs to info

Returns:

Mapping relationship between SubClusterId and Metric.

getSchedulerInfo

@VisibleForTesting
protected java.util.Map<org.apache.hadoop.yarn.server.federation.store.records.SubClusterId,org.apache.hadoop.yarn.server.resourcemanager.webapp.dao.SchedulerInfo> getSchedulerInfo(java.util.Map<org.apache.hadoop.yarn.server.federation.store.records.SubClusterId,org.apache.hadoop.yarn.server.federation.store.records.SubClusterInfo> activeSubClusters)

Helper to retrieve SchedulerInfos.

Parameters:

activeSubClusters - A map of active SubCluster IDs to info

Returns:

Mapping relationship between SubClusterId and SubClusterInfo.

getPolicy

public GlobalPolicy getPolicy()

setPolicy

public void setPolicy(GlobalPolicy policy)