@InterfaceAudience.Private @InterfaceStability.Unstable public class FifoPolicy extends SchedulingPolicy
Modifier and Type | Field and Description |
---|---|
static String |
NAME |
DEFAULT_POLICY, DEPTH_ANY, DEPTH_INTERMEDIATE, DEPTH_LEAF, DEPTH_PARENT, DEPTH_ROOT
Constructor and Description |
---|
FifoPolicy() |
Modifier and Type | Method and Description |
---|---|
boolean |
checkIfAMResourceUsageOverLimit(org.apache.hadoop.yarn.api.records.Resource usage,
org.apache.hadoop.yarn.api.records.Resource maxAMResource)
Check if a leaf queue's AM resource usage over its limit under this policy
|
boolean |
checkIfUsageOverFairShare(org.apache.hadoop.yarn.api.records.Resource usage,
org.apache.hadoop.yarn.api.records.Resource fairShare)
Check if the resource usage is over the fair share under this policy
|
void |
computeShares(Collection<? extends Schedulable> schedulables,
org.apache.hadoop.yarn.api.records.Resource totalResources)
Computes and updates the shares of
Schedulable s as per
the SchedulingPolicy , to be used later for scheduling decisions. |
void |
computeSteadyShares(Collection<? extends FSQueue> queues,
org.apache.hadoop.yarn.api.records.Resource totalResources)
Computes and updates the steady shares of
FSQueue s as per the
SchedulingPolicy . |
byte |
getApplicableDepth()
Specifies the depths in the hierarchy, this
SchedulingPolicy
applies to |
Comparator<Schedulable> |
getComparator()
The comparator returned by this method is to be used for sorting the
Schedulable s in that queue. |
org.apache.hadoop.yarn.api.records.Resource |
getHeadroom(org.apache.hadoop.yarn.api.records.Resource queueFairShare,
org.apache.hadoop.yarn.api.records.Resource queueUsage,
org.apache.hadoop.yarn.api.records.Resource clusterAvailable)
Get headroom by calculating the min of
clusterAvailable and
(queueFairShare - queueUsage ) resources that are
applicable to this policy. |
String |
getName() |
getInstance, initialize, isApplicableTo, parse
public static final String NAME
public String getName()
getName
in class SchedulingPolicy
SchedulingPolicy
public Comparator<Schedulable> getComparator()
SchedulingPolicy
Schedulable
s in that queue.getComparator
in class SchedulingPolicy
public void computeShares(Collection<? extends Schedulable> schedulables, org.apache.hadoop.yarn.api.records.Resource totalResources)
SchedulingPolicy
Schedulable
s as per
the SchedulingPolicy
, to be used later for scheduling decisions.
The shares computed are instantaneous and only consider queues with
running applications.computeShares
in class SchedulingPolicy
schedulables
- Schedulable
s whose shares are to be updatedtotalResources
- Total Resource
s in the clusterpublic void computeSteadyShares(Collection<? extends FSQueue> queues, org.apache.hadoop.yarn.api.records.Resource totalResources)
SchedulingPolicy
FSQueue
s as per the
SchedulingPolicy
. The steady share does not differentiate
between queues with and without running applications under them. The
steady share is not used for scheduling, it is displayed on the Web UI
for better visibility.computeSteadyShares
in class SchedulingPolicy
queues
- FSQueue
s whose shares are to be updatedtotalResources
- Total Resource
s in the clusterpublic boolean checkIfUsageOverFairShare(org.apache.hadoop.yarn.api.records.Resource usage, org.apache.hadoop.yarn.api.records.Resource fairShare)
SchedulingPolicy
checkIfUsageOverFairShare
in class SchedulingPolicy
usage
- Resource
the resource usagefairShare
- Resource
the fair sharepublic boolean checkIfAMResourceUsageOverLimit(org.apache.hadoop.yarn.api.records.Resource usage, org.apache.hadoop.yarn.api.records.Resource maxAMResource)
SchedulingPolicy
checkIfAMResourceUsageOverLimit
in class SchedulingPolicy
usage
- Resource
the resource used by application mastersmaxAMResource
- Resource
the maximum allowed resource for
application masterspublic org.apache.hadoop.yarn.api.records.Resource getHeadroom(org.apache.hadoop.yarn.api.records.Resource queueFairShare, org.apache.hadoop.yarn.api.records.Resource queueUsage, org.apache.hadoop.yarn.api.records.Resource clusterAvailable)
SchedulingPolicy
clusterAvailable
and
(queueFairShare
- queueUsage
) resources that are
applicable to this policy. For eg if only memory then leave other
resources such as CPU to same as clusterAvailable.getHeadroom
in class SchedulingPolicy
queueFairShare
- fairshare in the queuequeueUsage
- resources used in the queueclusterAvailable
- available resource in clusterpublic byte getApplicableDepth()
SchedulingPolicy
SchedulingPolicy
applies togetApplicableDepth
in class SchedulingPolicy
SchedulingPolicy
#DEPTH_*Copyright © 2015 Apache Software Foundation. All Rights Reserved.