Package org.apache.hadoop.hdfs.server.blockmanagement

Class AvailableSpaceRackFaultTolerantBlockPlacementPolicy

java.lang.Object

org.apache.hadoop.hdfs.server.blockmanagement.BlockPlacementPolicy

org.apache.hadoop.hdfs.server.blockmanagement.BlockPlacementPolicyDefault

org.apache.hadoop.hdfs.server.blockmanagement.BlockPlacementPolicyRackFaultTolerant

org.apache.hadoop.hdfs.server.blockmanagement.AvailableSpaceRackFaultTolerantBlockPlacementPolicy

public class AvailableSpaceRackFaultTolerantBlockPlacementPolicy
extends BlockPlacementPolicyRackFaultTolerant

Space balanced rack fault tolerant block placement policy.

Nested Class Summary

Nested classes/interfaces inherited from class org.apache.hadoop.hdfs.server.blockmanagement.BlockPlacementPolicy

BlockPlacementPolicy.NotEnoughReplicasException

Field Summary

Fields inherited from class org.apache.hadoop.hdfs.server.blockmanagement.BlockPlacementPolicyDefault

clusterMap, considerLoad, considerLoadFactor, heartbeatInterval, host2datanodeMap, tolerateHeartbeatMultiplier

Constructor Summary

Constructors

Constructor	Description
AvailableSpaceRackFaultTolerantBlockPlacementPolicy()

Method Summary

Modifier and Type	Method	Description
protected DatanodeDescriptor	chooseDataNode(java.lang.String scope, java.util.Collection<org.apache.hadoop.net.Node> excludedNode)	Choose a datanode from the given scope.
protected DatanodeDescriptor	chooseDataNode(java.lang.String scope, java.util.Collection<org.apache.hadoop.net.Node> excludedNode, org.apache.hadoop.fs.StorageType type)	Choose a datanode from the given scope with specified storage type.
protected int	compareDataNode(DatanodeDescriptor a, DatanodeDescriptor b)	Compare the two data nodes.
void	initialize(org.apache.hadoop.conf.Configuration conf, FSClusterStats stats, org.apache.hadoop.net.NetworkTopology clusterMap, org.apache.hadoop.hdfs.server.blockmanagement.Host2NodesMap host2datanodeMap)	Used to setup a BlockPlacementPolicy object.

Methods inherited from class org.apache.hadoop.hdfs.server.blockmanagement.BlockPlacementPolicyRackFaultTolerant

chooseTargetInOrder, getMaxNodesPerRack, pickupReplicaSet, verifyBlockPlacement

Methods inherited from class org.apache.hadoop.hdfs.server.blockmanagement.BlockPlacementPolicyDefault

addToExcludedNodes, chooseFavouredNodes, chooseLocalOrFavoredStorage, chooseLocalRack, chooseLocalStorage, chooseLocalStorage, chooseRandom, chooseRandom, chooseRemoteRack, chooseReplicasToDelete, chooseReplicaToDelete, chooseTarget, chooseTarget, getExcludeSlowNodesEnabled, getMinBlocksForWrite, isMovable, setExcludeSlowNodesEnabled, setMinBlocksForWrite

Methods inherited from class org.apache.hadoop.hdfs.server.blockmanagement.BlockPlacementPolicy

adjustSetsWithChosenReplica, getDatanodeInfo, getRack, splitNodesWithRack

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

AvailableSpaceRackFaultTolerantBlockPlacementPolicy

public AvailableSpaceRackFaultTolerantBlockPlacementPolicy()

Method Detail

initialize

public void initialize(org.apache.hadoop.conf.Configuration conf,
                       FSClusterStats stats,
                       org.apache.hadoop.net.NetworkTopology clusterMap,
                       org.apache.hadoop.hdfs.server.blockmanagement.Host2NodesMap host2datanodeMap)

Description copied from class: BlockPlacementPolicy

Used to setup a BlockPlacementPolicy object. This should be defined by all implementations of a BlockPlacementPolicy.

Overrides:

initialize in class BlockPlacementPolicyDefault

Parameters:

conf - the configuration object

stats - retrieve cluster status from here

clusterMap - cluster topology

chooseDataNode

protected DatanodeDescriptor chooseDataNode(java.lang.String scope,
                                            java.util.Collection<org.apache.hadoop.net.Node> excludedNode,
                                            org.apache.hadoop.fs.StorageType type)

Description copied from class: BlockPlacementPolicyDefault

Choose a datanode from the given scope with specified storage type.

Overrides:

chooseDataNode in class BlockPlacementPolicyDefault

Returns:

the chosen node, if there is any.

chooseDataNode

protected DatanodeDescriptor chooseDataNode(java.lang.String scope,
                                            java.util.Collection<org.apache.hadoop.net.Node> excludedNode)

Description copied from class: BlockPlacementPolicyDefault

Choose a datanode from the given scope.

Overrides:

chooseDataNode in class BlockPlacementPolicyDefault

Returns:

the chosen node, if there is any.

compareDataNode

protected int compareDataNode(DatanodeDescriptor a,
                              DatanodeDescriptor b)

Compare the two data nodes.