Package org.apache.hadoop.hdfs.server.common

Class ECTopologyVerifier

java.lang.Object

org.apache.hadoop.hdfs.server.common.ECTopologyVerifier

@Private
public final class ECTopologyVerifier
extends java.lang.Object

Class for verifying whether the cluster setup can support all enabled EC policies. Scenarios when the verification fails: 1. not enough data nodes compared to EC policy's highest data+parity number 2. not enough racks to satisfy BlockPlacementPolicyRackFaultTolerant

Field Summary

Fields

Modifier and Type	Field	Description
static org.slf4j.Logger	LOG

Method Summary

Modifier and Type	Method	Description
static org.apache.hadoop.hdfs.protocol.ECTopologyVerifierResult	getECTopologyVerifierResult(int numOfRacks, int numOfDataNodes, java.util.Collection<org.apache.hadoop.hdfs.protocol.ErasureCodingPolicy> policies)	Verifies whether the cluster setup can support all enabled EC policies.
static org.apache.hadoop.hdfs.protocol.ECTopologyVerifierResult	getECTopologyVerifierResult(org.apache.hadoop.hdfs.protocol.DatanodeInfo[] report, java.util.Collection<org.apache.hadoop.hdfs.protocol.ErasureCodingPolicy> policies)	Verifies whether the cluster setup can support the given EC policies.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

LOG

public static final org.slf4j.Logger LOG

Method Detail

getECTopologyVerifierResult

public static org.apache.hadoop.hdfs.protocol.ECTopologyVerifierResult getECTopologyVerifierResult(org.apache.hadoop.hdfs.protocol.DatanodeInfo[] report,
                                                                                                   java.util.Collection<org.apache.hadoop.hdfs.protocol.ErasureCodingPolicy> policies)

Verifies whether the cluster setup can support the given EC policies.

Parameters:

report - list of data node descriptors for all data nodes

policies - erasure coding policies to verify

Returns:

the status of the verification

getECTopologyVerifierResult

public static org.apache.hadoop.hdfs.protocol.ECTopologyVerifierResult getECTopologyVerifierResult(int numOfRacks,
                                                                                                   int numOfDataNodes,
                                                                                                   java.util.Collection<org.apache.hadoop.hdfs.protocol.ErasureCodingPolicy> policies)

Verifies whether the cluster setup can support all enabled EC policies.

Parameters:

numOfRacks - number of racks

numOfDataNodes - number of data nodes

policies - erasure coding policies to verify

Returns:

the status of the verification