| Package | Description |
|---|---|
| org.apache.hadoop.hdfs | |
| org.apache.hadoop.hdfs.client |
This package provides the administrative APIs for HDFS.
|
| org.apache.hadoop.hdfs.protocol |
Licensed to the Apache Software Foundation (ASF) under one
or more contributor license agreements.
|
| org.apache.hadoop.hdfs.protocolPB | |
| org.apache.hadoop.hdfs.util |
Licensed to the Apache Software Foundation (ASF) under one
or more contributor license agreements.
|
| org.apache.hadoop.hdfs.web |
| Modifier and Type | Method | Description |
|---|---|---|
ErasureCodingPolicy |
DFSClient.getErasureCodingPolicy(java.lang.String src) |
Get the erasure coding policy information for the specified path
|
ErasureCodingPolicy |
DistributedFileSystem.getErasureCodingPolicy(org.apache.hadoop.fs.Path path) |
Get erasure coding policy information for the specified path.
|
ErasureCodingPolicy |
ViewDistributedFileSystem.getErasureCodingPolicy(org.apache.hadoop.fs.Path path) |
| Modifier and Type | Method | Description |
|---|---|---|
AddErasureCodingPolicyResponse[] |
DFSClient.addErasureCodingPolicies(ErasureCodingPolicy[] policies) |
|
AddErasureCodingPolicyResponse[] |
DistributedFileSystem.addErasureCodingPolicies(ErasureCodingPolicy[] policies) |
Add Erasure coding policies to HDFS.
|
AddErasureCodingPolicyResponse[] |
ViewDistributedFileSystem.addErasureCodingPolicies(ErasureCodingPolicy[] policies) |
| Modifier and Type | Method | Description |
|---|---|---|
ErasureCodingPolicy |
HdfsAdmin.getErasureCodingPolicy(org.apache.hadoop.fs.Path path) |
Get the erasure coding policy information for the specified path
|
| Modifier and Type | Method | Description |
|---|---|---|
AddErasureCodingPolicyResponse[] |
HdfsAdmin.addErasureCodingPolicies(ErasureCodingPolicy[] policies) |
Add Erasure coding policies to HDFS.
|
| Modifier and Type | Method | Description |
|---|---|---|
static ErasureCodingPolicy |
SystemErasureCodingPolicies.getByID(byte id) |
Get a policy by policy ID.
|
static ErasureCodingPolicy |
SystemErasureCodingPolicies.getByName(java.lang.String name) |
Get a policy by policy name.
|
ErasureCodingPolicy |
ClientProtocol.getErasureCodingPolicy(java.lang.String src) |
Get the information about the EC policy for the path.
|
ErasureCodingPolicy |
HdfsFileStatus.getErasureCodingPolicy() |
Get the erasure coding policy if it's set.
|
ErasureCodingPolicy |
HdfsLocatedFileStatus.getErasureCodingPolicy() |
Get the erasure coding policy if it's set.
|
ErasureCodingPolicy |
HdfsNamedFileStatus.getErasureCodingPolicy() |
Get the erasure coding policy if it's set.
|
ErasureCodingPolicy |
LocatedBlocks.getErasureCodingPolicy() |
|
ErasureCodingPolicy |
StripedBlockInfo.getErasureCodingPolicy() |
|
ErasureCodingPolicy |
AddErasureCodingPolicyResponse.getPolicy() |
|
ErasureCodingPolicy |
ErasureCodingPolicyInfo.getPolicy() |
|
static ErasureCodingPolicy |
SystemErasureCodingPolicies.getReplicationPolicy() |
Get the special REPLICATION policy.
|
| Modifier and Type | Method | Description |
|---|---|---|
static java.util.List<ErasureCodingPolicy> |
SystemErasureCodingPolicies.getPolicies() |
Get system defined policies.
|
| Modifier and Type | Method | Description |
|---|---|---|
AddErasureCodingPolicyResponse[] |
ClientProtocol.addErasureCodingPolicies(ErasureCodingPolicy[] policies) |
Add Erasure coding policies to HDFS.
|
HdfsFileStatus.Builder |
HdfsFileStatus.Builder.ecPolicy(ErasureCodingPolicy ecPolicy) |
Set the erasure coding policy for this entity (default = null).
|
| Constructor | Description |
|---|---|
AddErasureCodingPolicyResponse(ErasureCodingPolicy policy) |
|
AddErasureCodingPolicyResponse(ErasureCodingPolicy policy,
java.lang.String errorMsg) |
|
AddErasureCodingPolicyResponse(ErasureCodingPolicy policy,
org.apache.hadoop.HadoopIllegalArgumentException e) |
|
ErasureCodingPolicyInfo(ErasureCodingPolicy thePolicy) |
|
ErasureCodingPolicyInfo(ErasureCodingPolicy thePolicy,
ErasureCodingPolicyState theState) |
|
LocatedBlocks(long flength,
boolean isUnderConstuction,
java.util.List<LocatedBlock> blks,
LocatedBlock lastBlock,
boolean isLastBlockCompleted,
org.apache.hadoop.fs.FileEncryptionInfo feInfo,
ErasureCodingPolicy ecPolicy) |
|
StripedBlockInfo(ExtendedBlock block,
DatanodeInfo[] datanodes,
org.apache.hadoop.security.token.Token<BlockTokenIdentifier>[] blockTokens,
byte[] blockIndices,
ErasureCodingPolicy ecPolicy) |
| Modifier and Type | Method | Description |
|---|---|---|
static ErasureCodingPolicy |
PBHelperClient.convertErasureCodingPolicy(org.apache.hadoop.hdfs.protocol.proto.HdfsProtos.ErasureCodingPolicyProto proto) |
Convert the protobuf to a
ErasureCodingPolicy. |
ErasureCodingPolicy |
ClientNamenodeProtocolTranslatorPB.getErasureCodingPolicy(java.lang.String src) |
| Modifier and Type | Method | Description |
|---|---|---|
AddErasureCodingPolicyResponse[] |
ClientNamenodeProtocolTranslatorPB.addErasureCodingPolicies(ErasureCodingPolicy[] policies) |
|
static org.apache.hadoop.hdfs.protocol.proto.HdfsProtos.ErasureCodingPolicyProto |
PBHelperClient.convertErasureCodingPolicy(ErasureCodingPolicy policy) |
Convert a
ErasureCodingPolicy to protobuf. |
| Modifier and Type | Method | Description |
|---|---|---|
java.util.List<ErasureCodingPolicy> |
ECPolicyLoader.loadPolicy(java.lang.String policyFilePath) |
Load user defined EC policies from a XML configuration file.
|
| Modifier and Type | Method | Description |
|---|---|---|
static ExtendedBlock |
StripedBlockUtil.constructInternalBlock(ExtendedBlock blockGroup,
ErasureCodingPolicy ecPolicy,
int idxInBlockGroup) |
|
static StripedBlockUtil.AlignedStripe[] |
StripedBlockUtil.divideByteRangeIntoStripes(ErasureCodingPolicy ecPolicy,
int cellSize,
LocatedStripedBlock blockGroup,
long rangeStartInBlockGroup,
long rangeEndInBlockGroup,
java.nio.ByteBuffer buf) |
This method divides a requested byte range into an array of inclusive
StripedBlockUtil.AlignedStripe. |
static StripedBlockUtil.AlignedStripe[] |
StripedBlockUtil.divideOneStripe(ErasureCodingPolicy ecPolicy,
int cellSize,
LocatedStripedBlock blockGroup,
long rangeStartInBlockGroup,
long rangeEndInBlockGroup,
java.nio.ByteBuffer buf) |
Similar functionality with
StripedBlockUtil.divideByteRangeIntoStripes(org.apache.hadoop.hdfs.protocol.ErasureCodingPolicy, int, org.apache.hadoop.hdfs.protocol.LocatedStripedBlock, long, long, java.nio.ByteBuffer), but is used
by stateful read and uses ByteBuffer as reading target buffer. |
static long |
StripedBlockUtil.getInternalBlockLength(long dataSize,
ErasureCodingPolicy ecPolicy,
int idxInBlockGroup) |
|
static long |
StripedBlockUtil.getSafeLength(ErasureCodingPolicy ecPolicy,
long[] blockLens) |
Compute the safe length given the internal block lengths.
|
| Modifier and Type | Method | Description |
|---|---|---|
ErasureCodingPolicy |
WebHdfsFileSystem.getErasureCodingPolicy(org.apache.hadoop.fs.Path p) |
|
static ErasureCodingPolicy |
JsonUtilClient.toECPolicy(java.util.Map<?,?> m) |
Copyright © 2008–2025 Apache Software Foundation. All rights reserved.