| Package | Description |
|---|---|
| org.apache.hadoop.hdfs | |
| org.apache.hadoop.hdfs.client |
This package provides the administrative APIs for HDFS.
|
| org.apache.hadoop.hdfs.client.impl |
Licensed to the Apache Software Foundation (ASF) under one
or more contributor license agreements.
|
| org.apache.hadoop.hdfs.protocol |
Licensed to the Apache Software Foundation (ASF) under one
or more contributor license agreements.
|
| org.apache.hadoop.hdfs.protocol.datatransfer | |
| org.apache.hadoop.hdfs.protocolPB | |
| org.apache.hadoop.hdfs.server.datanode | |
| org.apache.hadoop.hdfs.util |
Licensed to the Apache Software Foundation (ASF) under one
or more contributor license agreements.
|
| Modifier and Type | Method | Description |
|---|---|---|
ExtendedBlock |
DFSInputStream.getCurrentBlock() |
Returns the block containing the target position.
|
| Modifier and Type | Method | Description |
|---|---|---|
java.util.Map<ExtendedBlock,java.util.Set<DatanodeInfo>> |
DFSUtilClient.CorruptedBlocks.getCorruptionMap() |
| Modifier and Type | Method | Description |
|---|---|---|
void |
DFSUtilClient.CorruptedBlocks.addCorruptedBlock(ExtendedBlock blk,
DatanodeInfo node) |
Indicate a block replica on the specified datanode is corrupted
|
protected void |
DFSOutputStream.completeFile(ExtendedBlock last) |
|
static ExtendedBlockId |
ExtendedBlockId.fromExtendedBlock(ExtendedBlock block) |
| Modifier and Type | Method | Description |
|---|---|---|
ExtendedBlock |
HdfsDataInputStream.getCurrentBlock() |
Get the block containing the target position.
|
| Modifier and Type | Method | Description |
|---|---|---|
static BlockReader |
BlockReaderRemote.newBlockReader(java.lang.String file,
ExtendedBlock block,
org.apache.hadoop.security.token.Token<BlockTokenIdentifier> blockToken,
long startOffset,
long len,
boolean verifyChecksum,
java.lang.String clientName,
Peer peer,
DatanodeID datanodeID,
PeerCache peerCache,
CachingStrategy cachingStrategy,
int networkDistance,
org.apache.hadoop.conf.Configuration configuration) |
Create a new BlockReader specifically to satisfy a read.
|
BlockReaderFactory |
BlockReaderFactory.setBlock(ExtendedBlock block) |
| Modifier and Type | Method | Description |
|---|---|---|
ExtendedBlock |
BlockLocalPathInfo.getBlock() |
|
ExtendedBlock |
LocatedBlock.getBlock() |
|
ExtendedBlock |
StripedBlockInfo.getBlock() |
| Modifier and Type | Method | Description |
|---|---|---|
void |
ClientProtocol.abandonBlock(ExtendedBlock b,
long fileId,
java.lang.String src,
java.lang.String holder) |
The client can give up on a block by calling abandonBlock().
|
LocatedBlock |
ClientProtocol.addBlock(java.lang.String src,
java.lang.String clientName,
ExtendedBlock previous,
DatanodeInfo[] excludeNodes,
long fileId,
java.lang.String[] favoredNodes,
java.util.EnumSet<AddBlockFlag> addBlockFlags) |
A client that wants to write an additional block to the
indicated filename (which must currently be open for writing)
should call addBlock().
|
boolean |
ClientProtocol.complete(java.lang.String src,
java.lang.String clientName,
ExtendedBlock last,
long fileId) |
The client is done writing data to the given filename, and would
like to complete it.
|
LocatedBlock |
ClientProtocol.getAdditionalDatanode(java.lang.String src,
long fileId,
ExtendedBlock blk,
DatanodeInfo[] existings,
java.lang.String[] existingStorageIDs,
DatanodeInfo[] excludes,
int numAdditionalNodes,
java.lang.String clientName) |
Get a datanode for an existing pipeline.
|
BlockLocalPathInfo |
ClientDatanodeProtocol.getBlockLocalPathInfo(ExtendedBlock block,
org.apache.hadoop.security.token.Token<BlockTokenIdentifier> token) |
Retrieves the path names of the block file and metadata file stored on the
local file system.
|
static Block |
ExtendedBlock.getLocalBlock(ExtendedBlock b) |
|
long |
ClientDatanodeProtocol.getReplicaVisibleLength(ExtendedBlock b) |
Return the visible length of a replica.
|
LocatedBlock |
ClientProtocol.updateBlockForPipeline(ExtendedBlock block,
java.lang.String clientName) |
Get a new generation stamp together with an access token for
a block under construction
This method is called only when a client needs to recover a failed
pipeline or set up a pipeline for appending to a block.
|
void |
ClientProtocol.updatePipeline(java.lang.String clientName,
ExtendedBlock oldBlock,
ExtendedBlock newBlock,
DatanodeID[] newNodes,
java.lang.String[] newStorageIDs) |
Update a pipeline for a block under construction.
|
| Constructor | Description |
|---|---|
BlockLocalPathInfo(ExtendedBlock b,
java.lang.String file,
java.lang.String metafile) |
Constructs BlockLocalPathInfo.
|
ExtendedBlock(ExtendedBlock b) |
|
LocatedBlock(ExtendedBlock b,
DatanodeInfo[] locs) |
|
LocatedBlock(ExtendedBlock b,
DatanodeInfo[] locs,
java.lang.String[] storageIDs,
org.apache.hadoop.fs.StorageType[] storageTypes) |
|
LocatedBlock(ExtendedBlock b,
DatanodeInfo[] locs,
java.lang.String[] storageIDs,
org.apache.hadoop.fs.StorageType[] storageTypes,
long startOffset,
boolean corrupt,
DatanodeInfo[] cachedLocs) |
|
LocatedBlock(ExtendedBlock b,
DatanodeInfoWithStorage[] locs,
java.lang.String[] storageIDs,
org.apache.hadoop.fs.StorageType[] storageTypes,
long startOffset,
boolean corrupt,
DatanodeInfo[] cachedLocs) |
|
LocatedStripedBlock(ExtendedBlock b,
DatanodeInfo[] locs,
java.lang.String[] storageIDs,
org.apache.hadoop.fs.StorageType[] storageTypes,
byte[] indices,
long startOffset,
boolean corrupt,
DatanodeInfo[] cachedLocs) |
|
StripedBlockInfo(ExtendedBlock block,
DatanodeInfo[] datanodes,
org.apache.hadoop.security.token.Token<BlockTokenIdentifier>[] blockTokens,
byte[] blockIndices,
ErasureCodingPolicy ecPolicy) |
| Modifier and Type | Method | Description |
|---|---|---|
void |
DataTransferProtocol.blockChecksum(ExtendedBlock blk,
org.apache.hadoop.security.token.Token<BlockTokenIdentifier> blockToken,
BlockChecksumOptions blockChecksumOptions) |
Get block checksum (MD5 of CRC32).
|
void |
Sender.blockChecksum(ExtendedBlock blk,
org.apache.hadoop.security.token.Token<BlockTokenIdentifier> blockToken,
BlockChecksumOptions blockChecksumOptions) |
|
void |
DataTransferProtocol.copyBlock(ExtendedBlock blk,
org.apache.hadoop.security.token.Token<BlockTokenIdentifier> blockToken) |
Copy a block.
|
void |
Sender.copyBlock(ExtendedBlock blk,
org.apache.hadoop.security.token.Token<BlockTokenIdentifier> blockToken) |
|
void |
DataTransferProtocol.readBlock(ExtendedBlock blk,
org.apache.hadoop.security.token.Token<BlockTokenIdentifier> blockToken,
java.lang.String clientName,
long blockOffset,
long length,
boolean sendChecksum,
CachingStrategy cachingStrategy) |
Read a block.
|
void |
Sender.readBlock(ExtendedBlock blk,
org.apache.hadoop.security.token.Token<BlockTokenIdentifier> blockToken,
java.lang.String clientName,
long blockOffset,
long length,
boolean sendChecksum,
CachingStrategy cachingStrategy) |
|
void |
DataTransferProtocol.replaceBlock(ExtendedBlock blk,
org.apache.hadoop.fs.StorageType storageType,
org.apache.hadoop.security.token.Token<BlockTokenIdentifier> blockToken,
java.lang.String delHint,
DatanodeInfo source,
java.lang.String storageId) |
Receive a block from a source datanode
and then notifies the namenode
to remove the copy from the original datanode.
|
void |
Sender.replaceBlock(ExtendedBlock blk,
org.apache.hadoop.fs.StorageType storageType,
org.apache.hadoop.security.token.Token<BlockTokenIdentifier> blockToken,
java.lang.String delHint,
DatanodeInfo source,
java.lang.String storageId) |
|
void |
DataTransferProtocol.requestShortCircuitFds(ExtendedBlock blk,
org.apache.hadoop.security.token.Token<BlockTokenIdentifier> blockToken,
ShortCircuitShm.SlotId slotId,
int maxVersion,
boolean supportsReceiptVerification) |
Request short circuit access file descriptors from a DataNode.
|
void |
Sender.requestShortCircuitFds(ExtendedBlock blk,
org.apache.hadoop.security.token.Token<BlockTokenIdentifier> blockToken,
ShortCircuitShm.SlotId slotId,
int maxVersion,
boolean supportsReceiptVerification) |
|
void |
DataTransferProtocol.transferBlock(ExtendedBlock blk,
org.apache.hadoop.security.token.Token<BlockTokenIdentifier> blockToken,
java.lang.String clientName,
DatanodeInfo[] targets,
org.apache.hadoop.fs.StorageType[] targetStorageTypes,
java.lang.String[] targetStorageIDs) |
Transfer a block to another datanode.
|
void |
Sender.transferBlock(ExtendedBlock blk,
org.apache.hadoop.security.token.Token<BlockTokenIdentifier> blockToken,
java.lang.String clientName,
DatanodeInfo[] targets,
org.apache.hadoop.fs.StorageType[] targetStorageTypes,
java.lang.String[] targetStorageIds) |
|
void |
DataTransferProtocol.writeBlock(ExtendedBlock blk,
org.apache.hadoop.fs.StorageType storageType,
org.apache.hadoop.security.token.Token<BlockTokenIdentifier> blockToken,
java.lang.String clientName,
DatanodeInfo[] targets,
org.apache.hadoop.fs.StorageType[] targetStorageTypes,
DatanodeInfo source,
BlockConstructionStage stage,
int pipelineSize,
long minBytesRcvd,
long maxBytesRcvd,
long latestGenerationStamp,
org.apache.hadoop.util.DataChecksum requestedChecksum,
CachingStrategy cachingStrategy,
boolean allowLazyPersist,
boolean pinning,
boolean[] targetPinnings,
java.lang.String storageID,
java.lang.String[] targetStorageIDs) |
Write a block to a datanode pipeline.
|
void |
Sender.writeBlock(ExtendedBlock blk,
org.apache.hadoop.fs.StorageType storageType,
org.apache.hadoop.security.token.Token<BlockTokenIdentifier> blockToken,
java.lang.String clientName,
DatanodeInfo[] targets,
org.apache.hadoop.fs.StorageType[] targetStorageTypes,
DatanodeInfo source,
BlockConstructionStage stage,
int pipelineSize,
long minBytesRcvd,
long maxBytesRcvd,
long latestGenerationStamp,
org.apache.hadoop.util.DataChecksum requestedChecksum,
CachingStrategy cachingStrategy,
boolean allowLazyPersist,
boolean pinning,
boolean[] targetPinnings,
java.lang.String storageId,
java.lang.String[] targetStorageIds) |
| Modifier and Type | Method | Description |
|---|---|---|
static ExtendedBlock |
PBHelperClient.convert(org.apache.hadoop.hdfs.protocol.proto.HdfsProtos.ExtendedBlockProto eb) |
| Modifier and Type | Method | Description |
|---|---|---|
void |
ClientNamenodeProtocolTranslatorPB.abandonBlock(ExtendedBlock b,
long fileId,
java.lang.String src,
java.lang.String holder) |
|
LocatedBlock |
ClientNamenodeProtocolTranslatorPB.addBlock(java.lang.String src,
java.lang.String clientName,
ExtendedBlock previous,
DatanodeInfo[] excludeNodes,
long fileId,
java.lang.String[] favoredNodes,
java.util.EnumSet<AddBlockFlag> addBlockFlags) |
|
boolean |
ClientNamenodeProtocolTranslatorPB.complete(java.lang.String src,
java.lang.String clientName,
ExtendedBlock last,
long fileId) |
|
static org.apache.hadoop.hdfs.protocol.proto.HdfsProtos.ExtendedBlockProto |
PBHelperClient.convert(ExtendedBlock b) |
|
LocatedBlock |
ClientNamenodeProtocolTranslatorPB.getAdditionalDatanode(java.lang.String src,
long fileId,
ExtendedBlock blk,
DatanodeInfo[] existings,
java.lang.String[] existingStorageIDs,
DatanodeInfo[] excludes,
int numAdditionalNodes,
java.lang.String clientName) |
|
BlockLocalPathInfo |
ClientDatanodeProtocolTranslatorPB.getBlockLocalPathInfo(ExtendedBlock block,
org.apache.hadoop.security.token.Token<BlockTokenIdentifier> token) |
|
long |
ClientDatanodeProtocolTranslatorPB.getReplicaVisibleLength(ExtendedBlock b) |
|
LocatedBlock |
ClientNamenodeProtocolTranslatorPB.updateBlockForPipeline(ExtendedBlock block,
java.lang.String clientName) |
|
void |
ClientNamenodeProtocolTranslatorPB.updatePipeline(java.lang.String clientName,
ExtendedBlock oldBlock,
ExtendedBlock newBlock,
DatanodeID[] newNodes,
java.lang.String[] storageIDs) |
| Constructor | Description |
|---|---|
ReplicaNotFoundException(ExtendedBlock b) |
| Modifier and Type | Method | Description |
|---|---|---|
static ExtendedBlock |
StripedBlockUtil.constructInternalBlock(ExtendedBlock blockGroup,
int cellSize,
int dataBlkNum,
int idxInBlockGroup) |
This method creates an internal
ExtendedBlock at the given index
of a block group. |
static ExtendedBlock |
StripedBlockUtil.constructInternalBlock(ExtendedBlock blockGroup,
ErasureCodingPolicy ecPolicy,
int idxInBlockGroup) |
| Modifier and Type | Method | Description |
|---|---|---|
static void |
StripedBlockUtil.checkBlocks(ExtendedBlock blockGroup,
int i,
ExtendedBlock blocki) |
Check if the information such as IDs and generation stamps in block-i
match the block group.
|
static ExtendedBlock |
StripedBlockUtil.constructInternalBlock(ExtendedBlock blockGroup,
int cellSize,
int dataBlkNum,
int idxInBlockGroup) |
This method creates an internal
ExtendedBlock at the given index
of a block group. |
static ExtendedBlock |
StripedBlockUtil.constructInternalBlock(ExtendedBlock blockGroup,
ErasureCodingPolicy ecPolicy,
int idxInBlockGroup) |
Copyright © 2008–2025 Apache Software Foundation. All rights reserved.