Package org.apache.hadoop.hdfs.server.datanode.fsdataset.impl

Class NativePmemMappableBlockLoader

java.lang.Object

org.apache.hadoop.hdfs.server.datanode.fsdataset.impl.MappableBlockLoader

org.apache.hadoop.hdfs.server.datanode.fsdataset.impl.PmemMappableBlockLoader

org.apache.hadoop.hdfs.server.datanode.fsdataset.impl.NativePmemMappableBlockLoader

@Private
@Unstable
public class NativePmemMappableBlockLoader
extends PmemMappableBlockLoader

Map block to persistent memory with native PMDK libs.

Constructor Summary

Constructors

Constructor	Description
NativePmemMappableBlockLoader()

Method Summary

Modifier and Type	Method	Description
MappableBlock	getRecoveredMappableBlock(java.io.File cacheFile, java.lang.String bpid, byte volumeIndex)
boolean	isNativeLoader()
MappableBlock	load(long length, java.io.FileInputStream blockIn, java.io.FileInputStream metaIn, java.lang.String blockFileName, org.apache.hadoop.hdfs.ExtendedBlockId key)	Load the block.

Methods inherited from class org.apache.hadoop.hdfs.server.datanode.fsdataset.impl.PmemMappableBlockLoader

getBlockId, getCacheCapacity, getCacheUsed, isTransientCache

Methods inherited from class org.apache.hadoop.hdfs.server.datanode.fsdataset.impl.MappableBlockLoader

fillBuffer, verifyChecksum

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

NativePmemMappableBlockLoader

public NativePmemMappableBlockLoader()

Method Detail

load

public MappableBlock load(long length,
                          java.io.FileInputStream blockIn,
                          java.io.FileInputStream metaIn,
                          java.lang.String blockFileName,
                          org.apache.hadoop.hdfs.ExtendedBlockId key)
                   throws java.io.IOException

Load the block. Map the block and verify its checksum. The block will be mapped to PmemDir/BlockPoolId/subdir#/subdir#/BlockId, in which PmemDir is a persistent memory volume chosen by PmemVolumeManager.

Parameters:

length - The current length of the block.

blockIn - The block input stream. Should be positioned at the start. The caller must close this.

metaIn - The meta file input stream. Should be positioned at the start. The caller must close this.

blockFileName - The block file name, for logging purposes.

key - The extended block ID.

Returns:

The Mappable block.

Throws:

java.io.IOException - If mapping block to persistent memory fails or checksum fails.

isNativeLoader

public boolean isNativeLoader()

Overrides:

isNativeLoader in class PmemMappableBlockLoader

getRecoveredMappableBlock

public MappableBlock getRecoveredMappableBlock(java.io.File cacheFile,
                                               java.lang.String bpid,
                                               byte volumeIndex)
                                        throws java.io.IOException

Overrides:

getRecoveredMappableBlock in class PmemMappableBlockLoader

Throws:

java.io.IOException