Package org.apache.hadoop.hdfs.server.namenode.sps

Class BlockStorageMovementNeeded

java.lang.Object

org.apache.hadoop.hdfs.server.namenode.sps.BlockStorageMovementNeeded

@Private
public class BlockStorageMovementNeeded
extends java.lang.Object

A Class to track the block collection IDs (Inode's ID) for which physical storage movement needed as per the Namespace and StorageReports from DN. It scan the pending directories for which storage movement is required and schedule the block collection IDs for movement. It track the info of scheduled items and remove the SPS xAttr from the file/Directory once movement is success.

Nested Class Summary

Nested Classes

Modifier and Type	Class	Description
static class	BlockStorageMovementNeeded.DirPendingWorkInfo	Info for directory recursive scan.

Field Summary

Fields

Modifier and Type	Field	Description
static org.slf4j.Logger	LOG

Constructor Summary

Constructors

Constructor	Description
BlockStorageMovementNeeded(Context context)

Method Summary

Modifier and Type	Method	Description
void	activate()
void	add(ItemInfo trackInfo)	Add the candidate to tracking list for which storage movement expected if necessary.
void	add(ItemInfo itemInfo, boolean scanCompleted)	Add the itemInfo to tracking list for which storage movement expected if necessary.
void	addAll(long startPath, java.util.List<ItemInfo> itemInfoList, boolean scanCompleted)	Add the itemInfo list to tracking list for which storage movement expected if necessary.
void	clearAll()
void	clearQueuesWithNotification()	Clean all the movements in spsDirsToBeTraveresed/storageMovementNeeded and notify to clean up required resources.
void	close()
ItemInfo	get()	Gets the satisfier files for which block storage movements check necessary and make the movement if required.
static long	getStatusClearanceElapsedTimeMs()
void	markScanCompletedForDir(long inode)
void	removeItemTrackInfo(ItemInfo trackInfo, boolean isSuccess)	Decrease the pending child count for directory once one file blocks moved successfully.
static void	setStatusClearanceElapsedTimeMs(long statusClearanceElapsedTimeMs)
int	size()	Returns queue size.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

LOG

public static final org.slf4j.Logger LOG

Constructor Detail

BlockStorageMovementNeeded

public BlockStorageMovementNeeded(Context context)

Method Detail

add

public void add(ItemInfo trackInfo)

Add the candidate to tracking list for which storage movement expected if necessary.

Parameters:

trackInfo - - track info for satisfy the policy

addAll

@VisibleForTesting
public void addAll(long startPath,
                   java.util.List<ItemInfo> itemInfoList,
                   boolean scanCompleted)

Add the itemInfo list to tracking list for which storage movement expected if necessary.

Parameters:

startPath - - start path

itemInfoList - - List of child in the directory

scanCompleted - -Indicates whether the start id directory has no more elements to scan.

add

@VisibleForTesting
public void add(ItemInfo itemInfo,
                boolean scanCompleted)

Add the itemInfo to tracking list for which storage movement expected if necessary.

Parameters:

itemInfo - - child in the directory

scanCompleted - -Indicates whether the ItemInfo start id directory has no more elements to scan.

get

public ItemInfo get()

Gets the satisfier files for which block storage movements check necessary and make the movement if required.

Returns:

satisfier files

size

public int size()

Returns queue size.

clearAll

public void clearAll()

removeItemTrackInfo

public void removeItemTrackInfo(ItemInfo trackInfo,
                                boolean isSuccess)
                         throws java.io.IOException

Decrease the pending child count for directory once one file blocks moved successfully. Remove the SPS xAttr if pending child count is zero.

Throws:

java.io.IOException

clearQueuesWithNotification

public void clearQueuesWithNotification()

Clean all the movements in spsDirsToBeTraveresed/storageMovementNeeded and notify to clean up required resources.

activate

public void activate()

close

public void close()

setStatusClearanceElapsedTimeMs

@VisibleForTesting
public static void setStatusClearanceElapsedTimeMs(long statusClearanceElapsedTimeMs)

getStatusClearanceElapsedTimeMs

@VisibleForTesting
public static long getStatusClearanceElapsedTimeMs()

markScanCompletedForDir

public void markScanCompletedForDir(long inode)