Package org.apache.hadoop.hdfs.server.namenode

Class NamenodeFsck

java.lang.Object

org.apache.hadoop.hdfs.server.namenode.NamenodeFsck

All Implemented Interfaces:

org.apache.hadoop.hdfs.protocol.datatransfer.sasl.DataEncryptionKeyFactory

@Private
public class NamenodeFsck
extends java.lang.Object
implements org.apache.hadoop.hdfs.protocol.datatransfer.sasl.DataEncryptionKeyFactory

This class provides rudimentary checking of DFS volumes for errors and sub-optimal conditions.

The tool scans all files and directories, starting from an indicated root path and its descendants. The following abnormal conditions are detected and handled:

• files with blocks that are completely missing from all datanodes.
  In this case the tool can perform one of the following actions:
  • move corrupted files to /lost+found directory on DFS (doMove). Remaining data blocks are saved as a block chains, representing longest consecutive series of valid blocks.
  • delete corrupted files (doDelete)
• detect files with under-replicated or over-replicated blocks

Additionally, the tool collects a detailed overall DFS statistics, and optionally can print detailed statistics on block locations and replication factors of each file.

Field Summary

Fields

Modifier and Type	Field	Description
static java.lang.String	CORRUPT_STATUS
static java.lang.String	DECOMMISSIONED_STATUS
static java.lang.String	DECOMMISSIONING_STATUS
static java.lang.String	ENTERING_MAINTENANCE_STATUS
static java.lang.String	EXCESS_STATUS
static java.lang.String	FAILURE_STATUS
static java.lang.String	HEALTHY_STATUS
static java.lang.String	IN_MAINTENANCE_STATUS
static org.slf4j.Logger	LOG
static java.lang.String	NONEXISTENT_STATUS
static java.lang.String	STALE_STATUS
static java.lang.String	UNDEFINED

Method Summary

Modifier and Type	Method	Description
void	blockIdCK(java.lang.String blockId)	Check block information given a blockId number
void	fsck()	Check files on DFS, starting from the indicated path.
java.lang.String	getAuditSource()
org.apache.hadoop.hdfs.security.token.block.DataEncryptionKey	newDataEncryptionKey()

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

LOG

public static final org.slf4j.Logger LOG

CORRUPT_STATUS

public static final java.lang.String CORRUPT_STATUS

See Also:

Constant Field Values

HEALTHY_STATUS

public static final java.lang.String HEALTHY_STATUS

See Also:

Constant Field Values

DECOMMISSIONING_STATUS

public static final java.lang.String DECOMMISSIONING_STATUS

See Also:

Constant Field Values

DECOMMISSIONED_STATUS

public static final java.lang.String DECOMMISSIONED_STATUS

See Also:

Constant Field Values

ENTERING_MAINTENANCE_STATUS

public static final java.lang.String ENTERING_MAINTENANCE_STATUS

See Also:

Constant Field Values

IN_MAINTENANCE_STATUS

public static final java.lang.String IN_MAINTENANCE_STATUS

See Also:

Constant Field Values

STALE_STATUS

public static final java.lang.String STALE_STATUS

See Also:

Constant Field Values

EXCESS_STATUS

public static final java.lang.String EXCESS_STATUS

See Also:

Constant Field Values

NONEXISTENT_STATUS

public static final java.lang.String NONEXISTENT_STATUS

See Also:

Constant Field Values

FAILURE_STATUS

public static final java.lang.String FAILURE_STATUS

See Also:

Constant Field Values

UNDEFINED

public static final java.lang.String UNDEFINED

See Also:

Constant Field Values

Method Detail

getAuditSource

public java.lang.String getAuditSource()

blockIdCK

public void blockIdCK(java.lang.String blockId)

Check block information given a blockId number

fsck

public void fsck()
          throws org.apache.hadoop.security.AccessControlException

Check files on DFS, starting from the indicated path.

Throws:

org.apache.hadoop.security.AccessControlException

newDataEncryptionKey

public org.apache.hadoop.hdfs.security.token.block.DataEncryptionKey newDataEncryptionKey()
                                                                                   throws java.io.IOException

Specified by:

newDataEncryptionKey in interface org.apache.hadoop.hdfs.protocol.datatransfer.sasl.DataEncryptionKeyFactory

Throws:

java.io.IOException