Package org.apache.hadoop.hdfs

Class DeadNodeDetector

java.lang.Object

java.lang.Thread

org.apache.hadoop.util.Daemon

org.apache.hadoop.hdfs.DeadNodeDetector

All Implemented Interfaces:

java.lang.Runnable

public class DeadNodeDetector
extends org.apache.hadoop.util.Daemon

Detect the dead nodes in advance, and share this information among all the DFSInputStreams in the same client.

Nested Class Summary

Nested classes/interfaces inherited from class org.apache.hadoop.util.Daemon

org.apache.hadoop.util.Daemon.DaemonFactory

Nested classes/interfaces inherited from class java.lang.Thread

java.lang.Thread.UncaughtExceptionHandler

Field Summary

Fields

Modifier and Type	Field	Description
static org.slf4j.Logger	LOG

Fields inherited from class java.lang.Thread

MAX_PRIORITY, MIN_PRIORITY, NORM_PRIORITY

Constructor Summary

Constructors

Constructor	Description
DeadNodeDetector(java.lang.String name, org.apache.hadoop.conf.Configuration conf)

Method Summary

Modifier and Type	Method	Description
void	addNodeToDetect(DFSInputStream dfsInputStream, DatanodeInfo datanodeInfo)	Add datanode to suspectNodes and suspectAndDeadNodes.
java.util.Set<DatanodeInfo>	clearAndGetDetectedDeadNodes()	Remove dead node which is not used by any DFSInputStream from deadNodes.
org.apache.hadoop.hdfs.DeadNodeDetector.UniqueQueue<DatanodeInfo>	getDeadNodesProbeQueue()
org.apache.hadoop.hdfs.DeadNodeDetector.UniqueQueue<DatanodeInfo>	getSuspectNodesProbeQueue()
boolean	isDeadNode(DatanodeInfo datanodeInfo)
void	removeNodeFromDeadNodeDetector(DFSInputStream dfsInputStream, DatanodeInfo datanodeInfo)	Remove suspect and dead node from suspectAndDeadNodes#dfsInputStream and local deadNodes.
void	run()
void	shutdown()	Shutdown all the threads.

Methods inherited from class org.apache.hadoop.util.Daemon

getRunnable

Methods inherited from class java.lang.Thread

activeCount, checkAccess, clone, countStackFrames, currentThread, dumpStack, enumerate, getAllStackTraces, getContextClassLoader, getDefaultUncaughtExceptionHandler, getId, getName, getPriority, getStackTrace, getState, getThreadGroup, getUncaughtExceptionHandler, holdsLock, interrupt, interrupted, isAlive, isDaemon, isInterrupted, join, join, join, onSpinWait, resume, setContextClassLoader, setDaemon, setDefaultUncaughtExceptionHandler, setName, setPriority, setUncaughtExceptionHandler, sleep, sleep, start, stop, suspend, toString, yield

Methods inherited from class java.lang.Object

equals, finalize, getClass, hashCode, notify, notifyAll, wait, wait, wait

Field Detail

LOG

public static final org.slf4j.Logger LOG

Constructor Detail

DeadNodeDetector

public DeadNodeDetector(java.lang.String name,
                        org.apache.hadoop.conf.Configuration conf)

Method Detail

run

public void run()

Specified by:

run in interface java.lang.Runnable

Overrides:

run in class java.lang.Thread

shutdown

public void shutdown()

Shutdown all the threads.

isDeadNode

public boolean isDeadNode(DatanodeInfo datanodeInfo)

getDeadNodesProbeQueue

public org.apache.hadoop.hdfs.DeadNodeDetector.UniqueQueue<DatanodeInfo> getDeadNodesProbeQueue()

getSuspectNodesProbeQueue

public org.apache.hadoop.hdfs.DeadNodeDetector.UniqueQueue<DatanodeInfo> getSuspectNodesProbeQueue()

addNodeToDetect

public void addNodeToDetect(DFSInputStream dfsInputStream,
                            DatanodeInfo datanodeInfo)

Add datanode to suspectNodes and suspectAndDeadNodes.

clearAndGetDetectedDeadNodes

public java.util.Set<DatanodeInfo> clearAndGetDetectedDeadNodes()

Remove dead node which is not used by any DFSInputStream from deadNodes.

Returns:

new dead node shared by all DFSInputStreams.

removeNodeFromDeadNodeDetector

public void removeNodeFromDeadNodeDetector(DFSInputStream dfsInputStream,
                                           DatanodeInfo datanodeInfo)

Remove suspect and dead node from suspectAndDeadNodes#dfsInputStream and local deadNodes.