Thread.State, Thread.UncaughtExceptionHandler
Modifier and Type | Field and Description |
---|---|
protected org.apache.hadoop.fs.FileSystem |
rfs |
MAX_PRIORITY, MIN_PRIORITY, NORM_PRIORITY
Constructor and Description |
---|
DirectShuffleFetcher(int id,
org.apache.hadoop.mapred.JobConf jobConf,
org.apache.hadoop.mapreduce.TaskAttemptID reduceId,
DirectShuffleSchedulerImpl<K,V> scheduler,
org.apache.hadoop.mapreduce.task.reduce.MergeManager<K,V> merger,
org.apache.hadoop.mapred.Reporter reporter,
org.apache.hadoop.mapreduce.task.reduce.ShuffleClientMetrics metrics,
org.apache.hadoop.mapreduce.task.reduce.ExceptionReporter exceptionReporter,
org.apache.hadoop.mapred.MapOutputFile mapOutputFile)
Represents the result of an attempt to copy a map output
|
Modifier and Type | Method and Description |
---|---|
protected long |
copyOutput(MapOutputLocation loc)
Copies a a map output from a remote host.
|
boolean |
fail()
Fail the current file that we are fetching
|
MapOutputLocation |
getLocation()
Get the current map output location.
|
void |
run()
Loop forever and fetch map outputs as they become available.
|
void |
shutDown() |
activeCount, checkAccess, clone, countStackFrames, currentThread, destroy, dumpStack, enumerate, getAllStackTraces, getContextClassLoader, getDefaultUncaughtExceptionHandler, getId, getName, getPriority, getStackTrace, getState, getThreadGroup, getUncaughtExceptionHandler, holdsLock, interrupt, interrupted, isAlive, isDaemon, isInterrupted, join, join, join, resume, setContextClassLoader, setDaemon, setDefaultUncaughtExceptionHandler, setName, setPriority, setUncaughtExceptionHandler, sleep, sleep, start, stop, stop, suspend, toString, yield
public DirectShuffleFetcher(int id, org.apache.hadoop.mapred.JobConf jobConf, org.apache.hadoop.mapreduce.TaskAttemptID reduceId, DirectShuffleSchedulerImpl<K,V> scheduler, org.apache.hadoop.mapreduce.task.reduce.MergeManager<K,V> merger, org.apache.hadoop.mapred.Reporter reporter, org.apache.hadoop.mapreduce.task.reduce.ShuffleClientMetrics metrics, org.apache.hadoop.mapreduce.task.reduce.ExceptionReporter exceptionReporter, org.apache.hadoop.mapred.MapOutputFile mapOutputFile)
public boolean fail()
public MapOutputLocation getLocation()
public void shutDown()
public void run()
protected long copyOutput(MapOutputLocation loc) throws IOException, InterruptedException
IOException
- if there is an error copying the fileInterruptedException
- if the copier should give upCopyright © 2019 Apache Software Foundation. All Rights Reserved.