JavaScript is disabled on your browser.
Overview
Package
Class
Use
Tree
Deprecated
Index
Help
Prev
Next
Frames
No Frames
All Classes
A
C
D
F
G
I
M
N
O
R
S
T
U
W
A
abort()
- Method in class org.apache.hadoop.mapreduce.task.reduce.
DirectInMemoryOutput
abort()
- Method in class org.apache.hadoop.mapreduce.task.reduce.
DirectOnDiskMapOutput
addKnownMapOutput(String, TaskAttemptID, PathId)
- Method in class org.apache.hadoop.mapreduce.task.reduce.
DirectShuffleSchedulerImpl
C
canShuffleToMemory(long)
- Method in class org.apache.hadoop.mapreduce.task.reduce.
DirectShuffleMergeManagerImpl
close()
- Method in class org.apache.hadoop.mapred.
MapRFsOutputBuffer
close()
- Method in class org.apache.hadoop.mapreduce.task.reduce.
DirectInMemoryReader
close()
- Method in class org.apache.hadoop.mapreduce.task.reduce.
DirectShuffle
close()
- Method in class org.apache.hadoop.mapreduce.task.reduce.
DirectShuffleMergeManagerImpl
close()
- Method in class org.apache.hadoop.mapreduce.task.reduce.
DirectShuffleSchedulerImpl
closeInMemoryFile(DirectInMemoryOutput<K, V>)
- Method in class org.apache.hadoop.mapreduce.task.reduce.
DirectShuffleMergeManagerImpl
closeInMemoryMergedFile(DirectInMemoryOutput<K, V>)
- Method in class org.apache.hadoop.mapreduce.task.reduce.
DirectShuffleMergeManagerImpl
closeOnDiskFile(FileStatus)
- Method in class org.apache.hadoop.mapreduce.task.reduce.
DirectShuffleMergeManagerImpl
CLUSTER_NAME_PREFIX
- Static variable in class org.apache.hadoop.mapreduce.conf.
MapReduceDefaultProperties
collect(K, V, int)
- Method in class org.apache.hadoop.mapred.
MapRFsOutputBuffer
Serialize the key, value to intermediate storage.
commit()
- Method in class org.apache.hadoop.mapreduce.task.reduce.
DirectInMemoryOutput
commit()
- Method in class org.apache.hadoop.mapreduce.task.reduce.
DirectOnDiskMapOutput
compare(int, int)
- Method in class org.apache.hadoop.mapred.
MapRFsOutputBuffer
Compare logical range, st i, j MOD offset capacity.
copyFailed(TaskAttemptID, MapOutputLocation)
- Method in class org.apache.hadoop.mapreduce.task.reduce.
DirectShuffleSchedulerImpl
copyOutput(MapOutputLocation)
- Method in class org.apache.hadoop.mapreduce.task.reduce.
DirectShuffleFetcher
Copies a a map output from a remote host.
copySucceeded(TaskAttemptID, MapOutputLocation, long, long, MapOutput<K, V>)
- Method in class org.apache.hadoop.mapreduce.task.reduce.
DirectShuffleSchedulerImpl
createInMemoryMerger()
- Method in class org.apache.hadoop.mapreduce.task.reduce.
DirectShuffleMergeManagerImpl
createMergeManager(ShuffleConsumerPlugin.Context<K, V>)
- Method in class org.apache.hadoop.mapreduce.task.reduce.
DirectShuffle
D
DirectInMemoryOutput
<
K
,
V
> - Class in
org.apache.hadoop.mapreduce.task.reduce
DirectInMemoryOutput(Configuration, TaskAttemptID, DirectShuffleMergeManagerImpl<K, V>, int, CompressionCodec, boolean)
- Constructor for class org.apache.hadoop.mapreduce.task.reduce.
DirectInMemoryOutput
DirectInMemoryReader
<
K
,
V
> - Class in
org.apache.hadoop.mapreduce.task.reduce
DirectInMemoryReader(DirectShuffleMergeManagerImpl<K, V>, TaskAttemptID, byte[], int, int, Configuration)
- Constructor for class org.apache.hadoop.mapreduce.task.reduce.
DirectInMemoryReader
DirectOnDiskMapOutput
<
K
,
V
> - Class in
org.apache.hadoop.mapreduce.task.reduce
DirectOnDiskMapOutput(TaskAttemptID, TaskAttemptID, DirectShuffleMergeManagerImpl<K, V>, long, JobConf, MapOutputFile, int, boolean)
- Constructor for class org.apache.hadoop.mapreduce.task.reduce.
DirectOnDiskMapOutput
DirectShuffle
<
K
,
V
> - Class in
org.apache.hadoop.mapreduce.task.reduce
DirectShuffle()
- Constructor for class org.apache.hadoop.mapreduce.task.reduce.
DirectShuffle
DirectShuffleEventFetcher
<
K
,
V
> - Class in
org.apache.hadoop.mapreduce.task.reduce
DirectShuffleEventFetcher(TaskAttemptID, TaskUmbilicalProtocol, ShuffleScheduler<K, V>, ExceptionReporter, int)
- Constructor for class org.apache.hadoop.mapreduce.task.reduce.
DirectShuffleEventFetcher
DirectShuffleFetcher
<
K
,
V
> - Class in
org.apache.hadoop.mapreduce.task.reduce
DirectShuffleFetcher(int, JobConf, TaskAttemptID, DirectShuffleSchedulerImpl<K, V>, MergeManager<K, V>, Reporter, ShuffleClientMetrics, ExceptionReporter, MapOutputFile)
- Constructor for class org.apache.hadoop.mapreduce.task.reduce.
DirectShuffleFetcher
Represents the result of an attempt to copy a map output
DirectShuffleMergeManagerImpl
<
K
,
V
> - Class in
org.apache.hadoop.mapreduce.task.reduce
DirectShuffleMergeManagerImpl(TaskAttemptID, JobConf, FileSystem, Reporter, CompressionCodec, Class<? extends Reducer>, Task.CombineOutputCollector<K, V>, Counters.Counter, Counters.Counter, Counters.Counter, ExceptionReporter, Progress, MapOutputFile)
- Constructor for class org.apache.hadoop.mapreduce.task.reduce.
DirectShuffleMergeManagerImpl
DirectShuffleSchedulerImpl
<
K
,
V
> - Class in
org.apache.hadoop.mapreduce.task.reduce
DirectShuffleSchedulerImpl(JobConf, TaskStatus, TaskAttemptID, ExceptionReporter, Progress, Counters.Counter, Counters.Counter, Counters.Counter)
- Constructor for class org.apache.hadoop.mapreduce.task.reduce.
DirectShuffleSchedulerImpl
F
fail()
- Method in class org.apache.hadoop.mapreduce.task.reduce.
DirectShuffleFetcher
Fail the current file that we are fetching
finish()
- Method in class org.apache.hadoop.mapred.
MapRIFileOutputStream
Finishes writing data to the output stream, by writing the checksum bytes to the end.
finish(long, long)
- Method in class org.apache.hadoop.mapred.
MapRIFileOutputStream
flush()
- Method in class org.apache.hadoop.mapred.
MapRFsOutputBuffer
G
getArrayStream()
- Method in class org.apache.hadoop.mapreduce.task.reduce.
DirectInMemoryOutput
getClosestPowerOf2(int)
- Static method in class org.apache.hadoop.mapreduce.task.reduce.
DirectShuffleSchedulerImpl
getConf()
- Method in class org.apache.hadoop.mapred.
MapRFsOutputFile
getDescription()
- Method in class org.apache.hadoop.mapreduce.task.reduce.
DirectInMemoryOutput
getDescription()
- Method in class org.apache.hadoop.mapreduce.task.reduce.
DirectOnDiskMapOutput
getFileBytesWritten()
- Method in class org.apache.hadoop.mapred.
MapOutputFileInfo
getHost()
- Method in class org.apache.hadoop.mapreduce.task.reduce.
MapOutputLocation
getInputFile(int)
- Method in class org.apache.hadoop.mapred.
MapRFsOutputFile
getInputFile(int, TaskAttemptID)
- Method in class org.apache.hadoop.mapred.
MapRFsOutputFile
getInputFileForWrite(TaskID, long)
- Method in class org.apache.hadoop.mapred.
MapRFsOutputFile
getInputFileForWrite(TaskID, TaskAttemptID, long)
- Method in class org.apache.hadoop.mapred.
MapRFsOutputFile
getLength()
- Method in class org.apache.hadoop.mapreduce.task.reduce.
DirectInMemoryReader
getLocalPathForWrite(String, long)
- Method in class org.apache.hadoop.mapred.
MapRFsOutputFile
getLocation()
- Method in class org.apache.hadoop.mapreduce.task.reduce.
DirectShuffleFetcher
Get the current map output location.
getLocation()
- Method in class org.apache.hadoop.mapreduce.task.reduce.
DirectShuffleSchedulerImpl
getMapCompletionEvents()
- Method in class org.apache.hadoop.mapreduce.task.reduce.
DirectShuffleEventFetcher
Queries the
TaskTracker
for a set of map-completion events from a given event ID.
getMapOutputFileInfo()
- Method in class org.apache.hadoop.mapred.
MapRIFileInputStream
getMapOutputSize()
- Method in class org.apache.hadoop.mapred.
MapOutputFileInfo
getMemory()
- Method in class org.apache.hadoop.mapreduce.task.reduce.
DirectInMemoryOutput
getOutputFid()
- Method in class org.apache.hadoop.mapred.
MapRFsOutputFile
getOutputFile()
- Method in class org.apache.hadoop.mapred.
MapRFsOutputFile
getOutputFileForWrite(long)
- Method in class org.apache.hadoop.mapred.
MapRFsOutputFile
getOutputFileForWrite(TaskAttemptID, long, int)
- Method in class org.apache.hadoop.mapred.
MapRFsOutputFile
getOutputFileForWriteFid(TaskAttemptID, long, int)
- Method in class org.apache.hadoop.mapred.
MapRFsOutputFile
getOutputFileForWriteInVolume(Path)
- Method in class org.apache.hadoop.mapred.
MapRFsOutputFile
getOutputIndexFile()
- Method in class org.apache.hadoop.mapred.
MapRFsOutputFile
getOutputIndexFileForWrite(long)
- Method in class org.apache.hadoop.mapred.
MapRFsOutputFile
getOutputIndexFileForWriteInVolume(Path)
- Method in class org.apache.hadoop.mapred.
MapRFsOutputFile
getPosition()
- Method in class org.apache.hadoop.mapreduce.task.reduce.
DirectInMemoryReader
getRelOutputFile(TaskAttemptID, int)
- Method in class org.apache.hadoop.mapred.
MapRFsOutputFile
getShuffleRootFid()
- Method in class org.apache.hadoop.mapreduce.task.reduce.
MapOutputLocation
getSize()
- Method in class org.apache.hadoop.mapred.
MapRIFileInputStream
getSpillFid()
- Method in class org.apache.hadoop.mapred.
MapRFsOutputFile
getSpillFile(int)
- Method in class org.apache.hadoop.mapred.
MapRFsOutputFile
getSpillFileForWrite(int, long)
- Method in class org.apache.hadoop.mapred.
MapRFsOutputFile
getSpillFileForWriteFid(TaskAttemptID, int, long)
- Method in class org.apache.hadoop.mapred.
MapRFsOutputFile
getSpillIndexFile(int)
- Method in class org.apache.hadoop.mapred.
MapRFsOutputFile
getSpillIndexFileForWrite(int, long)
- Method in class org.apache.hadoop.mapred.
MapRFsOutputFile
getTaskAttemptId()
- Method in class org.apache.hadoop.mapreduce.task.reduce.
MapOutputLocation
getTaskId()
- Method in class org.apache.hadoop.mapreduce.task.reduce.
MapOutputLocation
I
init(MapOutputCollector.Context)
- Method in class org.apache.hadoop.mapred.
MapRFsOutputBuffer
init(ShuffleConsumerPlugin.Context<K, V>)
- Method in class org.apache.hadoop.mapreduce.task.reduce.
DirectShuffle
M
MAPOUTPUT_INFO_BYTES
- Static variable in class org.apache.hadoop.mapred.
MapOutputFileInfo
mapOutputFile
- Variable in class org.apache.hadoop.mapreduce.task.reduce.
DirectShuffleMergeManagerImpl
MapOutputFileInfo
- Class in
org.apache.hadoop.mapred
MapOutputFileInfo(FSDataOutputStream, long, long)
- Constructor for class org.apache.hadoop.mapred.
MapOutputFileInfo
MapOutputFileInfo(FSDataInputStream, long)
- Constructor for class org.apache.hadoop.mapred.
MapOutputFileInfo
MapOutputFileInfo(FSDataInputStream, long, boolean)
- Constructor for class org.apache.hadoop.mapred.
MapOutputFileInfo
MapOutputLocation
- Class in
org.apache.hadoop.mapreduce.task.reduce
MapOutputLocation(TaskAttemptID, String, PathId)
- Constructor for class org.apache.hadoop.mapreduce.task.reduce.
MapOutputLocation
MapReduceDefaultProperties
- Class in
org.apache.hadoop.mapreduce.conf
MapReduceDefaultProperties()
- Constructor for class org.apache.hadoop.mapreduce.conf.
MapReduceDefaultProperties
MapRFsOutputBuffer
<
K
,
V
> - Class in
org.apache.hadoop.mapred
MapRFsOutputBuffer()
- Constructor for class org.apache.hadoop.mapred.
MapRFsOutputBuffer
MapRFsOutputBuffer.BlockingBuffer
- Class in
org.apache.hadoop.mapred
Inner class managing the spill of serialized records to disk.
MapRFsOutputBuffer.BlockingBuffer()
- Constructor for class org.apache.hadoop.mapred.
MapRFsOutputBuffer.BlockingBuffer
MapRFsOutputBuffer.Buffer
- Class in
org.apache.hadoop.mapred
MapRFsOutputBuffer.Buffer()
- Constructor for class org.apache.hadoop.mapred.
MapRFsOutputBuffer.Buffer
MapRFsOutputBuffer.InMemValBytes
- Class in
org.apache.hadoop.mapred
Inner class wrapping valuebytes, used for appendRaw.
MapRFsOutputBuffer.InMemValBytes()
- Constructor for class org.apache.hadoop.mapred.
MapRFsOutputBuffer.InMemValBytes
MapRFsOutputFile
- Class in
org.apache.hadoop.mapred
MapRFsOutputFile()
- Constructor for class org.apache.hadoop.mapred.
MapRFsOutputFile
MapRIFileInputStream
- Class in
org.apache.hadoop.mapred
MapRIFileInputStream(InputStream, long, Configuration)
- Constructor for class org.apache.hadoop.mapred.
MapRIFileInputStream
Given input stream and length of file verify the filesize and provide a way to extract mapoutputsize.
MapRIFileInputStream(InputStream, long, boolean, Configuration)
- Constructor for class org.apache.hadoop.mapred.
MapRIFileInputStream
MapRIFileOutputStream
- Class in
org.apache.hadoop.mapred
MapRIFileOutputStream(OutputStream)
- Constructor for class org.apache.hadoop.mapred.
MapRIFileOutputStream
Create a checksum output stream that writes the bytes to the given stream.
markRecord()
- Method in class org.apache.hadoop.mapred.
MapRFsOutputBuffer.BlockingBuffer
Mark end of record.
mergeParts()
- Method in class org.apache.hadoop.mapred.
MapRFsOutputBuffer
N
nextRawKey(DataInputBuffer)
- Method in class org.apache.hadoop.mapreduce.task.reduce.
DirectInMemoryReader
nextRawValue(DataInputBuffer)
- Method in class org.apache.hadoop.mapreduce.task.reduce.
DirectInMemoryReader
O
obsoleteMapOutput(TaskAttemptID)
- Method in class org.apache.hadoop.mapreduce.task.reduce.
DirectShuffleSchedulerImpl
org.apache.hadoop.mapred
- package org.apache.hadoop.mapred
org.apache.hadoop.mapreduce.conf
- package org.apache.hadoop.mapreduce.conf
org.apache.hadoop.mapreduce.task.reduce
- package org.apache.hadoop.mapreduce.task.reduce
R
removeAll()
- Method in class org.apache.hadoop.mapred.
MapRFsOutputFile
removeAll(boolean)
- Method in class org.apache.hadoop.mapred.
MapRFsOutputFile
reportException(Throwable)
- Method in class org.apache.hadoop.mapreduce.task.reduce.
DirectShuffle
reportLocalError(IOException)
- Method in class org.apache.hadoop.mapreduce.task.reduce.
DirectShuffleSchedulerImpl
reserve(TaskAttemptID, long, int)
- Method in class org.apache.hadoop.mapreduce.task.reduce.
DirectShuffleMergeManagerImpl
reset(byte[], int, int)
- Method in class org.apache.hadoop.mapred.
MapRFsOutputBuffer.InMemValBytes
reset(int)
- Method in class org.apache.hadoop.mapreduce.task.reduce.
DirectInMemoryReader
resolve(TaskCompletionEvent)
- Method in class org.apache.hadoop.mapreduce.task.reduce.
DirectShuffleSchedulerImpl
rfs
- Variable in class org.apache.hadoop.mapreduce.task.reduce.
DirectShuffleFetcher
run()
- Method in class org.apache.hadoop.mapreduce.task.reduce.
DirectShuffle
run()
- Method in class org.apache.hadoop.mapreduce.task.reduce.
DirectShuffleEventFetcher
run()
- Method in class org.apache.hadoop.mapreduce.task.reduce.
DirectShuffleFetcher
Loop forever and fetch map outputs as they become available.
S
setConf(Configuration)
- Method in class org.apache.hadoop.mapred.
MapRFsOutputFile
setUser(String, String)
- Method in class org.apache.hadoop.mapred.
MapRFsOutputFile
shiftBufferedKey()
- Method in class org.apache.hadoop.mapred.
MapRFsOutputBuffer.BlockingBuffer
Set position from last mark to end of writable buffer, then rewrite the data between last mark and kvindex.
shuffle(MapHost, InputStream, long, long, ShuffleClientMetrics, Reporter)
- Method in class org.apache.hadoop.mapreduce.task.reduce.
DirectInMemoryOutput
shuffle(MapHost, InputStream, long, long, ShuffleClientMetrics, Reporter)
- Method in class org.apache.hadoop.mapreduce.task.reduce.
DirectOnDiskMapOutput
shutDown()
- Method in class org.apache.hadoop.mapreduce.task.reduce.
DirectShuffleEventFetcher
shutDown()
- Method in class org.apache.hadoop.mapreduce.task.reduce.
DirectShuffleFetcher
sortAndSpill()
- Method in class org.apache.hadoop.mapred.
MapRFsOutputBuffer
sortAndSpillWrapper()
- Method in class org.apache.hadoop.mapred.
MapRFsOutputBuffer
swap(int, int)
- Method in class org.apache.hadoop.mapred.
MapRFsOutputBuffer
Swap metadata for items i, j
T
tipFailed(TaskID)
- Method in class org.apache.hadoop.mapreduce.task.reduce.
DirectShuffleSchedulerImpl
U
unconditionalReserve(TaskAttemptID, long, boolean)
- Method in class org.apache.hadoop.mapreduce.task.reduce.
DirectShuffleMergeManagerImpl
Unconditional Reserve is used by the Memory-to-Memory thread
W
waitForResource()
- Method in class org.apache.hadoop.mapreduce.task.reduce.
DirectShuffleMergeManagerImpl
waitUntilDone(int)
- Method in class org.apache.hadoop.mapreduce.task.reduce.
DirectShuffleSchedulerImpl
write()
- Method in class org.apache.hadoop.mapred.
MapOutputFileInfo
write(int)
- Method in class org.apache.hadoop.mapred.
MapRFsOutputBuffer.Buffer
write(byte[], int, int)
- Method in class org.apache.hadoop.mapred.
MapRFsOutputBuffer.Buffer
Attempt to write a sequence of bytes to the collection buffer.
A
C
D
F
G
I
M
N
O
R
S
T
U
W
Overview
Package
Class
Use
Tree
Deprecated
Index
Help
Prev
Next
Frames
No Frames
All Classes
Copyright © 2018
Apache Software Foundation
. All Rights Reserved.