A C D F G I M N O R S T U W 

A

abort() - Method in class org.apache.hadoop.mapreduce.task.reduce.DirectInMemoryOutput
 
abort() - Method in class org.apache.hadoop.mapreduce.task.reduce.DirectOnDiskMapOutput
 
addKnownMapOutput(String, TaskAttemptID, PathId) - Method in class org.apache.hadoop.mapreduce.task.reduce.DirectShuffleSchedulerImpl
 

C

canShuffleToMemory(long) - Method in class org.apache.hadoop.mapreduce.task.reduce.DirectShuffleMergeManagerImpl
 
close() - Method in class org.apache.hadoop.mapred.MapRFsOutputBuffer
 
close() - Method in class org.apache.hadoop.mapreduce.task.reduce.DirectInMemoryReader
 
close() - Method in class org.apache.hadoop.mapreduce.task.reduce.DirectShuffle
 
close() - Method in class org.apache.hadoop.mapreduce.task.reduce.DirectShuffleMergeManagerImpl
 
close() - Method in class org.apache.hadoop.mapreduce.task.reduce.DirectShuffleSchedulerImpl
 
closeInMemoryFile(DirectInMemoryOutput<K, V>) - Method in class org.apache.hadoop.mapreduce.task.reduce.DirectShuffleMergeManagerImpl
 
closeInMemoryMergedFile(DirectInMemoryOutput<K, V>) - Method in class org.apache.hadoop.mapreduce.task.reduce.DirectShuffleMergeManagerImpl
 
closeOnDiskFile(FileStatus) - Method in class org.apache.hadoop.mapreduce.task.reduce.DirectShuffleMergeManagerImpl
 
CLUSTER_NAME_PREFIX - Static variable in class org.apache.hadoop.mapreduce.conf.MapReduceDefaultProperties
 
collect(K, V, int) - Method in class org.apache.hadoop.mapred.MapRFsOutputBuffer
Serialize the key, value to intermediate storage.
commit() - Method in class org.apache.hadoop.mapreduce.task.reduce.DirectInMemoryOutput
 
commit() - Method in class org.apache.hadoop.mapreduce.task.reduce.DirectOnDiskMapOutput
 
compare(int, int) - Method in class org.apache.hadoop.mapred.MapRFsOutputBuffer
Compare logical range, st i, j MOD offset capacity.
copyFailed(TaskAttemptID, MapOutputLocation) - Method in class org.apache.hadoop.mapreduce.task.reduce.DirectShuffleSchedulerImpl
 
copyOutput(MapOutputLocation) - Method in class org.apache.hadoop.mapreduce.task.reduce.DirectShuffleFetcher
Copies a a map output from a remote host.
copySucceeded(TaskAttemptID, MapOutputLocation, long, long, MapOutput<K, V>) - Method in class org.apache.hadoop.mapreduce.task.reduce.DirectShuffleSchedulerImpl
 
createInMemoryMerger() - Method in class org.apache.hadoop.mapreduce.task.reduce.DirectShuffleMergeManagerImpl
 
createMergeManager(ShuffleConsumerPlugin.Context<K, V>) - Method in class org.apache.hadoop.mapreduce.task.reduce.DirectShuffle
 

D

DirectInMemoryOutput<K,V> - Class in org.apache.hadoop.mapreduce.task.reduce
 
DirectInMemoryOutput(Configuration, TaskAttemptID, DirectShuffleMergeManagerImpl<K, V>, int, CompressionCodec, boolean) - Constructor for class org.apache.hadoop.mapreduce.task.reduce.DirectInMemoryOutput
 
DirectInMemoryReader<K,V> - Class in org.apache.hadoop.mapreduce.task.reduce
 
DirectInMemoryReader(DirectShuffleMergeManagerImpl<K, V>, TaskAttemptID, byte[], int, int, Configuration) - Constructor for class org.apache.hadoop.mapreduce.task.reduce.DirectInMemoryReader
 
DirectOnDiskMapOutput<K,V> - Class in org.apache.hadoop.mapreduce.task.reduce
 
DirectOnDiskMapOutput(TaskAttemptID, TaskAttemptID, DirectShuffleMergeManagerImpl<K, V>, long, JobConf, MapOutputFile, int, boolean) - Constructor for class org.apache.hadoop.mapreduce.task.reduce.DirectOnDiskMapOutput
 
DirectShuffle<K,V> - Class in org.apache.hadoop.mapreduce.task.reduce
 
DirectShuffle() - Constructor for class org.apache.hadoop.mapreduce.task.reduce.DirectShuffle
 
DirectShuffleEventFetcher<K,V> - Class in org.apache.hadoop.mapreduce.task.reduce
 
DirectShuffleEventFetcher(TaskAttemptID, TaskUmbilicalProtocol, ShuffleScheduler<K, V>, ExceptionReporter, int) - Constructor for class org.apache.hadoop.mapreduce.task.reduce.DirectShuffleEventFetcher
 
DirectShuffleFetcher<K,V> - Class in org.apache.hadoop.mapreduce.task.reduce
 
DirectShuffleFetcher(int, JobConf, TaskAttemptID, DirectShuffleSchedulerImpl<K, V>, MergeManager<K, V>, Reporter, ShuffleClientMetrics, ExceptionReporter, MapOutputFile) - Constructor for class org.apache.hadoop.mapreduce.task.reduce.DirectShuffleFetcher
Represents the result of an attempt to copy a map output
DirectShuffleMergeManagerImpl<K,V> - Class in org.apache.hadoop.mapreduce.task.reduce
 
DirectShuffleMergeManagerImpl(TaskAttemptID, JobConf, FileSystem, Reporter, CompressionCodec, Class<? extends Reducer>, Task.CombineOutputCollector<K, V>, Counters.Counter, Counters.Counter, Counters.Counter, ExceptionReporter, Progress, MapOutputFile) - Constructor for class org.apache.hadoop.mapreduce.task.reduce.DirectShuffleMergeManagerImpl
 
DirectShuffleSchedulerImpl<K,V> - Class in org.apache.hadoop.mapreduce.task.reduce
 
DirectShuffleSchedulerImpl(JobConf, TaskStatus, TaskAttemptID, ExceptionReporter, Progress, Counters.Counter, Counters.Counter, Counters.Counter) - Constructor for class org.apache.hadoop.mapreduce.task.reduce.DirectShuffleSchedulerImpl
 

F

fail() - Method in class org.apache.hadoop.mapreduce.task.reduce.DirectShuffleFetcher
Fail the current file that we are fetching
finish() - Method in class org.apache.hadoop.mapred.MapRIFileOutputStream
Finishes writing data to the output stream, by writing the checksum bytes to the end.
finish(long, long) - Method in class org.apache.hadoop.mapred.MapRIFileOutputStream
 
flush() - Method in class org.apache.hadoop.mapred.MapRFsOutputBuffer
 

G

getArrayStream() - Method in class org.apache.hadoop.mapreduce.task.reduce.DirectInMemoryOutput
 
getClosestPowerOf2(int) - Static method in class org.apache.hadoop.mapreduce.task.reduce.DirectShuffleSchedulerImpl
 
getConf() - Method in class org.apache.hadoop.mapred.MapRFsOutputFile
 
getDescription() - Method in class org.apache.hadoop.mapreduce.task.reduce.DirectInMemoryOutput
 
getDescription() - Method in class org.apache.hadoop.mapreduce.task.reduce.DirectOnDiskMapOutput
 
getFileBytesWritten() - Method in class org.apache.hadoop.mapred.MapOutputFileInfo
 
getHost() - Method in class org.apache.hadoop.mapreduce.task.reduce.MapOutputLocation
 
getInputFile(int) - Method in class org.apache.hadoop.mapred.MapRFsOutputFile
 
getInputFile(int, TaskAttemptID) - Method in class org.apache.hadoop.mapred.MapRFsOutputFile
 
getInputFileForWrite(TaskID, long) - Method in class org.apache.hadoop.mapred.MapRFsOutputFile
 
getInputFileForWrite(TaskID, TaskAttemptID, long) - Method in class org.apache.hadoop.mapred.MapRFsOutputFile
 
getLength() - Method in class org.apache.hadoop.mapreduce.task.reduce.DirectInMemoryReader
 
getLocalPathForWrite(String, long) - Method in class org.apache.hadoop.mapred.MapRFsOutputFile
 
getLocation() - Method in class org.apache.hadoop.mapreduce.task.reduce.DirectShuffleFetcher
Get the current map output location.
getLocation() - Method in class org.apache.hadoop.mapreduce.task.reduce.DirectShuffleSchedulerImpl
 
getMapCompletionEvents() - Method in class org.apache.hadoop.mapreduce.task.reduce.DirectShuffleEventFetcher
Queries the TaskTracker for a set of map-completion events from a given event ID.
getMapOutputFileInfo() - Method in class org.apache.hadoop.mapred.MapRIFileInputStream
 
getMapOutputSize() - Method in class org.apache.hadoop.mapred.MapOutputFileInfo
 
getMemory() - Method in class org.apache.hadoop.mapreduce.task.reduce.DirectInMemoryOutput
 
getOutputFid() - Method in class org.apache.hadoop.mapred.MapRFsOutputFile
 
getOutputFile() - Method in class org.apache.hadoop.mapred.MapRFsOutputFile
 
getOutputFileForWrite(long) - Method in class org.apache.hadoop.mapred.MapRFsOutputFile
 
getOutputFileForWrite(TaskAttemptID, long, int) - Method in class org.apache.hadoop.mapred.MapRFsOutputFile
 
getOutputFileForWriteFid(TaskAttemptID, long, int) - Method in class org.apache.hadoop.mapred.MapRFsOutputFile
 
getOutputFileForWriteInVolume(Path) - Method in class org.apache.hadoop.mapred.MapRFsOutputFile
 
getOutputIndexFile() - Method in class org.apache.hadoop.mapred.MapRFsOutputFile
 
getOutputIndexFileForWrite(long) - Method in class org.apache.hadoop.mapred.MapRFsOutputFile
 
getOutputIndexFileForWriteInVolume(Path) - Method in class org.apache.hadoop.mapred.MapRFsOutputFile
 
getPosition() - Method in class org.apache.hadoop.mapreduce.task.reduce.DirectInMemoryReader
 
getRelOutputFile(TaskAttemptID, int) - Method in class org.apache.hadoop.mapred.MapRFsOutputFile
 
getShuffleRootFid() - Method in class org.apache.hadoop.mapreduce.task.reduce.MapOutputLocation
 
getSize() - Method in class org.apache.hadoop.mapred.MapRIFileInputStream
 
getSpillFid() - Method in class org.apache.hadoop.mapred.MapRFsOutputFile
 
getSpillFile(int) - Method in class org.apache.hadoop.mapred.MapRFsOutputFile
 
getSpillFileForWrite(int, long) - Method in class org.apache.hadoop.mapred.MapRFsOutputFile
 
getSpillFileForWriteFid(TaskAttemptID, int, long) - Method in class org.apache.hadoop.mapred.MapRFsOutputFile
 
getSpillIndexFile(int) - Method in class org.apache.hadoop.mapred.MapRFsOutputFile
 
getSpillIndexFileForWrite(int, long) - Method in class org.apache.hadoop.mapred.MapRFsOutputFile
 
getTaskAttemptId() - Method in class org.apache.hadoop.mapreduce.task.reduce.MapOutputLocation
 
getTaskId() - Method in class org.apache.hadoop.mapreduce.task.reduce.MapOutputLocation
 

I

init(MapOutputCollector.Context) - Method in class org.apache.hadoop.mapred.MapRFsOutputBuffer
 
init(ShuffleConsumerPlugin.Context<K, V>) - Method in class org.apache.hadoop.mapreduce.task.reduce.DirectShuffle
 

M

MAPOUTPUT_INFO_BYTES - Static variable in class org.apache.hadoop.mapred.MapOutputFileInfo
 
mapOutputFile - Variable in class org.apache.hadoop.mapreduce.task.reduce.DirectShuffleMergeManagerImpl
 
MapOutputFileInfo - Class in org.apache.hadoop.mapred
 
MapOutputFileInfo(FSDataOutputStream, long, long) - Constructor for class org.apache.hadoop.mapred.MapOutputFileInfo
 
MapOutputFileInfo(FSDataInputStream, long) - Constructor for class org.apache.hadoop.mapred.MapOutputFileInfo
 
MapOutputFileInfo(FSDataInputStream, long, boolean) - Constructor for class org.apache.hadoop.mapred.MapOutputFileInfo
 
MapOutputLocation - Class in org.apache.hadoop.mapreduce.task.reduce
 
MapOutputLocation(TaskAttemptID, String, PathId) - Constructor for class org.apache.hadoop.mapreduce.task.reduce.MapOutputLocation
 
MapReduceDefaultProperties - Class in org.apache.hadoop.mapreduce.conf
 
MapReduceDefaultProperties() - Constructor for class org.apache.hadoop.mapreduce.conf.MapReduceDefaultProperties
 
MapRFsOutputBuffer<K,V> - Class in org.apache.hadoop.mapred
 
MapRFsOutputBuffer() - Constructor for class org.apache.hadoop.mapred.MapRFsOutputBuffer
 
MapRFsOutputBuffer.BlockingBuffer - Class in org.apache.hadoop.mapred
Inner class managing the spill of serialized records to disk.
MapRFsOutputBuffer.BlockingBuffer() - Constructor for class org.apache.hadoop.mapred.MapRFsOutputBuffer.BlockingBuffer
 
MapRFsOutputBuffer.Buffer - Class in org.apache.hadoop.mapred
 
MapRFsOutputBuffer.Buffer() - Constructor for class org.apache.hadoop.mapred.MapRFsOutputBuffer.Buffer
 
MapRFsOutputBuffer.InMemValBytes - Class in org.apache.hadoop.mapred
Inner class wrapping valuebytes, used for appendRaw.
MapRFsOutputBuffer.InMemValBytes() - Constructor for class org.apache.hadoop.mapred.MapRFsOutputBuffer.InMemValBytes
 
MapRFsOutputFile - Class in org.apache.hadoop.mapred
 
MapRFsOutputFile() - Constructor for class org.apache.hadoop.mapred.MapRFsOutputFile
 
MapRIFileInputStream - Class in org.apache.hadoop.mapred
 
MapRIFileInputStream(InputStream, long, Configuration) - Constructor for class org.apache.hadoop.mapred.MapRIFileInputStream
Given input stream and length of file verify the filesize and provide a way to extract mapoutputsize.
MapRIFileInputStream(InputStream, long, boolean, Configuration) - Constructor for class org.apache.hadoop.mapred.MapRIFileInputStream
 
MapRIFileOutputStream - Class in org.apache.hadoop.mapred
 
MapRIFileOutputStream(OutputStream) - Constructor for class org.apache.hadoop.mapred.MapRIFileOutputStream
Create a checksum output stream that writes the bytes to the given stream.
markRecord() - Method in class org.apache.hadoop.mapred.MapRFsOutputBuffer.BlockingBuffer
Mark end of record.
mergeParts() - Method in class org.apache.hadoop.mapred.MapRFsOutputBuffer
 

N

nextRawKey(DataInputBuffer) - Method in class org.apache.hadoop.mapreduce.task.reduce.DirectInMemoryReader
 
nextRawValue(DataInputBuffer) - Method in class org.apache.hadoop.mapreduce.task.reduce.DirectInMemoryReader
 

O

obsoleteMapOutput(TaskAttemptID) - Method in class org.apache.hadoop.mapreduce.task.reduce.DirectShuffleSchedulerImpl
 
org.apache.hadoop.mapred - package org.apache.hadoop.mapred
 
org.apache.hadoop.mapreduce.conf - package org.apache.hadoop.mapreduce.conf
 
org.apache.hadoop.mapreduce.task.reduce - package org.apache.hadoop.mapreduce.task.reduce
 

R

removeAll() - Method in class org.apache.hadoop.mapred.MapRFsOutputFile
 
removeAll(boolean) - Method in class org.apache.hadoop.mapred.MapRFsOutputFile
 
reportException(Throwable) - Method in class org.apache.hadoop.mapreduce.task.reduce.DirectShuffle
 
reportLocalError(IOException) - Method in class org.apache.hadoop.mapreduce.task.reduce.DirectShuffleSchedulerImpl
 
reserve(TaskAttemptID, long, int) - Method in class org.apache.hadoop.mapreduce.task.reduce.DirectShuffleMergeManagerImpl
 
reset(byte[], int, int) - Method in class org.apache.hadoop.mapred.MapRFsOutputBuffer.InMemValBytes
 
reset(int) - Method in class org.apache.hadoop.mapreduce.task.reduce.DirectInMemoryReader
 
resolve(TaskCompletionEvent) - Method in class org.apache.hadoop.mapreduce.task.reduce.DirectShuffleSchedulerImpl
 
rfs - Variable in class org.apache.hadoop.mapreduce.task.reduce.DirectShuffleFetcher
 
run() - Method in class org.apache.hadoop.mapreduce.task.reduce.DirectShuffle
 
run() - Method in class org.apache.hadoop.mapreduce.task.reduce.DirectShuffleEventFetcher
 
run() - Method in class org.apache.hadoop.mapreduce.task.reduce.DirectShuffleFetcher
Loop forever and fetch map outputs as they become available.

S

setConf(Configuration) - Method in class org.apache.hadoop.mapred.MapRFsOutputFile
 
setUser(String, String) - Method in class org.apache.hadoop.mapred.MapRFsOutputFile
 
shiftBufferedKey() - Method in class org.apache.hadoop.mapred.MapRFsOutputBuffer.BlockingBuffer
Set position from last mark to end of writable buffer, then rewrite the data between last mark and kvindex.
shuffle(MapHost, InputStream, long, long, ShuffleClientMetrics, Reporter) - Method in class org.apache.hadoop.mapreduce.task.reduce.DirectInMemoryOutput
 
shuffle(MapHost, InputStream, long, long, ShuffleClientMetrics, Reporter) - Method in class org.apache.hadoop.mapreduce.task.reduce.DirectOnDiskMapOutput
 
shutDown() - Method in class org.apache.hadoop.mapreduce.task.reduce.DirectShuffleEventFetcher
 
shutDown() - Method in class org.apache.hadoop.mapreduce.task.reduce.DirectShuffleFetcher
 
sortAndSpill() - Method in class org.apache.hadoop.mapred.MapRFsOutputBuffer
 
sortAndSpillWrapper() - Method in class org.apache.hadoop.mapred.MapRFsOutputBuffer
 
swap(int, int) - Method in class org.apache.hadoop.mapred.MapRFsOutputBuffer
Swap metadata for items i, j

T

tipFailed(TaskID) - Method in class org.apache.hadoop.mapreduce.task.reduce.DirectShuffleSchedulerImpl
 

U

unconditionalReserve(TaskAttemptID, long, boolean) - Method in class org.apache.hadoop.mapreduce.task.reduce.DirectShuffleMergeManagerImpl
Unconditional Reserve is used by the Memory-to-Memory thread

W

waitForResource() - Method in class org.apache.hadoop.mapreduce.task.reduce.DirectShuffleMergeManagerImpl
 
waitUntilDone(int) - Method in class org.apache.hadoop.mapreduce.task.reduce.DirectShuffleSchedulerImpl
 
write() - Method in class org.apache.hadoop.mapred.MapOutputFileInfo
 
write(int) - Method in class org.apache.hadoop.mapred.MapRFsOutputBuffer.Buffer
 
write(byte[], int, int) - Method in class org.apache.hadoop.mapred.MapRFsOutputBuffer.Buffer
Attempt to write a sequence of bytes to the collection buffer.
A C D F G I M N O R S T U W 

Copyright © 2018 Apache Software Foundation. All Rights Reserved.