Package org.apache.hadoop.mapred.nativetask.util

Interface NativeTaskOutput

All Known Implementing Classes:

LocalJobOutputFiles, NativeTaskOutputFiles

@Private
public interface NativeTaskOutput

base class of output files manager.

Method Summary

Modifier and Type	Method	Description
org.apache.hadoop.fs.Path	getInputFile(int mapId)	Return a local reduce input file created earlier
org.apache.hadoop.fs.Path	getInputFileForWrite(org.apache.hadoop.mapred.TaskID mapId, long size, org.apache.hadoop.conf.Configuration conf)	Create a local reduce input file name.
org.apache.hadoop.fs.Path	getOutputFile()	Return the path to local map output file created earlier
org.apache.hadoop.fs.Path	getOutputFileForWrite(long size)	Create a local map output file name.
org.apache.hadoop.fs.Path	getOutputIndexFile()	Return the path to a local map output index file created earlier
org.apache.hadoop.fs.Path	getOutputIndexFileForWrite(long size)	Create a local map output index file name.
java.lang.String	getOutputName(int partition)
org.apache.hadoop.fs.Path	getSpillFile(int spillNumber)	Return a local map spill file created earlier.
org.apache.hadoop.fs.Path	getSpillFileForWrite(int spillNumber, long size)	Create a local map spill file name.
org.apache.hadoop.fs.Path	getSpillIndexFile(int spillNumber)	Return a local map spill index file created earlier
org.apache.hadoop.fs.Path	getSpillIndexFileForWrite(int spillNumber, long size)	Create a local map spill index file name.
void	removeAll()	Removes all of the files related to a task.

Method Detail

getOutputFile

org.apache.hadoop.fs.Path getOutputFile()
                                 throws java.io.IOException

Return the path to local map output file created earlier

Throws:

java.io.IOException

getOutputFileForWrite

org.apache.hadoop.fs.Path getOutputFileForWrite(long size)
                                         throws java.io.IOException

Create a local map output file name.

Parameters:

size - the size of the file

Throws:

java.io.IOException

getOutputIndexFile

org.apache.hadoop.fs.Path getOutputIndexFile()
                                      throws java.io.IOException

Return the path to a local map output index file created earlier

Throws:

java.io.IOException

getOutputIndexFileForWrite

org.apache.hadoop.fs.Path getOutputIndexFileForWrite(long size)
                                              throws java.io.IOException

Create a local map output index file name.

Parameters:

size - the size of the file

Throws:

java.io.IOException

getSpillFile

org.apache.hadoop.fs.Path getSpillFile(int spillNumber)
                                throws java.io.IOException

Return a local map spill file created earlier.

Parameters:

spillNumber - the number

Throws:

java.io.IOException

getSpillFileForWrite

org.apache.hadoop.fs.Path getSpillFileForWrite(int spillNumber,
                                               long size)
                                        throws java.io.IOException

Create a local map spill file name.

Parameters:

spillNumber - the number

size - the size of the file

Throws:

java.io.IOException

getSpillIndexFile

org.apache.hadoop.fs.Path getSpillIndexFile(int spillNumber)
                                     throws java.io.IOException

Return a local map spill index file created earlier

Parameters:

spillNumber - the number

Throws:

java.io.IOException

getSpillIndexFileForWrite

org.apache.hadoop.fs.Path getSpillIndexFileForWrite(int spillNumber,
                                                    long size)
                                             throws java.io.IOException

Create a local map spill index file name. r* @param spillNumber the number

Parameters:

size - the size of the file

Throws:

java.io.IOException

getInputFile

org.apache.hadoop.fs.Path getInputFile(int mapId)
                                throws java.io.IOException

Return a local reduce input file created earlier

Parameters:

mapId - a map task id

Throws:

java.io.IOException

getInputFileForWrite

org.apache.hadoop.fs.Path getInputFileForWrite(org.apache.hadoop.mapred.TaskID mapId,
                                               long size,
                                               org.apache.hadoop.conf.Configuration conf)
                                        throws java.io.IOException

Create a local reduce input file name.

Parameters:

mapId - a map task id

size - the size of the file

Throws:

java.io.IOException

removeAll

void removeAll()
        throws java.io.IOException

Removes all of the files related to a task.

Throws:

java.io.IOException

getOutputName

java.lang.String getOutputName(int partition)