org.apache.hadoop.examples.terasort

Class TeraOutputFormatWithCRC

java.lang.Object

org.apache.hadoop.mapreduce.OutputFormat<K,V>

org.apache.hadoop.mapreduce.lib.output.FileOutputFormat<K,V>

org.apache.hadoop.mapreduce.lib.output.TextOutputFormat<org.apache.hadoop.io.Text,org.apache.hadoop.io.Text>

org.apache.hadoop.examples.terasort.TeraOutputFormatWithCRC

public class TeraOutputFormatWithCRC
extends org.apache.hadoop.mapreduce.lib.output.TextOutputFormat<org.apache.hadoop.io.Text,org.apache.hadoop.io.Text>

A streamlined text output format that writes key, value, and "\r\n".

Nested Class Summary

Nested classes/interfaces inherited from class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat

org.apache.hadoop.mapreduce.lib.output.TextOutputFormat.LineRecordWriter<K,V>

Nested classes/interfaces inherited from class org.apache.hadoop.mapreduce.lib.output.FileOutputFormat

org.apache.hadoop.mapreduce.lib.output.FileOutputFormat.Counter

Field Summary

Fields inherited from class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat

SEPERATOR

Fields inherited from class org.apache.hadoop.mapreduce.lib.output.FileOutputFormat

BASE_OUTPUT_NAME, COMPRESS, COMPRESS_CODEC, COMPRESS_TYPE, OUTDIR, PART

Constructor Summary

Constructors

Constructor and Description
TeraOutputFormatWithCRC()

Method Summary

Methods

Modifier and Type	Method and Description
static boolean	getFinalSync(org.apache.hadoop.mapreduce.JobContext conf) Does the user want a final sync at close?
org.apache.hadoop.mapreduce.RecordWriter<org.apache.hadoop.io.Text,org.apache.hadoop.io.Text>	getRecordWriter(org.apache.hadoop.mapreduce.TaskAttemptContext job)
static void	setFinalSync(org.apache.hadoop.mapreduce.JobContext conf, boolean newValue) Set the requirement for a final sync before the stream is closed.

Methods inherited from class org.apache.hadoop.mapreduce.lib.output.FileOutputFormat

checkOutputSpecs, getCompressOutput, getDefaultWorkFile, getOutputCommitter, getOutputCompressorClass, getOutputName, getOutputPath, getPathForWorkFile, getUniqueFile, getWorkOutputPath, setCompressOutput, setOutputCompressorClass, setOutputName, setOutputPath

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

TeraOutputFormatWithCRC

public TeraOutputFormatWithCRC()

Method Detail

setFinalSync

public static void setFinalSync(org.apache.hadoop.mapreduce.JobContext conf,
                boolean newValue)

Set the requirement for a final sync before the stream is closed.

getFinalSync

public static boolean getFinalSync(org.apache.hadoop.mapreduce.JobContext conf)

Does the user want a final sync at close?

getRecordWriter

public org.apache.hadoop.mapreduce.RecordWriter<org.apache.hadoop.io.Text,org.apache.hadoop.io.Text> getRecordWriter(org.apache.hadoop.mapreduce.TaskAttemptContext job)
                                                                                                              throws IOException

Overrides:

getRecordWriter in class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat<org.apache.hadoop.io.Text,org.apache.hadoop.io.Text>

Throws:

IOException