org.apache.hadoop.examples.terasort
Class TeraOutputFormatWithCRC

java.lang.Object
  org.apache.hadoop.mapred.FileOutputFormat<K,V>
      org.apache.hadoop.mapred.TextOutputFormat<org.apache.hadoop.io.Text,org.apache.hadoop.io.Text>
          org.apache.hadoop.examples.terasort.TeraOutputFormatWithCRC

All Implemented Interfaces:

org.apache.hadoop.mapred.OutputFormat<org.apache.hadoop.io.Text,org.apache.hadoop.io.Text>

public class TeraOutputFormatWithCRC
extends org.apache.hadoop.mapred.TextOutputFormat<org.apache.hadoop.io.Text,org.apache.hadoop.io.Text>

A streamlined text output format that writes key, value, and "\r\n".

Nested Class Summary

Nested classes/interfaces inherited from class org.apache.hadoop.mapred.TextOutputFormat

org.apache.hadoop.mapred.TextOutputFormat.LineRecordWriter<K,V>

Nested classes/interfaces inherited from class org.apache.hadoop.mapred.FileOutputFormat

org.apache.hadoop.mapred.FileOutputFormat.Counter

Constructor Summary

TeraOutputFormatWithCRC()

Method Summary

static boolean	getFinalSync(org.apache.hadoop.mapred.JobConf conf) Does the user want a final sync at close?
org.apache.hadoop.mapred.RecordWriter<org.apache.hadoop.io.Text,org.apache.hadoop.io.Text>	getRecordWriter(org.apache.hadoop.fs.FileSystem ignored, org.apache.hadoop.mapred.JobConf job, String name, org.apache.hadoop.util.Progressable progress)
static void	setFinalSync(org.apache.hadoop.mapred.JobConf conf, boolean newValue) Set the requirement for a final sync before the stream is closed.

Methods inherited from class org.apache.hadoop.mapred.FileOutputFormat

checkOutputSpecs, getCompressOutput, getOutputCompressorClass, getOutputPath, getPathForCustomFile, getTaskOutputPath, getUniqueName, getWorkOutputPath, setCompressOutput, setOutputCompressorClass, setOutputPath, setWorkOutputPath

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

TeraOutputFormatWithCRC

public TeraOutputFormatWithCRC()

Method Detail

setFinalSync

public static void setFinalSync(org.apache.hadoop.mapred.JobConf conf,
                                boolean newValue)

Set the requirement for a final sync before the stream is closed.

getFinalSync

public static boolean getFinalSync(org.apache.hadoop.mapred.JobConf conf)

Does the user want a final sync at close?

getRecordWriter

public org.apache.hadoop.mapred.RecordWriter<org.apache.hadoop.io.Text,org.apache.hadoop.io.Text> getRecordWriter(org.apache.hadoop.fs.FileSystem ignored,
                                                                                                                  org.apache.hadoop.mapred.JobConf job,
                                                                                                                  String name,
                                                                                                                  org.apache.hadoop.util.Progressable progress)
                                                                                                           throws IOException

Specified by:

getRecordWriter in interface org.apache.hadoop.mapred.OutputFormat<org.apache.hadoop.io.Text,org.apache.hadoop.io.Text>

Overrides:

getRecordWriter in class org.apache.hadoop.mapred.TextOutputFormat<org.apache.hadoop.io.Text,org.apache.hadoop.io.Text>

Throws:

IOException