Package org.apache.hadoop.streaming

Class StreamInputFormat

java.lang.Object

org.apache.hadoop.mapred.FileInputFormat<org.apache.hadoop.io.Text,org.apache.hadoop.io.Text>

org.apache.hadoop.mapred.KeyValueTextInputFormat

org.apache.hadoop.streaming.StreamInputFormat

All Implemented Interfaces:

org.apache.hadoop.mapred.InputFormat<org.apache.hadoop.io.Text,org.apache.hadoop.io.Text>, org.apache.hadoop.mapred.JobConfigurable

public class StreamInputFormat
extends org.apache.hadoop.mapred.KeyValueTextInputFormat

An input format that selects a RecordReader based on a JobConf property. This should be used only for non-standard record reader such as StreamXmlRecordReader. For all other standard record readers, the appropriate input format classes should be used.

Nested Class Summary

Nested classes/interfaces inherited from class org.apache.hadoop.mapred.FileInputFormat

org.apache.hadoop.mapred.FileInputFormat.Counter

Field Summary

Fields inherited from class org.apache.hadoop.mapred.FileInputFormat

INPUT_DIR_NONRECURSIVE_IGNORE_SUBDIRS, INPUT_DIR_RECURSIVE, LOG, NUM_INPUT_FILES

Constructor Summary

Constructors

Constructor	Description
StreamInputFormat()

Method Summary

Modifier and Type	Method	Description
org.apache.hadoop.mapred.RecordReader<org.apache.hadoop.io.Text,org.apache.hadoop.io.Text>	getRecordReader(org.apache.hadoop.mapred.InputSplit genericSplit, org.apache.hadoop.mapred.JobConf job, org.apache.hadoop.mapred.Reporter reporter)

Methods inherited from class org.apache.hadoop.mapred.KeyValueTextInputFormat

configure, isSplitable

Methods inherited from class org.apache.hadoop.mapred.FileInputFormat

addInputPath, addInputPathRecursively, addInputPaths, computeSplitSize, getBlockIndex, getInputPathFilter, getInputPaths, getSplitHosts, getSplits, listStatus, makeSplit, makeSplit, setInputPathFilter, setInputPaths, setInputPaths, setMinSplitSize

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

StreamInputFormat

public StreamInputFormat()

Method Detail

getRecordReader

public org.apache.hadoop.mapred.RecordReader<org.apache.hadoop.io.Text,org.apache.hadoop.io.Text> getRecordReader(org.apache.hadoop.mapred.InputSplit genericSplit,
                                                                                                                        org.apache.hadoop.mapred.JobConf job,
                                                                                                                        org.apache.hadoop.mapred.Reporter reporter)
                                                                                                                 throws java.io.IOException

Specified by:

getRecordReader in interface org.apache.hadoop.mapred.InputFormat<org.apache.hadoop.io.Text,org.apache.hadoop.io.Text>

Overrides:

getRecordReader in class org.apache.hadoop.mapred.KeyValueTextInputFormat

Throws:

java.io.IOException