public static class MultiFileWordCount.MyInputFormat extends org.apache.hadoop.mapreduce.lib.input.CombineFileInputFormat<MultiFileWordCount.WordOffset,org.apache.hadoop.io.Text>
CombineFileInputFormat
, one should extend it, to return a
(custom) RecordReader
. CombineFileInputFormat uses
CombineFileSplit
s.Constructor and Description |
---|
MultiFileWordCount.MyInputFormat() |
Modifier and Type | Method and Description |
---|---|
org.apache.hadoop.mapreduce.RecordReader<MultiFileWordCount.WordOffset,org.apache.hadoop.io.Text> |
createRecordReader(org.apache.hadoop.mapreduce.InputSplit split,
org.apache.hadoop.mapreduce.TaskAttemptContext context) |
createPool, createPool, getFileBlockLocations, getSplits, isSplitable, setMaxSplitSize, setMinSplitSizeNode, setMinSplitSizeRack
addInputPath, addInputPathRecursively, addInputPaths, computeSplitSize, getBlockIndex, getFormatMinSplitSize, getInputDirRecursive, getInputPathFilter, getInputPaths, getMaxSplitSize, getMinSplitSize, listStatus, makeSplit, makeSplit, setInputDirRecursive, setInputPathFilter, setInputPaths, setInputPaths, setMaxInputSplitSize, setMinInputSplitSize
public org.apache.hadoop.mapreduce.RecordReader<MultiFileWordCount.WordOffset,org.apache.hadoop.io.Text> createRecordReader(org.apache.hadoop.mapreduce.InputSplit split, org.apache.hadoop.mapreduce.TaskAttemptContext context) throws IOException
createRecordReader
in class org.apache.hadoop.mapreduce.lib.input.CombineFileInputFormat<MultiFileWordCount.WordOffset,org.apache.hadoop.io.Text>
IOException
Copyright © 2017 Apache Software Foundation. All Rights Reserved.