public abstract class DataJoinReducerBase extends JobBase
Modifier and Type | Field and Description |
---|---|
protected long |
collected |
protected org.apache.hadoop.mapred.JobConf |
job |
protected long |
largestNumOfValues |
static org.apache.hadoop.io.Text |
NUM_OF_VALUES_FIELD |
protected long |
numOfValues |
protected org.apache.hadoop.mapred.Reporter |
reporter |
static org.apache.hadoop.io.Text |
SOURCE_TAGS_FIELD |
Constructor and Description |
---|
DataJoinReducerBase() |
Modifier and Type | Method and Description |
---|---|
void |
close() |
protected void |
collect(Object key,
TaggedMapOutput aRecord,
org.apache.hadoop.mapred.OutputCollector output,
org.apache.hadoop.mapred.Reporter reporter)
The subclass can overwrite this method to perform additional filtering
and/or other processing logic before a value is collected.
|
protected abstract TaggedMapOutput |
combine(Object[] tags,
Object[] values) |
void |
configure(org.apache.hadoop.mapred.JobConf job)
Initializes a new instance from a
JobConf . |
protected ResetableIterator |
createResetableIterator()
The subclass can provide a different implementation on ResetableIterator.
|
void |
map(Object arg0,
Object arg1,
org.apache.hadoop.mapred.OutputCollector arg2,
org.apache.hadoop.mapred.Reporter arg3) |
void |
reduce(Object key,
Iterator values,
org.apache.hadoop.mapred.OutputCollector output,
org.apache.hadoop.mapred.Reporter reporter) |
addDoubleValue, addLongValue, getDoubleValue, getLongValue, getReport, report, setDoubleValue, setLongValue
protected org.apache.hadoop.mapred.Reporter reporter
protected long largestNumOfValues
protected long numOfValues
protected long collected
protected org.apache.hadoop.mapred.JobConf job
public static org.apache.hadoop.io.Text SOURCE_TAGS_FIELD
public static org.apache.hadoop.io.Text NUM_OF_VALUES_FIELD
public void close() throws IOException
IOException
public void configure(org.apache.hadoop.mapred.JobConf job)
JobBase
JobConf
.protected ResetableIterator createResetableIterator()
public void reduce(Object key, Iterator values, org.apache.hadoop.mapred.OutputCollector output, org.apache.hadoop.mapred.Reporter reporter) throws IOException
IOException
protected void collect(Object key, TaggedMapOutput aRecord, org.apache.hadoop.mapred.OutputCollector output, org.apache.hadoop.mapred.Reporter reporter) throws IOException
key
- aRecord
- output
- reporter
- IOException
protected abstract TaggedMapOutput combine(Object[] tags, Object[] values)
tags
- a list of source tagsvalues
- a value per sourcepublic void map(Object arg0, Object arg1, org.apache.hadoop.mapred.OutputCollector arg2, org.apache.hadoop.mapred.Reporter arg3) throws IOException
IOException
Copyright © 2015 Apache Software Foundation. All Rights Reserved.