Package org.apache.hadoop.examples

Class AggregateWordHistogram.AggregateWordHistogramPlugin

java.lang.Object

org.apache.hadoop.mapreduce.lib.aggregate.ValueAggregatorBaseDescriptor

org.apache.hadoop.examples.AggregateWordHistogram.AggregateWordHistogramPlugin

All Implemented Interfaces:

org.apache.hadoop.mapreduce.lib.aggregate.ValueAggregatorDescriptor

Enclosing class:

AggregateWordHistogram

public static class AggregateWordHistogram.AggregateWordHistogramPlugin
extends org.apache.hadoop.mapreduce.lib.aggregate.ValueAggregatorBaseDescriptor

Field Summary

Fields inherited from class org.apache.hadoop.mapreduce.lib.aggregate.ValueAggregatorBaseDescriptor

DOUBLE_VALUE_SUM, inputFile, LONG_VALUE_MAX, LONG_VALUE_MIN, LONG_VALUE_SUM, STRING_VALUE_MAX, STRING_VALUE_MIN, UNIQ_VALUE_COUNT, VALUE_HISTOGRAM

Fields inherited from interface org.apache.hadoop.mapreduce.lib.aggregate.ValueAggregatorDescriptor

ONE, TYPE_SEPARATOR

Constructor Summary

Constructors

Constructor	Description
AggregateWordHistogramPlugin()

Method Summary

Modifier and Type	Method	Description
java.util.ArrayList<java.util.Map.Entry<org.apache.hadoop.io.Text,org.apache.hadoop.io.Text>>	generateKeyValPairs(java.lang.Object key, java.lang.Object val)	Parse the given value, generate an aggregation-id/value pair per word.

Methods inherited from class org.apache.hadoop.mapreduce.lib.aggregate.ValueAggregatorBaseDescriptor

configure, generateEntry, generateValueAggregator

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

AggregateWordHistogramPlugin

public AggregateWordHistogramPlugin()

Method Detail

generateKeyValPairs

public java.util.ArrayList<java.util.Map.Entry<org.apache.hadoop.io.Text,org.apache.hadoop.io.Text>> generateKeyValPairs(java.lang.Object key,
                                                                                                                               java.lang.Object val)

Parse the given value, generate an aggregation-id/value pair per word. The ID is of type VALUE_HISTOGRAM, with WORD_HISTOGRAM as the real id. The value is WORD\t1.

Specified by:

generateKeyValPairs in interface org.apache.hadoop.mapreduce.lib.aggregate.ValueAggregatorDescriptor

Overrides:

generateKeyValPairs in class org.apache.hadoop.mapreduce.lib.aggregate.ValueAggregatorBaseDescriptor

Returns:

a list of the generated pairs.