Package org.apache.hadoop.tools.dynamometer.blockgenerator

Class GenerateDNBlockInfosReducer

java.lang.Object

org.apache.hadoop.mapreduce.Reducer<org.apache.hadoop.io.IntWritable,BlockInfo,org.apache.hadoop.io.NullWritable,org.apache.hadoop.io.Text>

org.apache.hadoop.tools.dynamometer.blockgenerator.GenerateDNBlockInfosReducer

public class GenerateDNBlockInfosReducer
extends org.apache.hadoop.mapreduce.Reducer<org.apache.hadoop.io.IntWritable,BlockInfo,org.apache.hadoop.io.NullWritable,org.apache.hadoop.io.Text>

This Reducer class generates a simple text file for each DN, listing the blocks to be generated. Input: BlockInfo's from XMLParserMapper Output: A text file named as dni-XXX, where i is the ID of the DN and XXX is a reducer ID. Each line in the file is in format: blockID,blockGenStamp,blockSize

Nested Class Summary

Nested classes/interfaces inherited from class org.apache.hadoop.mapreduce.Reducer

org.apache.hadoop.mapreduce.Reducer.Context

Constructor Summary

Constructors

Constructor	Description
GenerateDNBlockInfosReducer()

Method Summary

Modifier and Type	Method	Description
void	cleanup(org.apache.hadoop.mapreduce.Reducer.Context context)
void	reduce(org.apache.hadoop.io.IntWritable key, java.lang.Iterable<BlockInfo> values, org.apache.hadoop.mapreduce.Reducer.Context context)
void	setup(org.apache.hadoop.mapreduce.Reducer.Context context)

Methods inherited from class org.apache.hadoop.mapreduce.Reducer

run

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

GenerateDNBlockInfosReducer

public GenerateDNBlockInfosReducer()

Method Detail

setup

public void setup(org.apache.hadoop.mapreduce.Reducer.Context context)

Overrides:

setup in class org.apache.hadoop.mapreduce.Reducer<org.apache.hadoop.io.IntWritable,BlockInfo,org.apache.hadoop.io.NullWritable,org.apache.hadoop.io.Text>

cleanup

public void cleanup(org.apache.hadoop.mapreduce.Reducer.Context context)
             throws java.io.IOException,
                    java.lang.InterruptedException

Overrides:

cleanup in class org.apache.hadoop.mapreduce.Reducer<org.apache.hadoop.io.IntWritable,BlockInfo,org.apache.hadoop.io.NullWritable,org.apache.hadoop.io.Text>

Throws:

java.io.IOException

java.lang.InterruptedException

reduce

public void reduce(org.apache.hadoop.io.IntWritable key,
                   java.lang.Iterable<BlockInfo> values,
                   org.apache.hadoop.mapreduce.Reducer.Context context)
            throws java.io.IOException,
                   java.lang.InterruptedException

Overrides:

reduce in class org.apache.hadoop.mapreduce.Reducer<org.apache.hadoop.io.IntWritable,BlockInfo,org.apache.hadoop.io.NullWritable,org.apache.hadoop.io.Text>

Throws:

java.io.IOException

java.lang.InterruptedException