Package org.apache.hadoop.tools.dynamometer.blockgenerator

Class XMLParserMapper

java.lang.Object

org.apache.hadoop.mapreduce.Mapper<org.apache.hadoop.io.LongWritable,org.apache.hadoop.io.Text,org.apache.hadoop.io.IntWritable,BlockInfo>

org.apache.hadoop.tools.dynamometer.blockgenerator.XMLParserMapper

public class XMLParserMapper
extends org.apache.hadoop.mapreduce.Mapper<org.apache.hadoop.io.LongWritable,org.apache.hadoop.io.Text,org.apache.hadoop.io.IntWritable,BlockInfo>

This Mapper class generates a list of BlockInfo's from a given fsimage. Input: fsimage in XML format. It should be generated using org.apache.hadoop.hdfs.tools.offlineImageViewer.OfflineImageViewer. Output: list of all BlockInfo's

Nested Class Summary

Nested classes/interfaces inherited from class org.apache.hadoop.mapreduce.Mapper

org.apache.hadoop.mapreduce.Mapper.Context

Constructor Summary

Constructors

Constructor	Description
XMLParserMapper()

Method Summary

Modifier and Type	Method	Description
void	map(org.apache.hadoop.io.LongWritable lineNum, org.apache.hadoop.io.Text line, org.apache.hadoop.mapreduce.Mapper.Context context)	Read the input XML file line by line, and generate list of blocks.
void	setup(org.apache.hadoop.mapreduce.Mapper.Context context)

Methods inherited from class org.apache.hadoop.mapreduce.Mapper

cleanup, run

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

XMLParserMapper

public XMLParserMapper()

Method Detail

setup

public void setup(org.apache.hadoop.mapreduce.Mapper.Context context)

Overrides:

setup in class org.apache.hadoop.mapreduce.Mapper<org.apache.hadoop.io.LongWritable,org.apache.hadoop.io.Text,org.apache.hadoop.io.IntWritable,BlockInfo>

map

public void map(org.apache.hadoop.io.LongWritable lineNum,
                org.apache.hadoop.io.Text line,
                org.apache.hadoop.mapreduce.Mapper.Context context)
         throws java.io.IOException,
                java.lang.InterruptedException

Read the input XML file line by line, and generate list of blocks. The actual parsing logic is handled by XMLParser. This mapper just delegates to that class and then writes the blocks to the corresponding index to be processed by reducers.

Overrides:

map in class org.apache.hadoop.mapreduce.Mapper<org.apache.hadoop.io.LongWritable,org.apache.hadoop.io.Text,org.apache.hadoop.io.IntWritable,BlockInfo>

Throws:

java.io.IOException

java.lang.InterruptedException