Package org.apache.hadoop.tools.dynamometer.blockgenerator

Class GenerateBlockImagesDriver

java.lang.Object

org.apache.hadoop.conf.Configured

org.apache.hadoop.tools.dynamometer.blockgenerator.GenerateBlockImagesDriver

All Implemented Interfaces:

org.apache.hadoop.conf.Configurable, org.apache.hadoop.util.Tool

public class GenerateBlockImagesDriver
extends org.apache.hadoop.conf.Configured
implements org.apache.hadoop.util.Tool

This is the main driver class. It takes in the following arguments: - Required: input path of the fsImage from the HDFS cluster to be simulated - Required: output path for generated block image files for each Dynamometer DataNode - Required: Number of DataNodes to generate blocks for - Optional: Number of reducers to use for the job (defaults to number of DataNodes)

Nested Class Summary

Nested Classes

Modifier and Type	Class	Description
static class	GenerateBlockImagesDriver.NoSplitTextInputFormat	A simple text input format that doesn't allow splitting of files.

Field Summary

Fields

Modifier and Type	Field	Description
static java.lang.String	BLOCK_IMAGE_OUTPUT_ARG
static java.lang.String	FSIMAGE_INPUT_PATH_ARG
static java.lang.String	NUM_DATANODES_ARG
static java.lang.String	NUM_DATANODES_KEY
static java.lang.String	NUM_REDUCERS_ARG

Constructor Summary

Constructors

Constructor	Description
GenerateBlockImagesDriver(org.apache.hadoop.conf.Configuration conf)

Method Summary

Modifier and Type	Method	Description
static void	main(java.lang.String[] args)
int	run(java.lang.String[] args)

Methods inherited from class org.apache.hadoop.conf.Configured

getConf, setConf

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface org.apache.hadoop.conf.Configurable

getConf, setConf

Field Detail

FSIMAGE_INPUT_PATH_ARG

public static final java.lang.String FSIMAGE_INPUT_PATH_ARG

See Also:

Constant Field Values

BLOCK_IMAGE_OUTPUT_ARG

public static final java.lang.String BLOCK_IMAGE_OUTPUT_ARG

See Also:

Constant Field Values

NUM_REDUCERS_ARG

public static final java.lang.String NUM_REDUCERS_ARG

See Also:

Constant Field Values

NUM_DATANODES_ARG

public static final java.lang.String NUM_DATANODES_ARG

See Also:

Constant Field Values

NUM_DATANODES_KEY

public static final java.lang.String NUM_DATANODES_KEY

See Also:

Constant Field Values

Constructor Detail

GenerateBlockImagesDriver

public GenerateBlockImagesDriver(org.apache.hadoop.conf.Configuration conf)

Method Detail

run

public int run(java.lang.String[] args)
        throws java.lang.Exception

Specified by:

run in interface org.apache.hadoop.util.Tool

Throws:

java.lang.Exception

main

public static void main(java.lang.String[] args)
                 throws java.lang.Exception

Throws:

java.lang.Exception