A C D E F G H I L M N O P R S T U V W
All Classes All Packages

A

APPEND - org.apache.hadoop.tools.dynamometer.workloadgenerator.audit.AuditReplayMapper.ReplayCommand

AUDIT_LOG_DATE_FORMAT_DEFAULT - Static variable in class org.apache.hadoop.tools.dynamometer.workloadgenerator.audit.AuditLogDirectParser

AUDIT_LOG_DATE_FORMAT_KEY - Static variable in class org.apache.hadoop.tools.dynamometer.workloadgenerator.audit.AuditLogDirectParser

The format string used to parse the date which is present in the audit log.

AUDIT_LOG_DATE_TIME_ZONE_DEFAULT - Static variable in class org.apache.hadoop.tools.dynamometer.workloadgenerator.audit.AuditLogDirectParser

AUDIT_LOG_DATE_TIME_ZONE_KEY - Static variable in class org.apache.hadoop.tools.dynamometer.workloadgenerator.audit.AuditLogDirectParser

The time zone to use when parsing the audit log timestamp.

AUDIT_LOG_PARSE_REGEX_DEFAULT - Static variable in class org.apache.hadoop.tools.dynamometer.workloadgenerator.audit.AuditLogDirectParser

AUDIT_LOG_PARSE_REGEX_KEY - Static variable in class org.apache.hadoop.tools.dynamometer.workloadgenerator.audit.AuditLogDirectParser

The regex to use when parsing the audit log lines.

AUDIT_START_TIMESTAMP_KEY - Static variable in class org.apache.hadoop.tools.dynamometer.workloadgenerator.audit.AuditLogDirectParser

See class Javadoc for more detail.

AuditCommandParser - Interface in org.apache.hadoop.tools.dynamometer.workloadgenerator.audit

This interface represents a pluggable command parser.

AuditLogDirectParser - Class in org.apache.hadoop.tools.dynamometer.workloadgenerator.audit

This AuditCommandParser is used to read commands from an audit log in the original format audit logs are produced in with a standard configuration.

AuditLogDirectParser() - Constructor for class org.apache.hadoop.tools.dynamometer.workloadgenerator.audit.AuditLogDirectParser

AuditLogHiveTableParser - Class in org.apache.hadoop.tools.dynamometer.workloadgenerator.audit

This AuditCommandParser is used to read commands assuming that the input was generated by a Hive query storing uncompressed output files, in which fields should be separated by the start-of-heading (U+0001) character.

AuditLogHiveTableParser() - Constructor for class org.apache.hadoop.tools.dynamometer.workloadgenerator.audit.AuditLogHiveTableParser

AuditReplayMapper - Class in org.apache.hadoop.tools.dynamometer.workloadgenerator.audit

AuditReplayMapper replays the given audit trace against the NameNode under test.

AuditReplayMapper() - Constructor for class org.apache.hadoop.tools.dynamometer.workloadgenerator.audit.AuditReplayMapper

AuditReplayMapper.CommandType - Enum in org.apache.hadoop.tools.dynamometer.workloadgenerator.audit

Define the type of command, either read or write.

AuditReplayMapper.ReplayCommand - Enum in org.apache.hadoop.tools.dynamometer.workloadgenerator.audit

Definitions of the various commands that can be replayed.

AuditReplayMapper.REPLAYCOUNTERS - Enum in org.apache.hadoop.tools.dynamometer.workloadgenerator.audit

Counter definitions for replay.

AuditReplayReducer - Class in org.apache.hadoop.tools.dynamometer.workloadgenerator.audit

AuditReplayReducer aggregates the returned latency values from AuditReplayMapper and sums them up by UserCommandKey, which combines the user's id that ran the command and the type of the command (READ/WRITE).

AuditReplayReducer() - Constructor for class org.apache.hadoop.tools.dynamometer.workloadgenerator.audit.AuditReplayReducer

AuditReplayThread - Class in org.apache.hadoop.tools.dynamometer.workloadgenerator.audit

This class replays each audit log entry at a specified timestamp in the future.

C

cleanup(Mapper.Context) - Method in class org.apache.hadoop.tools.dynamometer.workloadgenerator.audit.AuditReplayMapper

close() - Method in class org.apache.hadoop.tools.dynamometer.workloadgenerator.VirtualRecordReader

COMMAND_PARSER_DEFAULT - Static variable in class org.apache.hadoop.tools.dynamometer.workloadgenerator.audit.AuditReplayMapper

COMMAND_PARSER_KEY - Static variable in class org.apache.hadoop.tools.dynamometer.workloadgenerator.audit.AuditReplayMapper

compareTo(Object) - Method in class org.apache.hadoop.tools.dynamometer.workloadgenerator.audit.UserCommandKey

CONCAT - org.apache.hadoop.tools.dynamometer.workloadgenerator.audit.AuditReplayMapper.ReplayCommand

configureJob(Job) - Method in class org.apache.hadoop.tools.dynamometer.workloadgenerator.audit.AuditReplayMapper

configureJob(Job) - Method in class org.apache.hadoop.tools.dynamometer.workloadgenerator.WorkloadMapper

Setup input and output formats and optional reducer.

CONTENTSUMMARY - org.apache.hadoop.tools.dynamometer.workloadgenerator.audit.AuditReplayMapper.ReplayCommand

CountTimeWritable - Class in org.apache.hadoop.tools.dynamometer.workloadgenerator.audit

UserCommandKey is a Writable used as a composite value that accumulates the count and cumulative latency of replayed commands.

CountTimeWritable() - Constructor for class org.apache.hadoop.tools.dynamometer.workloadgenerator.audit.CountTimeWritable

CountTimeWritable(long, long) - Constructor for class org.apache.hadoop.tools.dynamometer.workloadgenerator.audit.CountTimeWritable

CountTimeWritable(LongWritable, LongWritable) - Constructor for class org.apache.hadoop.tools.dynamometer.workloadgenerator.audit.CountTimeWritable

CREATE - org.apache.hadoop.tools.dynamometer.workloadgenerator.audit.AuditReplayMapper.ReplayCommand

CREATE_BLOCKS_DEFAULT - Static variable in class org.apache.hadoop.tools.dynamometer.workloadgenerator.audit.AuditReplayMapper

CREATE_BLOCKS_KEY - Static variable in class org.apache.hadoop.tools.dynamometer.workloadgenerator.audit.AuditReplayMapper

CreateFileMapper - Class in org.apache.hadoop.tools.dynamometer.workloadgenerator

CreateFileMapper continuously creates 1 byte files for the specified duration to increase the number of file objects on the NN.

CreateFileMapper() - Constructor for class org.apache.hadoop.tools.dynamometer.workloadgenerator.CreateFileMapper

CreateFileMapper.CREATEFILECOUNTERS - Enum in org.apache.hadoop.tools.dynamometer.workloadgenerator

Custom Counter definitions.

createRecordReader(InputSplit, TaskAttemptContext) - Method in class org.apache.hadoop.tools.dynamometer.workloadgenerator.VirtualInputFormat

D

DELETE - org.apache.hadoop.tools.dynamometer.workloadgenerator.audit.AuditReplayMapper.ReplayCommand

DURATION_MIN_KEY - Static variable in class org.apache.hadoop.tools.dynamometer.workloadgenerator.CreateFileMapper

E

equals(Object) - Method in class org.apache.hadoop.tools.dynamometer.workloadgenerator.audit.UserCommandKey

F

FILE_PARENT_PATH_DEFAULT - Static variable in class org.apache.hadoop.tools.dynamometer.workloadgenerator.CreateFileMapper

FILE_PARENT_PATH_KEY - Static variable in class org.apache.hadoop.tools.dynamometer.workloadgenerator.CreateFileMapper

G

getCommand() - Method in class org.apache.hadoop.tools.dynamometer.workloadgenerator.audit.UserCommandKey

getConfigDescriptions() - Method in class org.apache.hadoop.tools.dynamometer.workloadgenerator.audit.AuditReplayMapper

getConfigDescriptions() - Method in class org.apache.hadoop.tools.dynamometer.workloadgenerator.CreateFileMapper

getConfigDescriptions() - Method in class org.apache.hadoop.tools.dynamometer.workloadgenerator.WorkloadMapper

Get a list of the description of each configuration that this mapper accepts.

getCount() - Method in class org.apache.hadoop.tools.dynamometer.workloadgenerator.audit.CountTimeWritable

getCurrentKey() - Method in class org.apache.hadoop.tools.dynamometer.workloadgenerator.VirtualRecordReader

getCurrentValue() - Method in class org.apache.hadoop.tools.dynamometer.workloadgenerator.VirtualRecordReader

getDescription() - Method in class org.apache.hadoop.tools.dynamometer.workloadgenerator.audit.AuditReplayMapper

getDescription() - Method in class org.apache.hadoop.tools.dynamometer.workloadgenerator.CreateFileMapper

getDescription() - Method in class org.apache.hadoop.tools.dynamometer.workloadgenerator.WorkloadMapper

Get the description of the behavior of this mapper.

GETFILEINFO - org.apache.hadoop.tools.dynamometer.workloadgenerator.audit.AuditReplayMapper.ReplayCommand

getJobForSubmission(Configuration, String, long, Class<? extends WorkloadMapper<?, ?, ?, ?>>) - Static method in class org.apache.hadoop.tools.dynamometer.workloadgenerator.WorkloadDriver

getLength() - Method in class org.apache.hadoop.tools.dynamometer.workloadgenerator.VirtualInputSplit

getLocations() - Method in class org.apache.hadoop.tools.dynamometer.workloadgenerator.VirtualInputSplit

getProgress() - Method in class org.apache.hadoop.tools.dynamometer.workloadgenerator.VirtualRecordReader

getSplits(JobContext) - Method in class org.apache.hadoop.tools.dynamometer.workloadgenerator.VirtualInputFormat

getTime() - Method in class org.apache.hadoop.tools.dynamometer.workloadgenerator.audit.CountTimeWritable

getType() - Method in enum org.apache.hadoop.tools.dynamometer.workloadgenerator.audit.AuditReplayMapper.ReplayCommand

getType() - Method in class org.apache.hadoop.tools.dynamometer.workloadgenerator.audit.UserCommandKey

getUser() - Method in class org.apache.hadoop.tools.dynamometer.workloadgenerator.audit.UserCommandKey

H

hashCode() - Method in class org.apache.hadoop.tools.dynamometer.workloadgenerator.audit.UserCommandKey

I

INDIVIDUAL_COMMANDS_COUNT_SUFFIX - Static variable in class org.apache.hadoop.tools.dynamometer.workloadgenerator.audit.AuditReplayMapper

INDIVIDUAL_COMMANDS_COUNTER_GROUP - Static variable in class org.apache.hadoop.tools.dynamometer.workloadgenerator.audit.AuditReplayMapper

INDIVIDUAL_COMMANDS_INVALID_SUFFIX - Static variable in class org.apache.hadoop.tools.dynamometer.workloadgenerator.audit.AuditReplayMapper

INDIVIDUAL_COMMANDS_LATENCY_SUFFIX - Static variable in class org.apache.hadoop.tools.dynamometer.workloadgenerator.audit.AuditReplayMapper

initialize(Configuration) - Method in interface org.apache.hadoop.tools.dynamometer.workloadgenerator.audit.AuditCommandParser

Initialize this parser with the given configuration.

initialize(Configuration) - Method in class org.apache.hadoop.tools.dynamometer.workloadgenerator.audit.AuditLogDirectParser

initialize(Configuration) - Method in class org.apache.hadoop.tools.dynamometer.workloadgenerator.audit.AuditLogHiveTableParser

initialize(InputSplit, TaskAttemptContext) - Method in class org.apache.hadoop.tools.dynamometer.workloadgenerator.VirtualRecordReader

INPUT_PATH_KEY - Static variable in class org.apache.hadoop.tools.dynamometer.workloadgenerator.audit.AuditReplayMapper

isSplitable(JobContext, Path) - Method in class org.apache.hadoop.tools.dynamometer.workloadgenerator.audit.NoSplitTextInputFormat

L

LATECOMMANDS - org.apache.hadoop.tools.dynamometer.workloadgenerator.audit.AuditReplayMapper.REPLAYCOUNTERS

LATECOMMANDSTOTALTIME - org.apache.hadoop.tools.dynamometer.workloadgenerator.audit.AuditReplayMapper.REPLAYCOUNTERS

listStatus(JobContext) - Method in class org.apache.hadoop.tools.dynamometer.workloadgenerator.audit.NoSplitTextInputFormat

LISTSTATUS - org.apache.hadoop.tools.dynamometer.workloadgenerator.audit.AuditReplayMapper.ReplayCommand

M

main(String[]) - Static method in class org.apache.hadoop.tools.dynamometer.workloadgenerator.WorkloadDriver

map(LongWritable, Text, Mapper.Context) - Method in class org.apache.hadoop.tools.dynamometer.workloadgenerator.audit.AuditReplayMapper

map(NullWritable, NullWritable, Mapper.Context) - Method in class org.apache.hadoop.tools.dynamometer.workloadgenerator.CreateFileMapper

MAPPER_CLASS_NAME - Static variable in class org.apache.hadoop.tools.dynamometer.workloadgenerator.WorkloadDriver

MKDIRS - org.apache.hadoop.tools.dynamometer.workloadgenerator.audit.AuditReplayMapper.ReplayCommand

N

nextKeyValue() - Method in class org.apache.hadoop.tools.dynamometer.workloadgenerator.VirtualRecordReader

NN_URI - Static variable in class org.apache.hadoop.tools.dynamometer.workloadgenerator.WorkloadDriver

NoSplitTextInputFormat - Class in org.apache.hadoop.tools.dynamometer.workloadgenerator.audit

A simple TextInputFormat that disables splitting of files.

NoSplitTextInputFormat() - Constructor for class org.apache.hadoop.tools.dynamometer.workloadgenerator.audit.NoSplitTextInputFormat

NUM_MAPPERS_KEY - Static variable in class org.apache.hadoop.tools.dynamometer.workloadgenerator.CreateFileMapper

NUM_THREADS_DEFAULT - Static variable in class org.apache.hadoop.tools.dynamometer.workloadgenerator.audit.AuditReplayMapper

NUM_THREADS_KEY - Static variable in class org.apache.hadoop.tools.dynamometer.workloadgenerator.audit.AuditReplayMapper

NUMFILESCREATED - org.apache.hadoop.tools.dynamometer.workloadgenerator.CreateFileMapper.CREATEFILECOUNTERS

O

OPEN - org.apache.hadoop.tools.dynamometer.workloadgenerator.audit.AuditReplayMapper.ReplayCommand

org.apache.hadoop.tools.dynamometer.workloadgenerator - package org.apache.hadoop.tools.dynamometer.workloadgenerator

This contains the tooling necessary to generate a realistic workload, for example collected from audit logs, against a Dynamometer-simulated NameNode.

org.apache.hadoop.tools.dynamometer.workloadgenerator.audit - package org.apache.hadoop.tools.dynamometer.workloadgenerator.audit

This contains the tooling necessary to use audit logs as a way to generate a realistic workload against a Dynamometer-simulated NameNode.

OUTPUT_PATH_KEY - Static variable in class org.apache.hadoop.tools.dynamometer.workloadgenerator.audit.AuditReplayMapper

P

parse(Text, Function<Long, Long>) - Method in interface org.apache.hadoop.tools.dynamometer.workloadgenerator.audit.AuditCommandParser

Convert a line of input into an AuditReplayCommand.

parse(Text, Function<Long, Long>) - Method in class org.apache.hadoop.tools.dynamometer.workloadgenerator.audit.AuditLogDirectParser

parse(Text, Function<Long, Long>) - Method in class org.apache.hadoop.tools.dynamometer.workloadgenerator.audit.AuditLogHiveTableParser

R

RATE_FACTOR_DEFAULT - Static variable in class org.apache.hadoop.tools.dynamometer.workloadgenerator.audit.AuditReplayMapper

RATE_FACTOR_KEY - Static variable in class org.apache.hadoop.tools.dynamometer.workloadgenerator.audit.AuditReplayMapper

READ - org.apache.hadoop.tools.dynamometer.workloadgenerator.audit.AuditReplayMapper.CommandType

readFields(DataInput) - Method in class org.apache.hadoop.tools.dynamometer.workloadgenerator.audit.CountTimeWritable

readFields(DataInput) - Method in class org.apache.hadoop.tools.dynamometer.workloadgenerator.audit.UserCommandKey

readFields(DataInput) - Method in class org.apache.hadoop.tools.dynamometer.workloadgenerator.VirtualInputSplit

reduce(UserCommandKey, Iterable<CountTimeWritable>, Reducer.Context) - Method in class org.apache.hadoop.tools.dynamometer.workloadgenerator.audit.AuditReplayReducer

RENAME - org.apache.hadoop.tools.dynamometer.workloadgenerator.audit.AuditReplayMapper.ReplayCommand

run() - Method in class org.apache.hadoop.tools.dynamometer.workloadgenerator.audit.AuditReplayThread

run(String[]) - Method in class org.apache.hadoop.tools.dynamometer.workloadgenerator.WorkloadDriver

S

setCount(long) - Method in class org.apache.hadoop.tools.dynamometer.workloadgenerator.audit.CountTimeWritable

SETOWNER - org.apache.hadoop.tools.dynamometer.workloadgenerator.audit.AuditReplayMapper.ReplayCommand

SETPERMISSION - org.apache.hadoop.tools.dynamometer.workloadgenerator.audit.AuditReplayMapper.ReplayCommand

SETREPLICATION - org.apache.hadoop.tools.dynamometer.workloadgenerator.audit.AuditReplayMapper.ReplayCommand

setTime(long) - Method in class org.apache.hadoop.tools.dynamometer.workloadgenerator.audit.CountTimeWritable

SETTIMES - org.apache.hadoop.tools.dynamometer.workloadgenerator.audit.AuditReplayMapper.ReplayCommand

setup(Mapper.Context) - Method in class org.apache.hadoop.tools.dynamometer.workloadgenerator.audit.AuditReplayMapper

SHOULD_DELETE_DEFAULT - Static variable in class org.apache.hadoop.tools.dynamometer.workloadgenerator.CreateFileMapper

SHOULD_DELETE_KEY - Static variable in class org.apache.hadoop.tools.dynamometer.workloadgenerator.CreateFileMapper

START_TIME_OFFSET - Static variable in class org.apache.hadoop.tools.dynamometer.workloadgenerator.WorkloadDriver

START_TIME_OFFSET_DEFAULT - Static variable in class org.apache.hadoop.tools.dynamometer.workloadgenerator.WorkloadDriver

START_TIMESTAMP_MS - Static variable in class org.apache.hadoop.tools.dynamometer.workloadgenerator.WorkloadDriver

T

toString() - Method in class org.apache.hadoop.tools.dynamometer.workloadgenerator.audit.CountTimeWritable

toString() - Method in class org.apache.hadoop.tools.dynamometer.workloadgenerator.audit.UserCommandKey

TOTALCOMMANDS - org.apache.hadoop.tools.dynamometer.workloadgenerator.audit.AuditReplayMapper.REPLAYCOUNTERS

TOTALINVALIDCOMMANDS - org.apache.hadoop.tools.dynamometer.workloadgenerator.audit.AuditReplayMapper.REPLAYCOUNTERS

TOTALREADCOMMANDLATENCY - org.apache.hadoop.tools.dynamometer.workloadgenerator.audit.AuditReplayMapper.REPLAYCOUNTERS

TOTALREADCOMMANDS - org.apache.hadoop.tools.dynamometer.workloadgenerator.audit.AuditReplayMapper.REPLAYCOUNTERS

TOTALUNSUPPORTEDCOMMANDS - org.apache.hadoop.tools.dynamometer.workloadgenerator.audit.AuditReplayMapper.REPLAYCOUNTERS

TOTALWRITECOMMANDLATENCY - org.apache.hadoop.tools.dynamometer.workloadgenerator.audit.AuditReplayMapper.REPLAYCOUNTERS

TOTALWRITECOMMANDS - org.apache.hadoop.tools.dynamometer.workloadgenerator.audit.AuditReplayMapper.REPLAYCOUNTERS

U

UserCommandKey - Class in org.apache.hadoop.tools.dynamometer.workloadgenerator.audit

UserCommandKey is a Writable used as a composite key combining the user id, name, and type of a replayed command.

UserCommandKey() - Constructor for class org.apache.hadoop.tools.dynamometer.workloadgenerator.audit.UserCommandKey

UserCommandKey(String, String, String) - Constructor for class org.apache.hadoop.tools.dynamometer.workloadgenerator.audit.UserCommandKey

UserCommandKey(Text, Text, Text) - Constructor for class org.apache.hadoop.tools.dynamometer.workloadgenerator.audit.UserCommandKey

V

valueOf(String) - Static method in enum org.apache.hadoop.tools.dynamometer.workloadgenerator.audit.AuditReplayMapper.CommandType

Returns the enum constant of this type with the specified name.

valueOf(String) - Static method in enum org.apache.hadoop.tools.dynamometer.workloadgenerator.audit.AuditReplayMapper.ReplayCommand

Returns the enum constant of this type with the specified name.

valueOf(String) - Static method in enum org.apache.hadoop.tools.dynamometer.workloadgenerator.audit.AuditReplayMapper.REPLAYCOUNTERS

Returns the enum constant of this type with the specified name.

valueOf(String) - Static method in enum org.apache.hadoop.tools.dynamometer.workloadgenerator.CreateFileMapper.CREATEFILECOUNTERS

Returns the enum constant of this type with the specified name.

values() - Static method in enum org.apache.hadoop.tools.dynamometer.workloadgenerator.audit.AuditReplayMapper.CommandType

Returns an array containing the constants of this enum type, in the order they are declared.

values() - Static method in enum org.apache.hadoop.tools.dynamometer.workloadgenerator.audit.AuditReplayMapper.ReplayCommand

Returns an array containing the constants of this enum type, in the order they are declared.

values() - Static method in enum org.apache.hadoop.tools.dynamometer.workloadgenerator.audit.AuditReplayMapper.REPLAYCOUNTERS

Returns an array containing the constants of this enum type, in the order they are declared.

values() - Static method in enum org.apache.hadoop.tools.dynamometer.workloadgenerator.CreateFileMapper.CREATEFILECOUNTERS

Returns an array containing the constants of this enum type, in the order they are declared.

verifyConfigurations(Configuration) - Method in class org.apache.hadoop.tools.dynamometer.workloadgenerator.audit.AuditReplayMapper

verifyConfigurations(Configuration) - Method in class org.apache.hadoop.tools.dynamometer.workloadgenerator.CreateFileMapper

verifyConfigurations(Configuration) - Method in class org.apache.hadoop.tools.dynamometer.workloadgenerator.WorkloadMapper

Verify that the provided configuration contains all configurations required by this mapper.

VirtualInputFormat<K,V> - Class in org.apache.hadoop.tools.dynamometer.workloadgenerator

An input format which does not read any input, but rather starts a configurable number of mappers and runs them for a configurable duration.

VirtualInputFormat() - Constructor for class org.apache.hadoop.tools.dynamometer.workloadgenerator.VirtualInputFormat

VirtualInputSplit - Class in org.apache.hadoop.tools.dynamometer.workloadgenerator

A fake input split.

VirtualInputSplit() - Constructor for class org.apache.hadoop.tools.dynamometer.workloadgenerator.VirtualInputSplit

VirtualRecordReader<K,V> - Class in org.apache.hadoop.tools.dynamometer.workloadgenerator

A simple fake record reader which simply runs for some time duration.

VirtualRecordReader() - Constructor for class org.apache.hadoop.tools.dynamometer.workloadgenerator.VirtualRecordReader

W

WorkloadDriver - Class in org.apache.hadoop.tools.dynamometer.workloadgenerator

This is the driver for generating generic workloads against a NameNode under test.

WorkloadDriver() - Constructor for class org.apache.hadoop.tools.dynamometer.workloadgenerator.WorkloadDriver

WorkloadMapper<KEYIN,VALUEIN,KEYOUT,VALUEOUT> - Class in org.apache.hadoop.tools.dynamometer.workloadgenerator

Represents the base class for a generic workload-generating mapper.

WorkloadMapper() - Constructor for class org.apache.hadoop.tools.dynamometer.workloadgenerator.WorkloadMapper

write(DataOutput) - Method in class org.apache.hadoop.tools.dynamometer.workloadgenerator.audit.CountTimeWritable

write(DataOutput) - Method in class org.apache.hadoop.tools.dynamometer.workloadgenerator.audit.UserCommandKey

write(DataOutput) - Method in class org.apache.hadoop.tools.dynamometer.workloadgenerator.VirtualInputSplit

WRITE - org.apache.hadoop.tools.dynamometer.workloadgenerator.audit.AuditReplayMapper.CommandType

A C D E F G H I L M N O P R S T U V W
All Classes All Packages