@Private @Unstable

Package org.apache.hadoop.tools.dynamometer.workloadgenerator.audit

This contains the tooling necessary to use audit logs as a way to generate a realistic workload against a Dynamometer-simulated NameNode.

Interface Summary

Interface	Description
AuditCommandParser	This interface represents a pluggable command parser.

Class Summary

Class	Description
AuditLogDirectParser	This AuditCommandParser is used to read commands from an audit log in the original format audit logs are produced in with a standard configuration.
AuditLogHiveTableParser	This AuditCommandParser is used to read commands assuming that the input was generated by a Hive query storing uncompressed output files, in which fields should be separated by the start-of-heading (U+0001) character.
AuditReplayMapper	AuditReplayMapper replays the given audit trace against the NameNode under test.
AuditReplayReducer	AuditReplayReducer aggregates the returned latency values from AuditReplayMapper and sums them up by UserCommandKey, which combines the user's id that ran the command and the type of the command (READ/WRITE).
AuditReplayThread	This class replays each audit log entry at a specified timestamp in the future.
CountTimeWritable	UserCommandKey is a Writable used as a composite value that accumulates the count and cumulative latency of replayed commands.
NoSplitTextInputFormat	A simple TextInputFormat that disables splitting of files.
UserCommandKey	UserCommandKey is a Writable used as a composite key combining the user id, name, and type of a replayed command.

Enum Summary

Enum	Description
AuditReplayMapper.CommandType	Define the type of command, either read or write.
AuditReplayMapper.ReplayCommand	Definitions of the various commands that can be replayed.
AuditReplayMapper.REPLAYCOUNTERS	Counter definitions for replay.