Package org.apache.hadoop.yarn.sls.synthetic

Class SynthTraceJobProducer

java.lang.Object

org.apache.hadoop.yarn.sls.synthetic.SynthTraceJobProducer

All Implemented Interfaces:

java.io.Closeable, java.lang.AutoCloseable, org.apache.hadoop.tools.rumen.JobStoryProducer

public class SynthTraceJobProducer
extends java.lang.Object
implements org.apache.hadoop.tools.rumen.JobStoryProducer

This is a JobStoryProducer that operates from distribution of different workloads. The .json input file is used to determine how many weight, which size, number of maps/reducers and their duration, as well as the temporal distributed of submissions. For each parameter we control avg and stdev, and generate values via normal or log-normal distributions.

Nested Class Summary

Nested Classes

Modifier and Type	Class	Description
static class	SynthTraceJobProducer.JobDefinition	Class used to parse a job class from file.
static class	SynthTraceJobProducer.Sample	Class used to parse value sample information.
static class	SynthTraceJobProducer.TaskDefinition	A task representing a type of container - e.g.
static class	SynthTraceJobProducer.TimeSample	This is used to define time-varying probability of a job start-time (e.g., to simulate daily patterns).
static class	SynthTraceJobProducer.Trace	Class used to parse a trace configuration file.
static class	SynthTraceJobProducer.Workload	Class used to parse a workload from file.

Field Summary

Fields

Modifier and Type	Field	Description
static java.lang.String	SLS_SYNTHETIC_TRACE_FILE

Constructor Summary

Constructors

Constructor	Description
SynthTraceJobProducer(org.apache.hadoop.conf.Configuration conf)
SynthTraceJobProducer(org.apache.hadoop.conf.Configuration conf, org.apache.hadoop.fs.Path path)

Method Summary

Modifier and Type	Method	Description
void	close()
org.apache.hadoop.tools.rumen.JobStory	getNextJob()
int	getNodesPerRack()
int	getNumJobs()
int	getNumNodes()
long	getSeed()
java.lang.String	toString()

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, wait, wait, wait

Field Detail

SLS_SYNTHETIC_TRACE_FILE

public static final java.lang.String SLS_SYNTHETIC_TRACE_FILE

See Also:

Constant Field Values

Constructor Detail

SynthTraceJobProducer

public SynthTraceJobProducer(org.apache.hadoop.conf.Configuration conf)
                      throws java.io.IOException

Throws:

java.io.IOException

SynthTraceJobProducer

public SynthTraceJobProducer(org.apache.hadoop.conf.Configuration conf,
                             org.apache.hadoop.fs.Path path)
                      throws java.io.IOException

Throws:

java.io.IOException

Method Detail

getNextJob

public org.apache.hadoop.tools.rumen.JobStory getNextJob()
                                                  throws java.io.IOException

Specified by:

getNextJob in interface org.apache.hadoop.tools.rumen.JobStoryProducer

Throws:

java.io.IOException

close

public void close()

Specified by:

close in interface java.lang.AutoCloseable

Specified by:

close in interface java.io.Closeable

toString

public java.lang.String toString()

Overrides:

toString in class java.lang.Object

getNumJobs

public int getNumJobs()

getSeed

public long getSeed()

getNodesPerRack

public int getNodesPerRack()

getNumNodes

public int getNumNodes()