Package org.apache.hadoop.yarn.sls.utils

Class SLSUtils

java.lang.Object

org.apache.hadoop.yarn.sls.utils.SLSUtils

@Private
@Unstable
public class SLSUtils
extends java.lang.Object

Constructor Summary

Constructors

Constructor	Description
SLSUtils()

Method Summary

Modifier and Type	Method	Description
static java.util.Set<SLSRunner.NodeDetails>	generateNodes(int numNodes, int numRacks)
static void	generateNodeTableMapping(java.util.Set<SLSRunner.NodeDetails> nodeDetails, java.lang.String filePath)	Generates a node to rack mapping file based on node details.
static java.util.Set<java.lang.String>	generateSlsRunnerConfiguration(int nmMemory, int nmVCores, int amMemory, int amVCores, int slsRunnerPoolSize)	generate configuration for NM, AM and pool size to be used in sls-runner.xml
static java.lang.String[]	getRackHostName(java.lang.String hostname)
static java.util.Set<SLSRunner.NodeDetails>	parseNodesFromNodeFile(java.lang.String nodeFile, org.apache.hadoop.yarn.api.records.Resource nmDefaultResource)	parse the input node file, return each host name sample input: label1(exclusive=true),label2(exclusive=false),label3
static java.util.Set<SLSRunner.NodeDetails>	parseNodesFromRumenTrace(java.lang.String jobTrace)	parse the rumen trace file, return each host name
static java.util.Set<SLSRunner.NodeDetails>	parseNodesFromSLSTrace(java.lang.String jobTrace)	parse the sls trace file, return each host name

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

SLSUtils

public SLSUtils()

Method Detail

getRackHostName

public static java.lang.String[] getRackHostName(java.lang.String hostname)

parseNodesFromRumenTrace

public static java.util.Set<SLSRunner.NodeDetails> parseNodesFromRumenTrace(java.lang.String jobTrace)
                                                                     throws java.io.IOException

parse the rumen trace file, return each host name

Throws:

java.io.IOException

parseNodesFromSLSTrace

public static java.util.Set<SLSRunner.NodeDetails> parseNodesFromSLSTrace(java.lang.String jobTrace)
                                                                   throws java.io.IOException

parse the sls trace file, return each host name

Throws:

java.io.IOException

parseNodesFromNodeFile

public static java.util.Set<SLSRunner.NodeDetails> parseNodesFromNodeFile(java.lang.String nodeFile,
                                                                          org.apache.hadoop.yarn.api.records.Resource nmDefaultResource)
                                                                   throws java.io.IOException

parse the input node file, return each host name sample input: label1(exclusive=true),label2(exclusive=false),label3

Throws:

java.io.IOException

generateNodes

public static java.util.Set<SLSRunner.NodeDetails> generateNodes(int numNodes,
                                                                 int numRacks)

generateNodeTableMapping

public static void generateNodeTableMapping(java.util.Set<SLSRunner.NodeDetails> nodeDetails,
                                            java.lang.String filePath)
                                     throws java.io.IOException

Generates a node to rack mapping file based on node details. This file is then being used by TableMapping to resolve rack names. The format required by TableMapping is a two column text file where first column specifies node name and second column specifies rack name.

Parameters:

nodeDetails - Set of node details.

filePath - File path where to write table mapping.

Throws:

java.io.IOException

generateSlsRunnerConfiguration

public static java.util.Set<java.lang.String> generateSlsRunnerConfiguration(int nmMemory,
                                                                             int nmVCores,
                                                                             int amMemory,
                                                                             int amVCores,
                                                                             int slsRunnerPoolSize)

generate configuration for NM, AM and pool size to be used in sls-runner.xml

Parameters:

nmMemory - amount of memory for NM.

nmVCores - amount of vCores for NM.

amMemory - amount of memory for AM.

amVCores - amount of vCores for AM.

slsRunnerPoolSize - thread pool size for simulation AM and NM.