| Class | Description |
|---|---|
| BaseLogParser |
Base class to implement
LogParser. |
| BaseSolver |
Common functions shared by
Solver (translate predicted resource
allocation into Hadoop's ReservationSubmissionRequest. |
| DataFieldNotFoundException |
Exception thrown when job attributes are not found.
|
| DuplicateRecurrenceIdException |
Exception thrown the
RecurrenceId already exists in the
SkylineStore. |
| EmptyResourceSkylineException |
Exception thrown if the @link{ResourceSkyline}s to be added to the
SkylineStore is empty. |
| HistorySkylineStore |
HistorySkylineStore stores pipeline job's
ResourceSkylines in all
runs. |
| InMemoryStore |
An in-memory implementation of
SkylineStore. |
| InvalidInputException |
Exception thrown the
SkylineStore or the Estimator tries to
addHistory or query pipeline job's resource skylines. |
| InvalidSolverException |
Exception thrown the @link{SkylineStore} or the
Estimator tries to
addHistory or query pipeline job's resource skylines. |
| JobMetaData |
Job metadata collected when parsing the log file.
|
| LogParser |
LogParser iterates over a stream of logs, uses
SingleLineParser to
parse each line, and adds extracted ResourceSkylines to the
SkylineStore. |
| LogParserUtil |
Common utility functions for
LogParser. |
| LpSolver |
A LP(Linear Programming) solution to predict recurring pipeline's
Resource requirements, and generate Hadoop RDL requests which
will be used to make recurring resource reservation. |
| NativeSingleLineParser |
This sample parser will parse the sample log and extract the resource
skyline.
|
| NullPipelineIdException |
Exception thrown when pipelineId to be added is null.
|
| NullRecurrenceIdException |
Exception thrown the
RecurrenceId to be added is null. |
| NullResourceSkylineException |
Exception thrown if the
ResourceSkyline to be added is null. |
| NullRLESparseResourceAllocationException |
Exception thrown if the
ResourceSkyline to be added is null. |
| ParserValidator |
Validates the input parameters for the
LogParser. |
| PredictionSkylineStore |
PredictionSkylineStore stores the predicted
RLESparseResourceAllocation of a job as computed by the
Estimator based on the ResourceSkylines of past executions in
the HistorySkylineStore. |
| RecurrenceId |
RecurrenceId is the id for the recurring pipeline jobs.
|
| RecurrenceIdNotFoundException |
Exception thrown if
RecurrenceId is not found in the
SkylineStore. |
| ResourceEstimatorConfiguration |
Defines configuration keys for ResourceEstimatorServer.
|
| ResourceEstimatorException |
Exception thrown by ResourceEstimatorServer utility classes.
|
| ResourceEstimatorServer |
A simple embedded Hadoop HTTP server.
|
| ResourceEstimatorService |
Resource Estimator Service which provides a set of REST APIs for users to
use the estimation service.
|
| ResourceEstimatorUtil |
General resourceestimator utils.
|
| ResourceSerDe |
Serialize/deserialize Resource object to/from JSON.
|
| ResourceSkyline |
ResourceSkyline records the job identification information as well as job's
requested
containers information during its lifespan. |
| RLESparseResourceAllocationSerDe |
Serialize/deserialize RLESparseResourceAllocation object to/from JSON.
|
| RmSingleLineParser |
SingleLineParser for Hadoop Resource Manager logs. |
| ShutdownHook |
Simple shutdown hook for
ResourceEstimatorServer. |
| SingleLineParser |
SingleLineParser parses one line in the log file, extracts the
ResourceSkylines and stores them. |
| SkylineStore |
SkylineStore is composable interface for storing the history
ResourceSkylines of past job runs and the predicted
RLESparseResourceAllocation for future execution. |
| SkylineStoreException |
Exception thrown the @link{SkylineStore} or the
Estimator tries to
addHistory or query pipeline job's resource skylines. |
| SkylineStoreValidator |
SkylineStoreValidator validates input parameters for
SkylineStore. |
| Solver |
Solver takes recurring pipeline's
ResourceSkyline history as input,
predicts its Resource requirement at each time t for the next run,
and translate them into ResourceSkyline which will be used to make
recurring resource reservations. |
| SolverException |
Exception thrown the @link{SkylineStore} or the
Estimator tries to
addHistory or query pipeline job's resource skylines. |
| SolverPreprocessor |
Common preprocessing functions for
Solver. |
Copyright © 2008–2025 Apache Software Foundation. All rights reserved.