B C D E F G H I J L M N O P R S T U V W
All Classes All Packages

B

BalanceJob<T extends BalanceProcedure> - Class in org.apache.hadoop.tools.fedbalance.procedure

A Job is a state machine consists of many procedures.

BalanceJob.Builder<T extends BalanceProcedure> - Class in org.apache.hadoop.tools.fedbalance.procedure

BalanceJournal - Interface in org.apache.hadoop.tools.fedbalance.procedure

The Journal of the state machine.

BalanceJournalInfoHDFS - Class in org.apache.hadoop.tools.fedbalance.procedure

BalanceJournal based on HDFS.

BalanceJournalInfoHDFS() - Constructor for class org.apache.hadoop.tools.fedbalance.procedure.BalanceJournalInfoHDFS

BalanceJournalInfoHDFS.IdGenerator - Class in org.apache.hadoop.tools.fedbalance.procedure

BalanceProcedure<T extends BalanceProcedure> - Class in org.apache.hadoop.tools.fedbalance.procedure

The basic components of the Job.

BalanceProcedure() - Constructor for class org.apache.hadoop.tools.fedbalance.procedure.BalanceProcedure

BalanceProcedure(String, long) - Constructor for class org.apache.hadoop.tools.fedbalance.procedure.BalanceProcedure

BalanceProcedure(String, String, long) - Constructor for class org.apache.hadoop.tools.fedbalance.procedure.BalanceProcedure

The constructor of BalanceProcedure.

BalanceProcedure.RetryException - Exception in org.apache.hadoop.tools.fedbalance.procedure

The RetryException represents the current procedure should be delayed then retried.

BalanceProcedureScheduler - Class in org.apache.hadoop.tools.fedbalance.procedure

The state machine framework consist of: Job: The state machine.

BalanceProcedureScheduler(Configuration) - Constructor for class org.apache.hadoop.tools.fedbalance.procedure.BalanceProcedureScheduler

BANDWIDTH - Static variable in class org.apache.hadoop.tools.fedbalance.FedBalanceOptions

Specify bandwidth per map in MB, accepts bandwidth as a fraction.

build() - Method in class org.apache.hadoop.tools.fedbalance.FedBalanceContext.Builder

Build the FedBalanceContext.

build() - Method in class org.apache.hadoop.tools.fedbalance.procedure.BalanceJob.Builder

Builder() - Constructor for class org.apache.hadoop.tools.fedbalance.procedure.BalanceJob.Builder

Builder(Path, Path, String, Configuration) - Constructor for class org.apache.hadoop.tools.fedbalance.FedBalanceContext.Builder

This class helps building the FedBalanceContext.

C

clear(BalanceJob) - Method in interface org.apache.hadoop.tools.fedbalance.procedure.BalanceJournal

Clear all the journals of this job.

clear(BalanceJob) - Method in class org.apache.hadoop.tools.fedbalance.procedure.BalanceJournalInfoHDFS

CLI_OPTIONS - Static variable in class org.apache.hadoop.tools.fedbalance.FedBalanceOptions

CURRENT_SNAPSHOT_NAME - Static variable in class org.apache.hadoop.tools.fedbalance.FedBalanceConfigs

D

DELAY_DURATION - Static variable in class org.apache.hadoop.tools.fedbalance.FedBalanceOptions

Specify the delayed duration(millie seconds) to retry the Job.

delayMillisBeforeRetry() - Method in class org.apache.hadoop.tools.fedbalance.procedure.BalanceProcedure

The time in milliseconds the procedure should wait before retry.

DELETE - org.apache.hadoop.tools.fedbalance.FedBalanceConfigs.TrashOption

DIFF_DISTCP - org.apache.hadoop.tools.fedbalance.DistCpProcedure.Stage

DIFF_THRESHOLD - Static variable in class org.apache.hadoop.tools.fedbalance.FedBalanceOptions

Specify the threshold of diff entries.

DISABLE_WRITE - org.apache.hadoop.tools.fedbalance.DistCpProcedure.Stage

disableForTest() - Static method in class org.apache.hadoop.tools.fedbalance.DistCpProcedure

disableWrite(FedBalanceContext) - Method in class org.apache.hadoop.tools.fedbalance.DistCpProcedure

Disable write by cancelling the execute permission of the source path.

DISTCP_PROCEDURE - Static variable in class org.apache.hadoop.tools.fedbalance.FedBalance

DistCpProcedure - Class in org.apache.hadoop.tools.fedbalance

Copy data through distcp.

DistCpProcedure() - Constructor for class org.apache.hadoop.tools.fedbalance.DistCpProcedure

DistCpProcedure(String, String, long, FedBalanceContext) - Constructor for class org.apache.hadoop.tools.fedbalance.DistCpProcedure

The constructor of DistCpProcedure.

DistCpProcedure.Stage - Enum in org.apache.hadoop.tools.fedbalance

E

enableForTest() - Static method in class org.apache.hadoop.tools.fedbalance.DistCpProcedure

enableWrite() - Method in class org.apache.hadoop.tools.fedbalance.DistCpProcedure

Enable write.

equals(Object) - Method in class org.apache.hadoop.tools.fedbalance.FedBalanceContext

equals(Object) - Method in class org.apache.hadoop.tools.fedbalance.procedure.BalanceJob

equals(Object) - Method in class org.apache.hadoop.tools.fedbalance.procedure.BalanceProcedure

execute() - Method in class org.apache.hadoop.tools.fedbalance.DistCpProcedure

execute() - Method in class org.apache.hadoop.tools.fedbalance.procedure.BalanceJob

Run the state machine.

execute() - Method in class org.apache.hadoop.tools.fedbalance.procedure.BalanceProcedure

The main process.

execute() - Method in class org.apache.hadoop.tools.fedbalance.TrashProcedure

F

FED_BALANCE_DEFAULT_XML - Static variable in class org.apache.hadoop.tools.fedbalance.FedBalance

FED_BALANCE_SITE_XML - Static variable in class org.apache.hadoop.tools.fedbalance.FedBalance

FedBalance - Class in org.apache.hadoop.tools.fedbalance

Balance data from src cluster to dst cluster with distcp.

FedBalance() - Constructor for class org.apache.hadoop.tools.fedbalance.FedBalance

FedBalanceConfigs - Class in org.apache.hadoop.tools.fedbalance

Federation balance configuration properties.

FedBalanceConfigs.TrashOption - Enum in org.apache.hadoop.tools.fedbalance

FedBalanceContext - Class in org.apache.hadoop.tools.fedbalance

This class contains the basic information needed when Federation Balance.

FedBalanceContext() - Constructor for class org.apache.hadoop.tools.fedbalance.FedBalanceContext

FedBalanceContext.Builder - Class in org.apache.hadoop.tools.fedbalance

FedBalanceOptions - Class in org.apache.hadoop.tools.fedbalance

Command line options of FedBalance.

FINAL_DISTCP - org.apache.hadoop.tools.fedbalance.DistCpProcedure.Stage

findJob(BalanceJob) - Method in class org.apache.hadoop.tools.fedbalance.procedure.BalanceProcedureScheduler

Find job in scheduler.

FINISH - org.apache.hadoop.tools.fedbalance.DistCpProcedure.Stage

FORCE_CLOSE_OPEN - Static variable in class org.apache.hadoop.tools.fedbalance.FedBalanceOptions

If true, in DIFF_DISTCP stage it will force close all open files when there is no diff between the source path and the dst path.

G

getAllJobs() - Method in class org.apache.hadoop.tools.fedbalance.procedure.BalanceProcedureScheduler

Return all jobs in the scheduler.

getBandwidthLimit() - Method in class org.apache.hadoop.tools.fedbalance.FedBalanceContext

getConf() - Method in class org.apache.hadoop.tools.fedbalance.FedBalanceContext

getConf() - Method in class org.apache.hadoop.tools.fedbalance.procedure.BalanceJournalInfoHDFS

getContext() - Method in class org.apache.hadoop.tools.fedbalance.TrashProcedure

getDetailMessage() - Method in class org.apache.hadoop.tools.fedbalance.procedure.BalanceJob

Get the detail description of this job.

getDiffThreshold() - Method in class org.apache.hadoop.tools.fedbalance.FedBalanceContext

getDst() - Method in class org.apache.hadoop.tools.fedbalance.FedBalanceContext

getError() - Method in class org.apache.hadoop.tools.fedbalance.procedure.BalanceJob

Return the error exception during the job execution.

getForceCloseOpenFiles() - Method in class org.apache.hadoop.tools.fedbalance.FedBalanceContext

getId() - Method in class org.apache.hadoop.tools.fedbalance.procedure.BalanceJob

Get the uid of the job.

getMapNum() - Method in class org.apache.hadoop.tools.fedbalance.FedBalanceContext

getMount() - Method in class org.apache.hadoop.tools.fedbalance.FedBalanceContext

getSrc() - Method in class org.apache.hadoop.tools.fedbalance.FedBalanceContext

getTrashOpt() - Method in class org.apache.hadoop.tools.fedbalance.FedBalanceContext

getUseMountReadOnly() - Method in class org.apache.hadoop.tools.fedbalance.FedBalanceContext

H

hashCode() - Method in class org.apache.hadoop.tools.fedbalance.FedBalanceContext

hashCode() - Method in class org.apache.hadoop.tools.fedbalance.procedure.BalanceJob

hashCode() - Method in class org.apache.hadoop.tools.fedbalance.procedure.BalanceProcedure

I

IdGenerator(long) - Constructor for class org.apache.hadoop.tools.fedbalance.procedure.BalanceJournalInfoHDFS.IdGenerator

init(boolean) - Method in class org.apache.hadoop.tools.fedbalance.procedure.BalanceProcedureScheduler

Init the scheduler.

INIT_DISTCP - org.apache.hadoop.tools.fedbalance.DistCpProcedure.Stage

isJobDone() - Method in class org.apache.hadoop.tools.fedbalance.procedure.BalanceJob

Return true if the job has finished.

isRunning() - Method in class org.apache.hadoop.tools.fedbalance.procedure.BalanceProcedureScheduler

The running state of the scheduler.

isSchedulerShutdown() - Method in class org.apache.hadoop.tools.fedbalance.procedure.BalanceProcedure

The active flag.

J

JOB_PREFIX - Static variable in class org.apache.hadoop.tools.fedbalance.FedBalanceConfigs

L

LAST_SNAPSHOT_NAME - Static variable in class org.apache.hadoop.tools.fedbalance.FedBalanceConfigs

listAllJobs() - Method in interface org.apache.hadoop.tools.fedbalance.procedure.BalanceJournal

List all unfinished jobs.

listAllJobs() - Method in class org.apache.hadoop.tools.fedbalance.procedure.BalanceJournalInfoHDFS

LOG - Static variable in class org.apache.hadoop.tools.fedbalance.DistCpProcedure

LOG - Static variable in class org.apache.hadoop.tools.fedbalance.FedBalance

LOG - Static variable in class org.apache.hadoop.tools.fedbalance.procedure.BalanceJob

LOG - Static variable in class org.apache.hadoop.tools.fedbalance.procedure.BalanceJournalInfoHDFS

LOG - Static variable in class org.apache.hadoop.tools.fedbalance.procedure.BalanceProcedure

LOG - Static variable in class org.apache.hadoop.tools.fedbalance.procedure.BalanceProcedureScheduler

M

main(String[]) - Static method in class org.apache.hadoop.tools.fedbalance.FedBalance

Main function of the FedBalance program.

MAP - Static variable in class org.apache.hadoop.tools.fedbalance.FedBalanceOptions

Max number of maps to use during copy.

N

name() - Method in class org.apache.hadoop.tools.fedbalance.procedure.BalanceProcedure

Get the procedure name.

nextProcedure() - Method in class org.apache.hadoop.tools.fedbalance.procedure.BalanceProcedure

Get the next procedure.

nextProcedure(T) - Method in class org.apache.hadoop.tools.fedbalance.procedure.BalanceJob.Builder

Append a procedure to the tail.

NO_MOUNT - Static variable in class org.apache.hadoop.tools.fedbalance.FedBalance

O

org.apache.hadoop.tools.fedbalance - package org.apache.hadoop.tools.fedbalance

FedBalance is a tool for balancing data across federation clusters.

org.apache.hadoop.tools.fedbalance.procedure - package org.apache.hadoop.tools.fedbalance.procedure

Classes under this package implement a state machine used for balancing data across federation namespaces.

P

PRE_CHECK - org.apache.hadoop.tools.fedbalance.DistCpProcedure.Stage

R

readFields(DataInput) - Method in class org.apache.hadoop.tools.fedbalance.DistCpProcedure

readFields(DataInput) - Method in class org.apache.hadoop.tools.fedbalance.FedBalanceContext

readFields(DataInput) - Method in class org.apache.hadoop.tools.fedbalance.procedure.BalanceJob

readFields(DataInput) - Method in class org.apache.hadoop.tools.fedbalance.procedure.BalanceProcedure

readFields(DataInput) - Method in class org.apache.hadoop.tools.fedbalance.TrashProcedure

recoverJob(BalanceJob) - Method in interface org.apache.hadoop.tools.fedbalance.procedure.BalanceJournal

Recover the job from journal.

recoverJob(BalanceJob) - Method in class org.apache.hadoop.tools.fedbalance.procedure.BalanceJournalInfoHDFS

Recover job from journal on HDFS.

remove(BalanceJob) - Method in class org.apache.hadoop.tools.fedbalance.procedure.BalanceProcedureScheduler

Remove the job from scheduler if it finishes.

removeAfterDone(boolean) - Method in class org.apache.hadoop.tools.fedbalance.procedure.BalanceJob.Builder

Automatically remove this job from the scheduler cache when the job is done.

RetryException() - Constructor for exception org.apache.hadoop.tools.fedbalance.procedure.BalanceProcedure.RetryException

run(String[]) - Method in class org.apache.hadoop.tools.fedbalance.FedBalance

S

saveJob(BalanceJob) - Method in interface org.apache.hadoop.tools.fedbalance.procedure.BalanceJournal

Save journal of this job.

saveJob(BalanceJob) - Method in class org.apache.hadoop.tools.fedbalance.procedure.BalanceJournalInfoHDFS

Save job journal to HDFS.

SCHEDULER_JOURNAL_URI - Static variable in class org.apache.hadoop.tools.fedbalance.FedBalanceConfigs

setBandwidthLimit(int) - Method in class org.apache.hadoop.tools.fedbalance.FedBalanceContext.Builder

The bandwidth limit of the distcp job(MB).

setConf(Configuration) - Method in class org.apache.hadoop.tools.fedbalance.procedure.BalanceJournalInfoHDFS

setDelayDuration(long) - Method in class org.apache.hadoop.tools.fedbalance.FedBalanceContext.Builder

Specify the delayed duration when the procedures need to retry.

setDiffThreshold(int) - Method in class org.apache.hadoop.tools.fedbalance.FedBalanceContext.Builder

Specify the threshold of diff entries.

setForceCloseOpenFiles(boolean) - Method in class org.apache.hadoop.tools.fedbalance.FedBalanceContext.Builder

Force close open files.

setJournal(BalanceJournal) - Method in class org.apache.hadoop.tools.fedbalance.procedure.BalanceProcedureScheduler

setMapNum(int) - Method in class org.apache.hadoop.tools.fedbalance.FedBalanceContext.Builder

The map number of the distcp job.

setNextProcedure(String) - Method in class org.apache.hadoop.tools.fedbalance.procedure.BalanceProcedure

setTrash(FedBalanceConfigs.TrashOption) - Method in class org.apache.hadoop.tools.fedbalance.FedBalanceContext.Builder

Specify the trash behaviour after all the data is sync to the target.

setUseMountReadOnly(boolean) - Method in class org.apache.hadoop.tools.fedbalance.FedBalanceContext.Builder

Use mount point readonly to disable write.

shouldRemoveAfterDone() - Method in class org.apache.hadoop.tools.fedbalance.procedure.BalanceJob

Whether this job should be removed after it's done.

shutDown() - Method in class org.apache.hadoop.tools.fedbalance.procedure.BalanceProcedureScheduler

Shutdown the scheduler.

shutDownAndWait(int) - Method in class org.apache.hadoop.tools.fedbalance.procedure.BalanceProcedureScheduler

Shutdown scheduler and wait at most timeout seconds for procedures to finish.

SKIP - org.apache.hadoop.tools.fedbalance.FedBalanceConfigs.TrashOption

submit(BalanceJob) - Method in class org.apache.hadoop.tools.fedbalance.procedure.BalanceProcedureScheduler

Submit the job.

T

TMP_TAIL - Static variable in class org.apache.hadoop.tools.fedbalance.FedBalanceConfigs

toString() - Method in class org.apache.hadoop.tools.fedbalance.FedBalanceContext

toString() - Method in class org.apache.hadoop.tools.fedbalance.procedure.BalanceJob

toString() - Method in class org.apache.hadoop.tools.fedbalance.procedure.BalanceProcedure

TRASH - org.apache.hadoop.tools.fedbalance.FedBalanceConfigs.TrashOption

TRASH - Static variable in class org.apache.hadoop.tools.fedbalance.FedBalanceOptions

Move the source path to trash after all the data are sync to target, or delete the source directly, or skip both trash and deletion.

TRASH_PROCEDURE - Static variable in class org.apache.hadoop.tools.fedbalance.FedBalance

TrashProcedure - Class in org.apache.hadoop.tools.fedbalance

This procedure moves the source path to the corresponding trash.

TrashProcedure() - Constructor for class org.apache.hadoop.tools.fedbalance.TrashProcedure

TrashProcedure(String, String, long, FedBalanceContext) - Constructor for class org.apache.hadoop.tools.fedbalance.TrashProcedure

The constructor of TrashProcedure.

U

updateStage(DistCpProcedure.Stage) - Method in class org.apache.hadoop.tools.fedbalance.DistCpProcedure

V

valueOf(String) - Static method in enum org.apache.hadoop.tools.fedbalance.DistCpProcedure.Stage

Returns the enum constant of this type with the specified name.

valueOf(String) - Static method in enum org.apache.hadoop.tools.fedbalance.FedBalanceConfigs.TrashOption

Returns the enum constant of this type with the specified name.

values() - Static method in enum org.apache.hadoop.tools.fedbalance.DistCpProcedure.Stage

Returns an array containing the constants of this enum type, in the order they are declared.

values() - Static method in enum org.apache.hadoop.tools.fedbalance.FedBalanceConfigs.TrashOption

Returns an array containing the constants of this enum type, in the order they are declared.

W

waitJobDone() - Method in class org.apache.hadoop.tools.fedbalance.procedure.BalanceJob

Wait until the job is done.

waitUntilDone(BalanceJob) - Method in class org.apache.hadoop.tools.fedbalance.procedure.BalanceProcedureScheduler

Wait permanently until the job is done.

WORK_THREAD_NUM - Static variable in class org.apache.hadoop.tools.fedbalance.FedBalanceConfigs

WORK_THREAD_NUM_DEFAULT - Static variable in class org.apache.hadoop.tools.fedbalance.FedBalanceConfigs

write(DataOutput) - Method in class org.apache.hadoop.tools.fedbalance.DistCpProcedure

write(DataOutput) - Method in class org.apache.hadoop.tools.fedbalance.FedBalanceContext

write(DataOutput) - Method in class org.apache.hadoop.tools.fedbalance.procedure.BalanceJob

write(DataOutput) - Method in class org.apache.hadoop.tools.fedbalance.procedure.BalanceProcedure

write(DataOutput) - Method in class org.apache.hadoop.tools.fedbalance.TrashProcedure

B C D E F G H I J L M N O P R S T U V W
All Classes All Packages