Index

A B C D F G I L M N O P R S T U
All Classes and Interfaces|All Packages|Constant Field Values

A

AbstractStateChangeFsUploader - Class in org.apache.flink.changelog.fs

Base implementation of StateChangeUploader.

AbstractStateChangeFsUploader(boolean, int, ChangelogStorageMetricGroup, TaskChangelogRegistry, BiFunction<Path, Long, StreamStateHandle>) - Constructor for class org.apache.flink.changelog.fs.AbstractStateChangeFsUploader

B

BASE_PATH - Static variable in class org.apache.flink.changelog.fs.FsStateChangelogOptions

bufferSize - Variable in class org.apache.flink.changelog.fs.AbstractStateChangeFsUploader

C

CACHE_IDLE_TIMEOUT - Static variable in class org.apache.flink.changelog.fs.FsStateChangelogOptions

CHANGELOG_STORAGE_ATTEMPTS_PER_UPLOAD - Static variable in class org.apache.flink.changelog.fs.ChangelogStorageMetricGroup

CHANGELOG_STORAGE_NUM_UPLOAD_FAILURES - Static variable in class org.apache.flink.changelog.fs.ChangelogStorageMetricGroup

CHANGELOG_STORAGE_NUM_UPLOAD_REQUESTS - Static variable in class org.apache.flink.changelog.fs.ChangelogStorageMetricGroup

CHANGELOG_STORAGE_TOTAL_ATTEMPTS_PER_UPLOAD - Static variable in class org.apache.flink.changelog.fs.ChangelogStorageMetricGroup

CHANGELOG_STORAGE_UPLOAD_BATCH_SIZES - Static variable in class org.apache.flink.changelog.fs.ChangelogStorageMetricGroup

CHANGELOG_STORAGE_UPLOAD_LATENCIES_NANOS - Static variable in class org.apache.flink.changelog.fs.ChangelogStorageMetricGroup

CHANGELOG_STORAGE_UPLOAD_QUEUE_SIZE - Static variable in class org.apache.flink.changelog.fs.ChangelogStorageMetricGroup

CHANGELOG_STORAGE_UPLOAD_SIZES - Static variable in class org.apache.flink.changelog.fs.ChangelogStorageMetricGroup

ChangelogStorageMetricGroup - Class in org.apache.flink.changelog.fs

Metrics related to the Changelog Storage used by the Changelog State Backend.

ChangelogStorageMetricGroup(MetricGroup) - Constructor for class org.apache.flink.changelog.fs.ChangelogStorageMetricGroup

close() - Method in class org.apache.flink.changelog.fs.DuplicatingStateChangeFsUploader

close() - Method in class org.apache.flink.changelog.fs.FsStateChangelogStorage

close() - Method in class org.apache.flink.changelog.fs.FsStateChangelogStorageForRecovery

close() - Method in class org.apache.flink.changelog.fs.StateChangeFsUploader

complete() - Method in class org.apache.flink.changelog.fs.StateChangeUploader.UploadTasksResult

complete(List<UploadResult>) - Method in class org.apache.flink.changelog.fs.StateChangeUploadScheduler.UploadTask

compression - Variable in class org.apache.flink.changelog.fs.AbstractStateChangeFsUploader

COMPRESSION_ENABLED - Static variable in class org.apache.flink.changelog.fs.FsStateChangelogOptions

configure(Configuration, File, Duration, int) - Static method in class org.apache.flink.changelog.fs.FsStateChangelogStorageFactory

createReader() - Method in class org.apache.flink.changelog.fs.FsStateChangelogStorageForRecovery

createStorage(JobID, Configuration, TaskManagerJobMetricGroup, LocalRecoveryConfig) - Method in class org.apache.flink.changelog.fs.FsStateChangelogStorageFactory

createStorageView(Configuration) - Method in class org.apache.flink.changelog.fs.FsStateChangelogStorageFactory

createWriter(String, KeyGroupRange, MailboxExecutor) - Method in class org.apache.flink.changelog.fs.FsStateChangelogStorage

D

defaultChangelogRegistry(int) - Static method in interface org.apache.flink.changelog.fs.TaskChangelogRegistry

defaultChangelogRegistry(Executor) - Static method in interface org.apache.flink.changelog.fs.TaskChangelogRegistry

directScheduler(StateChangeUploader) - Static method in interface org.apache.flink.changelog.fs.StateChangeUploadScheduler

discard() - Method in class org.apache.flink.changelog.fs.StateChangeUploader.UploadTasksResult

DuplicatingStateChangeFsUploader - Class in org.apache.flink.changelog.fs

A StateChangeFsUploader implementation that writes the changes to remote and local.

DuplicatingStateChangeFsUploader(JobID, Path, FileSystem, boolean, int, ChangelogStorageMetricGroup, TaskChangelogRegistry, LocalSnapshotDirectoryProvider) - Constructor for class org.apache.flink.changelog.fs.DuplicatingStateChangeFsUploader

F

fail(Throwable) - Method in class org.apache.flink.changelog.fs.StateChangeUploadScheduler.UploadTask

fixed(int, long, long) - Static method in interface org.apache.flink.changelog.fs.RetryPolicy

fromConfig(JobID, ReadableConfig, ChangelogStorageMetricGroup, TaskChangelogRegistry, LocalRecoveryConfig) - Static method in interface org.apache.flink.changelog.fs.StateChangeUploadScheduler

fromConfig(ReadableConfig) - Static method in interface org.apache.flink.changelog.fs.RetryPolicy

FsStateChangelogOptions - Class in org.apache.flink.changelog.fs

ConfigOptions for FsStateChangelogStorage.

FsStateChangelogOptions() - Constructor for class org.apache.flink.changelog.fs.FsStateChangelogOptions

FsStateChangelogStorage - Class in org.apache.flink.changelog.fs

Filesystem-based implementation of StateChangelogStorage.

FsStateChangelogStorage(JobID, Configuration, TaskManagerJobMetricGroup, TaskChangelogRegistry, LocalRecoveryConfig) - Constructor for class org.apache.flink.changelog.fs.FsStateChangelogStorage

FsStateChangelogStorage(JobID, Configuration, TaskManagerJobMetricGroup, LocalRecoveryConfig) - Constructor for class org.apache.flink.changelog.fs.FsStateChangelogStorage

FsStateChangelogStorage(JobID, Path, boolean, int, ChangelogStorageMetricGroup, TaskChangelogRegistry, LocalRecoveryConfig) - Constructor for class org.apache.flink.changelog.fs.FsStateChangelogStorage

FsStateChangelogStorage(StateChangeUploadScheduler, long, TaskChangelogRegistry, LocalRecoveryConfig) - Constructor for class org.apache.flink.changelog.fs.FsStateChangelogStorage

FsStateChangelogStorageFactory - Class in org.apache.flink.changelog.fs

FsStateChangelogStorage factory.

FsStateChangelogStorageFactory() - Constructor for class org.apache.flink.changelog.fs.FsStateChangelogStorageFactory

FsStateChangelogStorageForRecovery - Class in org.apache.flink.changelog.fs

Filesystem-based implementation of StateChangelogStorage just for recovery.

FsStateChangelogStorageForRecovery(ChangelogStreamHandleReader) - Constructor for class org.apache.flink.changelog.fs.FsStateChangelogStorageForRecovery

G

generateFileName() - Method in class org.apache.flink.changelog.fs.AbstractStateChangeFsUploader

getAttemptsPerUpload() - Method in class org.apache.flink.changelog.fs.ChangelogStorageMetricGroup

getAvailabilityProvider() - Method in class org.apache.flink.changelog.fs.FsStateChangelogStorage

getAvailabilityProvider() - Method in interface org.apache.flink.changelog.fs.StateChangeUploadScheduler

getBasePath() - Method in class org.apache.flink.changelog.fs.StateChangeFsUploader

getChanges() - Method in class org.apache.flink.changelog.fs.StateChangeSet

getChangeSets() - Method in class org.apache.flink.changelog.fs.StateChangeUploadScheduler.UploadTask

getIdentifier() - Method in class org.apache.flink.changelog.fs.FsStateChangelogStorageFactory

getLocalOffset() - Method in class org.apache.flink.changelog.fs.UploadResult

getLocalStreamHandleStateHandle() - Method in class org.apache.flink.changelog.fs.UploadResult

getLogId() - Method in class org.apache.flink.changelog.fs.StateChangeSet

getOffset() - Method in class org.apache.flink.changelog.fs.UploadResult

getSequenceNumber() - Method in class org.apache.flink.changelog.fs.StateChangeSet

getSequenceNumber() - Method in class org.apache.flink.changelog.fs.UploadResult

getSize() - Method in class org.apache.flink.changelog.fs.StateChangeSet

getSize() - Method in class org.apache.flink.changelog.fs.StateChangeUploadScheduler.UploadTask

getSize() - Method in class org.apache.flink.changelog.fs.UploadResult

getStateSize() - Method in class org.apache.flink.changelog.fs.StateChangeUploader.UploadTasksResult

getStreamStateHandle() - Method in class org.apache.flink.changelog.fs.StateChangeUploader.UploadTasksResult

getStreamStateHandle() - Method in class org.apache.flink.changelog.fs.UploadResult

getTotalAttemptsPerUpload() - Method in class org.apache.flink.changelog.fs.ChangelogStorageMetricGroup

getUploadBatchSizes() - Method in class org.apache.flink.changelog.fs.ChangelogStorageMetricGroup

The number of upload tasks (coming from one or more writers, i.e. backends/tasks) that were grouped together and form a single upload resulting in a single file.

getUploadFailuresCounter() - Method in class org.apache.flink.changelog.fs.ChangelogStorageMetricGroup

getUploadLatenciesNanos() - Method in class org.apache.flink.changelog.fs.ChangelogStorageMetricGroup

getUploadsCounter() - Method in class org.apache.flink.changelog.fs.ChangelogStorageMetricGroup

getUploadSizes() - Method in class org.apache.flink.changelog.fs.ChangelogStorageMetricGroup

I

IDENTIFIER - Static variable in class org.apache.flink.changelog.fs.FsStateChangelogStorageFactory

IN_FLIGHT_DATA_LIMIT - Static variable in class org.apache.flink.changelog.fs.FsStateChangelogOptions

isFinished() - Method in class org.apache.flink.changelog.fs.StateChangeUploadScheduler.UploadTask

L

localOffset - Variable in class org.apache.flink.changelog.fs.UploadResult

localStreamHandle - Variable in class org.apache.flink.changelog.fs.UploadResult

M

metrics - Variable in class org.apache.flink.changelog.fs.AbstractStateChangeFsUploader

N

NO_OP - Static variable in interface org.apache.flink.changelog.fs.TaskChangelogRegistry

NONE - Static variable in interface org.apache.flink.changelog.fs.RetryPolicy

NUM_DISCARD_THREADS - Static variable in class org.apache.flink.changelog.fs.FsStateChangelogOptions

NUM_UPLOAD_THREADS - Static variable in class org.apache.flink.changelog.fs.FsStateChangelogOptions

O

of(StreamStateHandle, StreamStateHandle, StateChangeSet, long, long) - Static method in class org.apache.flink.changelog.fs.UploadResult

offset - Variable in class org.apache.flink.changelog.fs.UploadResult

org.apache.flink.changelog.fs - package org.apache.flink.changelog.fs

P

PATH_SUB_DIR - Static variable in class org.apache.flink.changelog.fs.StateChangeFsUploader

PERSIST_DELAY - Static variable in class org.apache.flink.changelog.fs.FsStateChangelogOptions

PERSIST_SIZE_THRESHOLD - Static variable in class org.apache.flink.changelog.fs.FsStateChangelogOptions

PREEMPTIVE_PERSIST_THRESHOLD - Static variable in class org.apache.flink.changelog.fs.FsStateChangelogOptions

prepareStream() - Method in class org.apache.flink.changelog.fs.DuplicatingStateChangeFsUploader

prepareStream() - Method in class org.apache.flink.changelog.fs.StateChangeFsUploader

R

registerUploadQueueSizeGauge(Gauge<Integer>) - Method in class org.apache.flink.changelog.fs.ChangelogStorageMetricGroup

release(StreamStateHandle) - Method in interface org.apache.flink.changelog.fs.TaskChangelogRegistry

Decrease the reference count of the state by one, e.g. if it was pre-emptively uploaded and materialized.

RETRY_DELAY_AFTER_FAILURE - Static variable in class org.apache.flink.changelog.fs.FsStateChangelogOptions

RETRY_MAX_ATTEMPTS - Static variable in class org.apache.flink.changelog.fs.FsStateChangelogOptions

RETRY_POLICY - Static variable in class org.apache.flink.changelog.fs.FsStateChangelogOptions

retryAfter(int, Exception) - Method in class org.apache.flink.changelog.fs.RetryPolicy.FixedRetryPolicy

retryAfter(int, Exception) - Method in interface org.apache.flink.changelog.fs.RetryPolicy

RetryPolicy - Interface in org.apache.flink.changelog.fs

Retry policy to use by RetryingExecutor.

RetryPolicy.FixedRetryPolicy - Class in org.apache.flink.changelog.fs

RetryPolicy with fixed timeout, delay and max attempts.

S

sequenceNumber - Variable in class org.apache.flink.changelog.fs.UploadResult

size - Variable in class org.apache.flink.changelog.fs.UploadResult

startTracking(StreamStateHandle, long) - Method in interface org.apache.flink.changelog.fs.TaskChangelogRegistry

Start tracking the state uploaded.

StateChangeFormat - Class in org.apache.flink.changelog.fs

Serialization format for state changes.

StateChangeFormat() - Constructor for class org.apache.flink.changelog.fs.StateChangeFormat

StateChangeFsUploader - Class in org.apache.flink.changelog.fs

A synchronous StateChangeUploadScheduler implementation that uploads the changes using FileSystem.

StateChangeFsUploader(JobID, Path, FileSystem, boolean, int, ChangelogStorageMetricGroup, TaskChangelogRegistry) - Constructor for class org.apache.flink.changelog.fs.StateChangeFsUploader

StateChangeFsUploader(JobID, Path, FileSystem, boolean, int, ChangelogStorageMetricGroup, TaskChangelogRegistry, BiFunction<Path, Long, StreamStateHandle>) - Constructor for class org.apache.flink.changelog.fs.StateChangeFsUploader

StateChangeSet - Class in org.apache.flink.changelog.fs

A set of changes made to some state(s) by a single state backend during a single checkpoint.

StateChangeSet(UUID, SequenceNumber, List<StateChange>) - Constructor for class org.apache.flink.changelog.fs.StateChangeSet

StateChangeUploader - Interface in org.apache.flink.changelog.fs

The purpose of this interface is to abstract the different implementations of uploading state changelog parts.

StateChangeUploader.UploadTasksResult - Class in org.apache.flink.changelog.fs

Result of executing one or more upload tasks.

StateChangeUploadScheduler - Interface in org.apache.flink.changelog.fs

Schedules upload tasks on a StateChangeUploader.

StateChangeUploadScheduler.UploadTask - Class in org.apache.flink.changelog.fs

Upload Task for StateChangeUploadScheduler.

stopTracking(StreamStateHandle) - Method in interface org.apache.flink.changelog.fs.TaskChangelogRegistry

Stop tracking the state, so that it's not tracked (some other component is doing that).

streamStateHandle - Variable in class org.apache.flink.changelog.fs.UploadResult

T

TaskChangelogRegistry - Interface in org.apache.flink.changelog.fs

TM-side registry of StateObjects, each representing one or more changelog segments.

timeoutFor(int) - Method in class org.apache.flink.changelog.fs.RetryPolicy.FixedRetryPolicy

timeoutFor(int) - Method in interface org.apache.flink.changelog.fs.RetryPolicy

toString() - Method in class org.apache.flink.changelog.fs.RetryPolicy.FixedRetryPolicy

toString() - Method in class org.apache.flink.changelog.fs.StateChangeSet

toString() - Method in class org.apache.flink.changelog.fs.StateChangeUploadScheduler.UploadTask

toString() - Method in class org.apache.flink.changelog.fs.UploadResult

U

upload(Collection<StateChangeUploadScheduler.UploadTask>) - Method in class org.apache.flink.changelog.fs.AbstractStateChangeFsUploader

upload(Collection<StateChangeUploadScheduler.UploadTask>) - Method in interface org.apache.flink.changelog.fs.StateChangeUploader

Execute the upload task and return the results.

upload(StateChangeUploadScheduler.UploadTask) - Method in interface org.apache.flink.changelog.fs.StateChangeUploadScheduler

Schedule the upload and complete or fail the corresponding tasks.

UPLOAD_BUFFER_SIZE - Static variable in class org.apache.flink.changelog.fs.FsStateChangelogOptions

UPLOAD_TIMEOUT - Static variable in class org.apache.flink.changelog.fs.FsStateChangelogOptions

UploadResult - Class in org.apache.flink.changelog.fs

Result of uploading state changes.

UploadResult(StreamStateHandle, long, SequenceNumber, long) - Constructor for class org.apache.flink.changelog.fs.UploadResult

UploadResult(StreamStateHandle, StreamStateHandle, long, long, SequenceNumber, long) - Constructor for class org.apache.flink.changelog.fs.UploadResult

UploadTask(Collection<StateChangeSet>, Consumer<List<UploadResult>>, BiConsumer<List<SequenceNumber>, Throwable>) - Constructor for class org.apache.flink.changelog.fs.StateChangeUploadScheduler.UploadTask

UploadTasksResult(Map<StateChangeUploadScheduler.UploadTask, Map<StateChangeSet, Tuple2<Long, Long>>>, StreamStateHandle) - Constructor for class org.apache.flink.changelog.fs.StateChangeUploader.UploadTasksResult

UploadTasksResult(Map<StateChangeUploadScheduler.UploadTask, Map<StateChangeSet, Tuple2<Long, Long>>>, StreamStateHandle, StreamStateHandle) - Constructor for class org.apache.flink.changelog.fs.StateChangeUploader.UploadTasksResult

A B C D F G I L M N O P R S T U
All Classes and Interfaces|All Packages|Constant Field Values