Uses of Class
org.apache.flink.runtime.checkpoint.filemerging.FileMergingSnapshotManager.SubtaskKey
Packages that use FileMergingSnapshotManager.SubtaskKey
Package
Description
-
Uses of FileMergingSnapshotManager.SubtaskKey in org.apache.flink.runtime.checkpoint.filemerging
Fields in org.apache.flink.runtime.checkpoint.filemerging with type parameters of type FileMergingSnapshotManager.SubtaskKeyModifier and TypeFieldDescriptionprotected final Map<FileMergingSnapshotManager.SubtaskKey,Queue<PhysicalFile>> PhysicalFilePool.sharedPhysicalFilePoolBySubtaskMap maintaining queues of different subtasks for reusing shared physical files.Methods in org.apache.flink.runtime.checkpoint.filemerging that return FileMergingSnapshotManager.SubtaskKeyModifier and TypeMethodDescriptionLogicalFile.getSubtaskKey()FileMergingSnapshotManager.SubtaskKey.of(Environment environment) Methods in org.apache.flink.runtime.checkpoint.filemerging with parameters of type FileMergingSnapshotManager.SubtaskKeyModifier and TypeMethodDescriptionvoidPhysicalFilePool.close(FileMergingSnapshotManager.SubtaskKey subtaskKey) Close files in shared file pool by subtaskKey and close all files in exclusive file pool.FileMergingSnapshotManager.createCheckpointStateOutputStream(FileMergingSnapshotManager.SubtaskKey subtaskKey, long checkpointId, CheckpointedStateScope scope) Create a newFileMergingCheckpointStateOutputStream.FileMergingSnapshotManagerBase.createCheckpointStateOutputStream(FileMergingSnapshotManager.SubtaskKey subtaskKey, long checkpointId, CheckpointedStateScope scope) protected LogicalFileFileMergingSnapshotManagerBase.createLogicalFile(PhysicalFile physicalFile, long startOffset, long length, FileMergingSnapshotManager.SubtaskKey subtaskKey) Create a logical file on a physical file.protected PhysicalFileFileMergingSnapshotManagerBase.createPhysicalFile(FileMergingSnapshotManager.SubtaskKey subtaskKey, CheckpointedStateScope scope) Create a physical file in right location (managed directory), which is specified by scope of this checkpoint and current subtask.protected Queue<PhysicalFile>PhysicalFilePool.getFileQueue(FileMergingSnapshotManager.SubtaskKey subtaskKey, CheckpointedStateScope scope) Get or create a file queue for specific subtaskKey and checkpoint scope.org.apache.flink.core.fs.PathFileMergingSnapshotManager.getManagedDir(FileMergingSnapshotManager.SubtaskKey subtaskKey, CheckpointedStateScope scope) Get the managed directory of the file-merging snapshot manager, created inFileMergingSnapshotManager.initFileSystem(org.apache.flink.core.fs.FileSystem, org.apache.flink.core.fs.Path, org.apache.flink.core.fs.Path, org.apache.flink.core.fs.Path, int)orFileMergingSnapshotManager.registerSubtaskForSharedStates(org.apache.flink.runtime.checkpoint.filemerging.FileMergingSnapshotManager.SubtaskKey).org.apache.flink.core.fs.PathFileMergingSnapshotManagerBase.getManagedDir(FileMergingSnapshotManager.SubtaskKey subtaskKey, CheckpointedStateScope scope) FileMergingSnapshotManager.getManagedDirStateHandle(FileMergingSnapshotManager.SubtaskKey subtaskKey, CheckpointedStateScope scope) Get theDirectoryStreamStateHandleof the managed directory, created inFileMergingSnapshotManager.initFileSystem(org.apache.flink.core.fs.FileSystem, org.apache.flink.core.fs.Path, org.apache.flink.core.fs.Path, org.apache.flink.core.fs.Path, int)orFileMergingSnapshotManager.registerSubtaskForSharedStates(org.apache.flink.runtime.checkpoint.filemerging.FileMergingSnapshotManager.SubtaskKey).FileMergingSnapshotManagerBase.getManagedDirStateHandle(FileMergingSnapshotManager.SubtaskKey subtaskKey, CheckpointedStateScope scope) protected PhysicalFileAcrossCheckpointFileMergingSnapshotManager.getOrCreatePhysicalFileForCheckpoint(FileMergingSnapshotManager.SubtaskKey subtaskKey, long checkpointID, CheckpointedStateScope scope) protected abstract PhysicalFileFileMergingSnapshotManagerBase.getOrCreatePhysicalFileForCheckpoint(FileMergingSnapshotManager.SubtaskKey subtaskKey, long checkpointId, CheckpointedStateScope scope) Get a reused physical file or create one.protected PhysicalFileWithinCheckpointFileMergingSnapshotManager.getOrCreatePhysicalFileForCheckpoint(FileMergingSnapshotManager.SubtaskKey subtaskKey, long checkpointId, CheckpointedStateScope scope) voidFileMergingSnapshotManager.notifyCheckpointAborted(FileMergingSnapshotManager.SubtaskKey subtaskKey, long checkpointId) This method is called as a notification once a distributed checkpoint has been aborted.voidFileMergingSnapshotManagerBase.notifyCheckpointAborted(FileMergingSnapshotManager.SubtaskKey subtaskKey, long checkpointId) voidWithinCheckpointFileMergingSnapshotManager.notifyCheckpointAborted(FileMergingSnapshotManager.SubtaskKey subtaskKey, long checkpointId) voidFileMergingSnapshotManager.notifyCheckpointComplete(FileMergingSnapshotManager.SubtaskKey subtaskKey, long checkpointId) Notifies the manager that the checkpoint with the givencheckpointIdcompleted and was committed.voidFileMergingSnapshotManagerBase.notifyCheckpointComplete(FileMergingSnapshotManager.SubtaskKey subtaskKey, long checkpointId) voidWithinCheckpointFileMergingSnapshotManager.notifyCheckpointComplete(FileMergingSnapshotManager.SubtaskKey subtaskKey, long checkpointId) voidFileMergingSnapshotManager.notifyCheckpointStart(FileMergingSnapshotManager.SubtaskKey subtaskKey, long checkpointId) Notifies the manager that the checkpoint with the givencheckpointIdhas been started.voidFileMergingSnapshotManagerBase.notifyCheckpointStart(FileMergingSnapshotManager.SubtaskKey subtaskKey, long checkpointId) SubtaskCheckpointCoordinatorImpluse this method let the file merging manager know an ongoing checkpoint may reference the managed dirs.voidFileMergingSnapshotManager.notifyCheckpointSubsumed(FileMergingSnapshotManager.SubtaskKey subtaskKey, long checkpointId) This method is called as a notification once a distributed checkpoint has been subsumed.voidFileMergingSnapshotManagerBase.notifyCheckpointSubsumed(FileMergingSnapshotManager.SubtaskKey subtaskKey, long checkpointId) PhysicalFile.PhysicalFileCreator.perform(FileMergingSnapshotManager.SubtaskKey subtaskKey, CheckpointedStateScope scope) Create the file.BlockingPhysicalFilePool.pollFile(FileMergingSnapshotManager.SubtaskKey subtaskKey, CheckpointedStateScope scope) NonBlockingPhysicalFilePool.pollFile(FileMergingSnapshotManager.SubtaskKey subtaskKey, CheckpointedStateScope scope) abstract PhysicalFilePhysicalFilePool.pollFile(FileMergingSnapshotManager.SubtaskKey subtaskKey, CheckpointedStateScope scope) Poll a physical file from the pool.voidFileMergingSnapshotManager.registerSubtaskForSharedStates(FileMergingSnapshotManager.SubtaskKey subtaskKey) Register a subtask and create the managed directory for shared states.voidFileMergingSnapshotManagerBase.registerSubtaskForSharedStates(FileMergingSnapshotManager.SubtaskKey subtaskKey) voidFileMergingSnapshotManager.restoreStateHandles(long checkpointId, FileMergingSnapshotManager.SubtaskKey subtaskKey, Stream<SegmentFileStateHandle> stateHandles) Restore and re-register the SegmentFileStateHandles into FileMergingSnapshotManager.voidFileMergingSnapshotManagerBase.restoreStateHandles(long checkpointId, FileMergingSnapshotManager.SubtaskKey subtaskKey, Stream<SegmentFileStateHandle> stateHandles) protected voidAcrossCheckpointFileMergingSnapshotManager.returnPhysicalFileForNextReuse(FileMergingSnapshotManager.SubtaskKey subtaskKey, long checkpointId, PhysicalFile physicalFile) protected abstract voidFileMergingSnapshotManagerBase.returnPhysicalFileForNextReuse(FileMergingSnapshotManager.SubtaskKey subtaskKey, long checkpointId, PhysicalFile physicalFile) Try to return an existing physical file to the manager for next reuse.protected voidWithinCheckpointFileMergingSnapshotManager.returnPhysicalFileForNextReuse(FileMergingSnapshotManager.SubtaskKey subtaskKey, long checkpointId, PhysicalFile physicalFile) booleanBlockingPhysicalFilePool.tryPutFile(FileMergingSnapshotManager.SubtaskKey subtaskKey, PhysicalFile physicalFile) booleanNonBlockingPhysicalFilePool.tryPutFile(FileMergingSnapshotManager.SubtaskKey subtaskKey, PhysicalFile physicalFile) abstract booleanPhysicalFilePool.tryPutFile(FileMergingSnapshotManager.SubtaskKey subtaskKey, PhysicalFile physicalFile) Try to put a physical file into file pool.voidFileMergingSnapshotManager.unregisterSubtask(FileMergingSnapshotManager.SubtaskKey subtaskKey) Unregister a subtask.voidFileMergingSnapshotManagerBase.unregisterSubtask(FileMergingSnapshotManager.SubtaskKey subtaskKey) Constructors in org.apache.flink.runtime.checkpoint.filemerging with parameters of type FileMergingSnapshotManager.SubtaskKeyModifierConstructorDescriptionLogicalFile(LogicalFile.LogicalFileId fileId, PhysicalFile physicalFile, long startOffset, long length, FileMergingSnapshotManager.SubtaskKey subtaskKey) -
Uses of FileMergingSnapshotManager.SubtaskKey in org.apache.flink.runtime.state.filesystem
Constructors in org.apache.flink.runtime.state.filesystem with parameters of type FileMergingSnapshotManager.SubtaskKeyModifierConstructorDescriptionFsMergingCheckpointStorageLocation(FileMergingSnapshotManager.SubtaskKey subtaskKey, org.apache.flink.core.fs.FileSystem fileSystem, org.apache.flink.core.fs.Path checkpointDir, org.apache.flink.core.fs.Path sharedStateDir, org.apache.flink.core.fs.Path taskOwnedStateDir, CheckpointStorageLocationReference reference, int fileStateSizeThreshold, int writeBufferSize, FileMergingSnapshotManager fileMergingSnapshotManager, long checkpointId)