Package org.apache.flink.changelog.fs

Class FsStateChangelogStorage

java.lang.Object
org.apache.flink.changelog.fs.FsStateChangelogStorageForRecovery
org.apache.flink.changelog.fs.FsStateChangelogStorage
All Implemented Interfaces:
AutoCloseable, org.apache.flink.runtime.state.changelog.StateChangelogStorage<org.apache.flink.runtime.state.changelog.ChangelogStateHandleStreamImpl>, org.apache.flink.runtime.state.changelog.StateChangelogStorageView<org.apache.flink.runtime.state.changelog.ChangelogStateHandleStreamImpl>
@Experimental @ThreadSafe public class FsStateChangelogStorage extends FsStateChangelogStorageForRecovery implements org.apache.flink.runtime.state.changelog.StateChangelogStorage<org.apache.flink.runtime.state.changelog.ChangelogStateHandleStreamImpl>
Filesystem-based implementation of StateChangelogStorage.

  • Constructor Summary

    Constructors
    Constructor
    Description
    FsStateChangelogStorage(org.apache.flink.api.common.JobID jobID, org.apache.flink.configuration.Configuration config, org.apache.flink.runtime.metrics.groups.TaskManagerJobMetricGroup metricGroup, TaskChangelogRegistry changelogRegistry, org.apache.flink.runtime.state.LocalRecoveryConfig localRecoveryConfig)
     
    FsStateChangelogStorage(org.apache.flink.api.common.JobID jobID, org.apache.flink.configuration.Configuration config, org.apache.flink.runtime.metrics.groups.TaskManagerJobMetricGroup metricGroup, org.apache.flink.runtime.state.LocalRecoveryConfig localRecoveryConfig)
     
    FsStateChangelogStorage(org.apache.flink.api.common.JobID jobID, org.apache.flink.core.fs.Path basePath, boolean compression, int bufferSize, ChangelogStorageMetricGroup metricGroup, TaskChangelogRegistry changelogRegistry, org.apache.flink.runtime.state.LocalRecoveryConfig localRecoveryConfig)
     
    FsStateChangelogStorage(StateChangeUploadScheduler uploader, long preEmptivePersistThresholdInBytes, TaskChangelogRegistry changelogRegistry, org.apache.flink.runtime.state.LocalRecoveryConfig localRecoveryConfig)
     

  • Method Summary

    Modifier and Type
    Method
    Description
    void
    close()
     
    org.apache.flink.changelog.fs.FsStateChangelogWriter
    createWriter(String operatorID, org.apache.flink.runtime.state.KeyGroupRange keyGroupRange, org.apache.flink.api.common.operators.MailboxExecutor mailboxExecutor)
     
    org.apache.flink.runtime.io.AvailabilityProvider
    getAvailabilityProvider()
     

    Methods inherited from class org.apache.flink.changelog.fs.FsStateChangelogStorageForRecovery

    createReader

    Methods inherited from class java.lang.Object

    clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

    Methods inherited from interface org.apache.flink.runtime.state.changelog.StateChangelogStorageView

    createReader

  • Constructor Details

    • FsStateChangelogStorage

      public FsStateChangelogStorage(org.apache.flink.api.common.JobID jobID, org.apache.flink.configuration.Configuration config, org.apache.flink.runtime.metrics.groups.TaskManagerJobMetricGroup metricGroup, org.apache.flink.runtime.state.LocalRecoveryConfig localRecoveryConfig) throws IOException
      Throws:
      IOException

    • FsStateChangelogStorage

      public FsStateChangelogStorage(org.apache.flink.api.common.JobID jobID, org.apache.flink.configuration.Configuration config, org.apache.flink.runtime.metrics.groups.TaskManagerJobMetricGroup metricGroup, TaskChangelogRegistry changelogRegistry, org.apache.flink.runtime.state.LocalRecoveryConfig localRecoveryConfig) throws IOException
      Throws:
      IOException

    • FsStateChangelogStorage

      @VisibleForTesting public FsStateChangelogStorage(org.apache.flink.api.common.JobID jobID, org.apache.flink.core.fs.Path basePath, boolean compression, int bufferSize, ChangelogStorageMetricGroup metricGroup, TaskChangelogRegistry changelogRegistry, org.apache.flink.runtime.state.LocalRecoveryConfig localRecoveryConfig) throws IOException
      Throws:
      IOException

    • FsStateChangelogStorage

      @VisibleForTesting public FsStateChangelogStorage(StateChangeUploadScheduler uploader, long preEmptivePersistThresholdInBytes, TaskChangelogRegistry changelogRegistry, org.apache.flink.runtime.state.LocalRecoveryConfig localRecoveryConfig)

  • Method Details

    • createWriter

      public org.apache.flink.changelog.fs.FsStateChangelogWriter createWriter(String operatorID, org.apache.flink.runtime.state.KeyGroupRange keyGroupRange, org.apache.flink.api.common.operators.MailboxExecutor mailboxExecutor)
      Specified by:
      createWriter in interface org.apache.flink.runtime.state.changelog.StateChangelogStorage<org.apache.flink.runtime.state.changelog.ChangelogStateHandleStreamImpl>

    • close

      public void close() throws Exception
      Specified by:
      close in interface AutoCloseable
      Specified by:
      close in interface org.apache.flink.runtime.state.changelog.StateChangelogStorageView<org.apache.flink.runtime.state.changelog.ChangelogStateHandleStreamImpl>
      Overrides:
      close in class FsStateChangelogStorageForRecovery
      Throws:
      Exception

    • getAvailabilityProvider

      public org.apache.flink.runtime.io.AvailabilityProvider getAvailabilityProvider()
      Specified by:
      getAvailabilityProvider in interface org.apache.flink.runtime.state.changelog.StateChangelogStorage<org.apache.flink.runtime.state.changelog.ChangelogStateHandleStreamImpl>