Package org.apache.flink.fs.azurefs

Class AzureBlobRecoverableWriter

java.lang.Object
org.apache.flink.runtime.fs.hdfs.HadoopRecoverableWriter
org.apache.flink.fs.azurefs.AzureBlobRecoverableWriter
All Implemented Interfaces:
org.apache.flink.core.fs.RecoverableWriter
public class AzureBlobRecoverableWriter extends org.apache.flink.runtime.fs.hdfs.HadoopRecoverableWriter
Recoverable writer for AzureBlob file system.

  • Nested Class Summary

    Nested classes/interfaces inherited from interface org.apache.flink.core.fs.RecoverableWriter

    org.apache.flink.core.fs.RecoverableWriter.CommitRecoverable, org.apache.flink.core.fs.RecoverableWriter.ResumeRecoverable

  • Field Summary

    Fields inherited from class org.apache.flink.runtime.fs.hdfs.HadoopRecoverableWriter

    fs

  • Constructor Summary

    Constructors
    Constructor
    Description
    AzureBlobRecoverableWriter(org.apache.hadoop.fs.FileSystem fs)
    Creates a new Recoverable writer.

  • Method Summary

    Modifier and Type
    Method
    Description
    protected void
    checkSupportedFSSchemes(org.apache.hadoop.fs.FileSystem fs)
     
    protected org.apache.flink.core.fs.RecoverableFsDataOutputStream
    getRecoverableFsDataOutputStream(org.apache.hadoop.fs.Path targetFile, org.apache.hadoop.fs.Path tempFile)
     
    org.apache.flink.core.fs.RecoverableFsDataOutputStream
    recover(org.apache.flink.core.fs.RecoverableWriter.ResumeRecoverable recoverable)
     
    org.apache.flink.core.fs.RecoverableFsDataOutputStream.Committer
    recoverForCommit(org.apache.flink.core.fs.RecoverableWriter.CommitRecoverable recoverable)
     

    Methods inherited from class org.apache.flink.runtime.fs.hdfs.HadoopRecoverableWriter

    cleanupRecoverableState, getCommitRecoverableSerializer, getResumeRecoverableSerializer, open, requiresCleanupOfRecoverableState, supportsResume

    Methods inherited from class java.lang.Object

    clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

  • Constructor Details

    • AzureBlobRecoverableWriter

      public AzureBlobRecoverableWriter(org.apache.hadoop.fs.FileSystem fs)
      Creates a new Recoverable writer.
      Parameters:
      fs - The AzureBlob file system on which the writer operates.

  • Method Details

    • checkSupportedFSSchemes

      protected void checkSupportedFSSchemes(org.apache.hadoop.fs.FileSystem fs)
      Overrides:
      checkSupportedFSSchemes in class org.apache.flink.runtime.fs.hdfs.HadoopRecoverableWriter

    • getRecoverableFsDataOutputStream

      protected org.apache.flink.core.fs.RecoverableFsDataOutputStream getRecoverableFsDataOutputStream(org.apache.hadoop.fs.Path targetFile, org.apache.hadoop.fs.Path tempFile) throws IOException
      Overrides:
      getRecoverableFsDataOutputStream in class org.apache.flink.runtime.fs.hdfs.HadoopRecoverableWriter
      Throws:
      IOException

    • recover

      public org.apache.flink.core.fs.RecoverableFsDataOutputStream recover(org.apache.flink.core.fs.RecoverableWriter.ResumeRecoverable recoverable) throws IOException
      Specified by:
      recover in interface org.apache.flink.core.fs.RecoverableWriter
      Overrides:
      recover in class org.apache.flink.runtime.fs.hdfs.HadoopRecoverableWriter
      Throws:
      IOException

    • recoverForCommit

      public org.apache.flink.core.fs.RecoverableFsDataOutputStream.Committer recoverForCommit(org.apache.flink.core.fs.RecoverableWriter.CommitRecoverable recoverable) throws IOException
      Specified by:
      recoverForCommit in interface org.apache.flink.core.fs.RecoverableWriter
      Overrides:
      recoverForCommit in class org.apache.flink.runtime.fs.hdfs.HadoopRecoverableWriter
      Throws:
      IOException