Package org.apache.flink.fs.gs.writer

Class GSRecoverableWriter

java.lang.Object
org.apache.flink.fs.gs.writer.GSRecoverableWriter
All Implemented Interfaces:
org.apache.flink.core.fs.RecoverableWriter
public class GSRecoverableWriter extends Object implements org.apache.flink.core.fs.RecoverableWriter
The recoverable writer implementation for Google storage.

  • Nested Class Summary

    Nested classes/interfaces inherited from interface org.apache.flink.core.fs.RecoverableWriter

    org.apache.flink.core.fs.RecoverableWriter.CommitRecoverable, org.apache.flink.core.fs.RecoverableWriter.ResumeRecoverable

  • Constructor Summary

    Constructors
    Constructor
    Description
    GSRecoverableWriter(GSBlobStorage storage, GSFileSystemOptions options)
    Construct a GS recoverable writer.

  • Method Summary

    Modifier and Type
    Method
    Description
    boolean
    cleanupRecoverableState(org.apache.flink.core.fs.RecoverableWriter.ResumeRecoverable resumable)
     
    org.apache.flink.core.io.SimpleVersionedSerializer<org.apache.flink.core.fs.RecoverableWriter.CommitRecoverable>
    getCommitRecoverableSerializer()
     
    org.apache.flink.core.io.SimpleVersionedSerializer<org.apache.flink.core.fs.RecoverableWriter.ResumeRecoverable>
    getResumeRecoverableSerializer()
     
    org.apache.flink.core.fs.RecoverableFsDataOutputStream
    open(org.apache.flink.core.fs.Path path)
     
    org.apache.flink.core.fs.RecoverableFsDataOutputStream
    recover(org.apache.flink.core.fs.RecoverableWriter.ResumeRecoverable resumable)
     
    org.apache.flink.core.fs.RecoverableFsDataOutputStream.Committer
    recoverForCommit(org.apache.flink.core.fs.RecoverableWriter.CommitRecoverable resumable)
     
    boolean
    requiresCleanupOfRecoverableState()
     
    boolean
    supportsResume()
     

    Methods inherited from class java.lang.Object

    clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

  • Constructor Details

    • GSRecoverableWriter

      public GSRecoverableWriter(GSBlobStorage storage, GSFileSystemOptions options)
      Construct a GS recoverable writer.
      Parameters:
      storage - The underlying blob storage instance
      options - The GS file system options

  • Method Details

    • requiresCleanupOfRecoverableState

      public boolean requiresCleanupOfRecoverableState()
      Specified by:
      requiresCleanupOfRecoverableState in interface org.apache.flink.core.fs.RecoverableWriter

    • supportsResume

      public boolean supportsResume()
      Specified by:
      supportsResume in interface org.apache.flink.core.fs.RecoverableWriter

    • open

      public org.apache.flink.core.fs.RecoverableFsDataOutputStream open(org.apache.flink.core.fs.Path path) throws IOException
      Specified by:
      open in interface org.apache.flink.core.fs.RecoverableWriter
      Throws:
      IOException

    • recover

      public org.apache.flink.core.fs.RecoverableFsDataOutputStream recover(org.apache.flink.core.fs.RecoverableWriter.ResumeRecoverable resumable)
      Specified by:
      recover in interface org.apache.flink.core.fs.RecoverableWriter

    • cleanupRecoverableState

      public boolean cleanupRecoverableState(org.apache.flink.core.fs.RecoverableWriter.ResumeRecoverable resumable)
      Specified by:
      cleanupRecoverableState in interface org.apache.flink.core.fs.RecoverableWriter

    • recoverForCommit

      public org.apache.flink.core.fs.RecoverableFsDataOutputStream.Committer recoverForCommit(org.apache.flink.core.fs.RecoverableWriter.CommitRecoverable resumable)
      Specified by:
      recoverForCommit in interface org.apache.flink.core.fs.RecoverableWriter

    • getCommitRecoverableSerializer

      public org.apache.flink.core.io.SimpleVersionedSerializer<org.apache.flink.core.fs.RecoverableWriter.CommitRecoverable> getCommitRecoverableSerializer()
      Specified by:
      getCommitRecoverableSerializer in interface org.apache.flink.core.fs.RecoverableWriter

    • getResumeRecoverableSerializer

      public org.apache.flink.core.io.SimpleVersionedSerializer<org.apache.flink.core.fs.RecoverableWriter.ResumeRecoverable> getResumeRecoverableSerializer()
      Specified by:
      getResumeRecoverableSerializer in interface org.apache.flink.core.fs.RecoverableWriter