Package org.apache.flink.streaming.api.functions.sink.filesystem

Interface BucketWriter.PendingFile

Enclosing interface:
BucketWriter<IN,BucketID>
public static interface BucketWriter.PendingFile
This represents the file that can not write any data to.

  • Method Summary

    Modifier and Type
    Method
    Description
    void
    commit()
    Commits the pending file, making it visible.
    void
    commitAfterRecovery()
    Commits the pending file, making it visible.

  • Method Details

    • commit

      void commit() throws IOException
      Commits the pending file, making it visible. The file will contain the exact data as when the pending file was created.
      Throws:
      IOException - Thrown if committing fails.

    • commitAfterRecovery

      void commitAfterRecovery() throws IOException
      Commits the pending file, making it visible. The file will contain the exact data as when the pending file was created.

      This method tolerates situations where the file was already committed and will not raise an exception in that case. This is important for idempotent commit retries as they need to happen after recovery.

      Throws:
      IOException - Thrown if committing fails.