Class BatchPartitionCommitterSink

java.lang.Object
org.apache.flink.api.common.functions.AbstractRichFunction
org.apache.flink.streaming.api.functions.sink.legacy.RichSinkFunction<CompactMessages.CompactOutput>
org.apache.flink.connector.file.table.batch.compact.BatchPartitionCommitterSink
All Implemented Interfaces:
Serializable, org.apache.flink.api.common.functions.Function, org.apache.flink.api.common.functions.RichFunction, org.apache.flink.streaming.api.functions.sink.legacy.SinkFunction<CompactMessages.CompactOutput>

public class BatchPartitionCommitterSink extends org.apache.flink.streaming.api.functions.sink.legacy.RichSinkFunction<CompactMessages.CompactOutput>
Committer operator for partition in batch mode. This is the single (non-parallel) task. It collects all the partition information including partition and written files send from upstream.
See Also:
  • Nested Class Summary

    Nested classes/interfaces inherited from interface org.apache.flink.streaming.api.functions.sink.legacy.SinkFunction

    org.apache.flink.streaming.api.functions.sink.legacy.SinkFunction.Context
  • Constructor Summary

    Constructors
    Constructor
    Description
    BatchPartitionCommitterSink(FileSystemFactory fsFactory, TableMetaStoreFactory msFactory, boolean overwrite, boolean isToLocal, org.apache.flink.core.fs.Path tmpPath, String[] partitionColumns, LinkedHashMap<String,String> staticPartitions, org.apache.flink.table.catalog.ObjectIdentifier identifier, PartitionCommitPolicyFactory partitionCommitPolicyFactory)
     
  • Method Summary

    Modifier and Type
    Method
    Description
    void
     
    void
     
    void
    invoke(CompactMessages.CompactOutput compactOutput, org.apache.flink.streaming.api.functions.sink.legacy.SinkFunction.Context context)
     
    void
    open(org.apache.flink.api.common.functions.OpenContext openContext)
     

    Methods inherited from class org.apache.flink.api.common.functions.AbstractRichFunction

    getIterationRuntimeContext, getRuntimeContext, setRuntimeContext

    Methods inherited from class java.lang.Object

    clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

    Methods inherited from interface org.apache.flink.streaming.api.functions.sink.legacy.SinkFunction

    invoke, writeWatermark
  • Constructor Details

  • Method Details

    • open

      public void open(org.apache.flink.api.common.functions.OpenContext openContext) throws Exception
      Specified by:
      open in interface org.apache.flink.api.common.functions.RichFunction
      Overrides:
      open in class org.apache.flink.api.common.functions.AbstractRichFunction
      Throws:
      Exception
    • invoke

      public void invoke(CompactMessages.CompactOutput compactOutput, org.apache.flink.streaming.api.functions.sink.legacy.SinkFunction.Context context) throws Exception
      Throws:
      Exception
    • finish

      public void finish() throws Exception
      Throws:
      Exception
    • close

      public void close() throws Exception
      Specified by:
      close in interface org.apache.flink.api.common.functions.RichFunction
      Overrides:
      close in class org.apache.flink.api.common.functions.AbstractRichFunction
      Throws:
      Exception