Package org.apache.flink.streaming.api.transformations

Class GlobalCommitterTransform<CommT>

java.lang.Object
org.apache.flink.api.dag.Transformation<T>
org.apache.flink.streaming.api.transformations.PhysicalTransformation<T>
org.apache.flink.streaming.api.transformations.TransformationWithLineage<Void>
org.apache.flink.streaming.api.transformations.GlobalCommitterTransform<CommT>
Type Parameters:
CommT -
@Internal public class GlobalCommitterTransform<CommT> extends TransformationWithLineage<Void>
Transformation for global committer. Only used to fetch if the pipeline is streaming or batch with the respective GlobalCommitterTransformationTranslator.

  • Field Summary

    Fields inherited from class org.apache.flink.api.dag.Transformation

    bufferTimeout, description, id, name, outputType, typeUsed, UPPER_BOUND_MAX_PARALLELISM

  • Constructor Summary

    Constructors
    Constructor
    Description
    GlobalCommitterTransform(DataStream<CommittableMessage<CommT>> inputStream, org.apache.flink.util.function.SerializableFunction<org.apache.flink.api.connector.sink2.CommitterInitContext,org.apache.flink.api.connector.sink2.Committer<CommT>> committerFactory, org.apache.flink.util.function.SerializableSupplier<org.apache.flink.core.io.SimpleVersionedSerializer<CommT>> committableSerializer)
     

  • Method Summary

    Modifier and Type
    Method
    Description
    org.apache.flink.util.function.SerializableSupplier<org.apache.flink.core.io.SimpleVersionedSerializer<CommT>>
    getCommittableSerializer()
     
    org.apache.flink.util.function.SerializableFunction<org.apache.flink.api.connector.sink2.CommitterInitContext,org.apache.flink.api.connector.sink2.Committer<CommT>>
    getCommitterFactory()
     
    List<org.apache.flink.api.dag.Transformation<?>>
    getInputs()
     
    DataStream<CommittableMessage<CommT>>
    getInputStream()
     
    protected List<org.apache.flink.api.dag.Transformation<?>>
    getTransitivePredecessorsInternal()
     
    void
    setChainingStrategy(ChainingStrategy strategy)
    Sets the chaining strategy of this Transformation.

    Methods inherited from class org.apache.flink.streaming.api.transformations.TransformationWithLineage

    getLineageVertex, setLineageVertex

    Methods inherited from class org.apache.flink.streaming.api.transformations.PhysicalTransformation

    isSupportsConcurrentExecutionAttempts, setSupportsConcurrentExecutionAttempts

    Methods inherited from class org.apache.flink.api.dag.Transformation

    declareManagedMemoryUseCaseAtOperatorScope, declareManagedMemoryUseCaseAtSlotScope, enableAsyncState, equals, getAttribute, getBufferTimeout, getCoLocationGroupKey, getDescription, getId, getManagedMemoryOperatorScopeUseCaseWeights, getManagedMemorySlotScopeUseCases, getMaxParallelism, getMinResources, getName, getNewNodeId, getOutputType, getParallelism, getPreferredResources, getSlotSharingGroup, getTransitivePredecessors, getUid, getUserProvidedNodeHash, hashCode, isParallelismConfigured, setAttribute, setBufferTimeout, setCoLocationGroupKey, setDescription, setMaxParallelism, setName, setOutputType, setParallelism, setParallelism, setResources, setSlotSharingGroup, setSlotSharingGroup, setUid, setUidHash, toString, updateManagedMemoryStateBackendUseCase

    Methods inherited from class java.lang.Object

    clone, finalize, getClass, notify, notifyAll, wait, wait, wait

  • Constructor Details

    • GlobalCommitterTransform

      public GlobalCommitterTransform(DataStream<CommittableMessage<CommT>> inputStream, org.apache.flink.util.function.SerializableFunction<org.apache.flink.api.connector.sink2.CommitterInitContext,org.apache.flink.api.connector.sink2.Committer<CommT>> committerFactory, org.apache.flink.util.function.SerializableSupplier<org.apache.flink.core.io.SimpleVersionedSerializer<CommT>> committableSerializer)

  • Method Details

    • setChainingStrategy

      public void setChainingStrategy(ChainingStrategy strategy)
      Description copied from class: PhysicalTransformation
      Sets the chaining strategy of this Transformation.
      Specified by:
      setChainingStrategy in class PhysicalTransformation<Void>

    • getTransitivePredecessorsInternal

      protected List<org.apache.flink.api.dag.Transformation<?>> getTransitivePredecessorsInternal()
      Specified by:
      getTransitivePredecessorsInternal in class org.apache.flink.api.dag.Transformation<Void>

    • getInputs

      public List<org.apache.flink.api.dag.Transformation<?>> getInputs()
      Specified by:
      getInputs in class org.apache.flink.api.dag.Transformation<Void>

    • getInputStream

      public DataStream<CommittableMessage<CommT>> getInputStream()

    • getCommitterFactory

      public org.apache.flink.util.function.SerializableFunction<org.apache.flink.api.connector.sink2.CommitterInitContext,org.apache.flink.api.connector.sink2.Committer<CommT>> getCommitterFactory()

    • getCommittableSerializer

      public org.apache.flink.util.function.SerializableSupplier<org.apache.flink.core.io.SimpleVersionedSerializer<CommT>> getCommittableSerializer()