Package org.apache.flink.streaming.api.operators

Class MapPartitionOperator<IN,OUT>

java.lang.Object
org.apache.flink.streaming.api.operators.AbstractStreamOperator<OUT>
org.apache.flink.streaming.api.operators.AbstractUdfStreamOperator<OUT,org.apache.flink.api.common.functions.MapPartitionFunction<IN,OUT>>
org.apache.flink.streaming.api.operators.MapPartitionOperator<IN,OUT>
All Implemented Interfaces:
Serializable, org.apache.flink.api.common.state.CheckpointListener, BoundedOneInput, Input<IN>, KeyContext, KeyContextHandler, OneInputStreamOperator<IN,OUT>, org.apache.flink.streaming.api.operators.OutputTypeConfigurable<OUT>, StreamOperator<OUT>, StreamOperatorStateHandler.CheckpointedStreamOperator, UserFunctionProvider<org.apache.flink.api.common.functions.MapPartitionFunction<IN,OUT>>, YieldingOperator<OUT>
@Internal public class MapPartitionOperator<IN,OUT> extends AbstractUdfStreamOperator<OUT,org.apache.flink.api.common.functions.MapPartitionFunction<IN,OUT>> implements OneInputStreamOperator<IN,OUT>, BoundedOneInput
The MapPartitionOperator is used to process all records in each partition on non-keyed stream. Each partition contains all records of a subtask.
See Also:

  • Constructor Details

    • MapPartitionOperator

      public MapPartitionOperator(org.apache.flink.api.common.functions.MapPartitionFunction<IN,OUT> function)

  • Method Details

    • open

      public void open() throws Exception
      Description copied from class: AbstractStreamOperator
      This method is called immediately before any elements are processed, it should contain the operator's initialization logic, e.g. state initialization.

      The default implementation does nothing.

      Specified by:
      open in interface StreamOperator<IN>
      Overrides:
      open in class AbstractUdfStreamOperator<OUT,org.apache.flink.api.common.functions.MapPartitionFunction<IN,OUT>>
      Throws:
      Exception - An exception in this method causes the operator to fail.

    • processElement

      public void processElement(StreamRecord<IN> element) throws Exception
      Description copied from interface: Input
      Processes one element that arrived on this input of the MultipleInputStreamOperator. This method is guaranteed to not be called concurrently with other methods of the operator.
      Specified by:
      processElement in interface Input<IN>
      Throws:
      Exception

    • endInput

      public void endInput() throws Exception
      Description copied from interface: BoundedOneInput
      It is notified that no more data will arrive from the input.

      WARNING: It is not safe to use this method to commit any transactions or other side effects! You can use this method to flush any buffered data that can later on be committed e.g. in a CheckpointListener.notifyCheckpointComplete(long).

      NOTE: Given it is semantically very similar to the StreamOperator.finish() method. It might be dropped in favour of the other method at some point in time.

      Specified by:
      endInput in interface BoundedOneInput
      Throws:
      Exception

    • getOperatorAttributes

      public OperatorAttributes getOperatorAttributes()
      Description copied from interface: StreamOperator
      Called to get the OperatorAttributes of the operator. If there is no defined attribute, a default OperatorAttributes is built.
      Specified by:
      getOperatorAttributes in interface StreamOperator<IN>
      Returns:
      OperatorAttributes of the operator.