Package org.apache.flink.datastream.impl.operators

Class ProcessOperator<IN,OUT>

java.lang.Object
org.apache.flink.streaming.api.operators.AbstractStreamOperator<OUT>
org.apache.flink.runtime.asyncprocessing.operators.AbstractAsyncStateStreamOperator<OUT>
org.apache.flink.runtime.asyncprocessing.operators.AbstractAsyncStateUdfStreamOperator<OUT,org.apache.flink.datastream.api.function.OneInputStreamProcessFunction<IN,OUT>>
org.apache.flink.datastream.impl.operators.ProcessOperator<IN,OUT>
All Implemented Interfaces:
Serializable, org.apache.flink.api.common.state.CheckpointListener, org.apache.flink.streaming.api.operators.BoundedOneInput, org.apache.flink.streaming.api.operators.Input<IN>, org.apache.flink.streaming.api.operators.KeyContext, org.apache.flink.streaming.api.operators.KeyContextHandler, org.apache.flink.streaming.api.operators.OneInputStreamOperator<IN,OUT>, org.apache.flink.streaming.api.operators.OutputTypeConfigurable<OUT>, org.apache.flink.streaming.api.operators.StreamOperator<OUT>, org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.CheckpointedStreamOperator, org.apache.flink.streaming.api.operators.UserFunctionProvider<org.apache.flink.datastream.api.function.OneInputStreamProcessFunction<IN,OUT>>, org.apache.flink.streaming.api.operators.YieldingOperator<OUT>, org.apache.flink.streaming.runtime.operators.asyncprocessing.AsyncStateProcessing, org.apache.flink.streaming.runtime.operators.asyncprocessing.AsyncStateProcessingOperator
Direct Known Subclasses:
BaseKeyedProcessOperator
public class ProcessOperator<IN,OUT> extends org.apache.flink.runtime.asyncprocessing.operators.AbstractAsyncStateUdfStreamOperator<OUT,org.apache.flink.datastream.api.function.OneInputStreamProcessFunction<IN,OUT>> implements org.apache.flink.streaming.api.operators.OneInputStreamOperator<IN,OUT>, org.apache.flink.streaming.api.operators.BoundedOneInput
Operator for OneInputStreamProcessFunction.
See Also:

  • Field Summary

    Fields
    Modifier and Type
    Field
    Description
    protected DefaultRuntimeContext
    context
     
    protected org.apache.flink.streaming.runtime.watermark.extension.eventtime.EventTimeWatermarkHandler
    eventTimeWatermarkHandler
     
    protected org.apache.flink.datastream.api.context.NonPartitionedContext<OUT>
    nonPartitionedContext
     
    protected TimestampCollector<OUT>
    outputCollector
     
    protected DefaultPartitionedContext<OUT>
    partitionedContext
     
    protected Map<String,org.apache.flink.streaming.runtime.watermark.AbstractInternalWatermarkDeclaration<?>>
    watermarkDeclarationMap
     

    Fields inherited from class org.apache.flink.runtime.asyncprocessing.operators.AbstractAsyncStateUdfStreamOperator

    declarationContext, userFunction

    Fields inherited from class org.apache.flink.runtime.asyncprocessing.operators.AbstractAsyncStateStreamOperator

    declarationManager

    Fields inherited from class org.apache.flink.streaming.api.operators.AbstractStreamOperator

    combinedWatermark, config, lastRecordAttributes1, lastRecordAttributes2, latencyStats, metrics, output, processingTimeService, stateHandler, stateKeySelector1, stateKeySelector2, timeServiceManager

  • Constructor Summary

    Constructors
    Constructor
    Description
    ProcessOperator(org.apache.flink.datastream.api.function.OneInputStreamProcessFunction<IN,OUT> userFunction)
     

  • Method Summary

    Modifier and Type
    Method
    Description
    void
    close()
     
    protected Object
    currentKey()
     
    void
    endInput()
     
    protected Supplier<Long>
    getEventTimeSupplier()
     
    protected org.apache.flink.datastream.api.context.NonPartitionedContext<OUT>
    getNonPartitionedContext()
     
    protected TimestampCollector<OUT>
    getOutputCollector()
     
    protected org.apache.flink.datastream.api.context.ProcessingTimeManager
    getProcessingTimeManager()
     
    protected BiConsumer<Runnable,Object>
    getProcessorWithKey()
     
    protected org.apache.flink.streaming.api.operators.InternalTimerService<org.apache.flink.runtime.state.VoidNamespace>
    getTimerService()
     
    boolean
    isAsyncStateProcessingEnabled()
     
    void
    open()
     
    void
    processElement(org.apache.flink.streaming.runtime.streamrecord.StreamRecord<IN> element)
     
    void
    processWatermarkInternal(org.apache.flink.runtime.event.WatermarkEvent watermark)
     

    Methods inherited from class org.apache.flink.runtime.asyncprocessing.operators.AbstractAsyncStateUdfStreamOperator

    finish, getUserFunction, initializeState, notifyCheckpointAborted, notifyCheckpointComplete, setOutputType, setup, snapshotState

    Methods inherited from class org.apache.flink.runtime.asyncprocessing.operators.AbstractAsyncStateStreamOperator

    asyncProcessWithKey, beforeInitializeStateHandler, drainStateRequests, getAsyncKeyedStateBackend, getCurrentKey, getDeclarationManager, getElementOrder, getInternalTimerService, getOrCreateKeyedState, getRecordProcessor, newKeySelected, postProcessElement, postProcessWatermark, prepareSnapshotPreBarrier, preProcessWatermark, preserveRecordOrderAndProcess, processRecordAttributes, processRecordAttributes1, processRecordAttributes2, processWatermark, processWatermark, processWatermark1, processWatermark1Internal, processWatermark2, processWatermark2Internal, processWatermarkStatus, processWatermarkStatus, reportOrForwardLatencyMarker, setAsyncKeyedContextElement, setKeyContextElement1, setKeyContextElement2

    Methods inherited from class org.apache.flink.streaming.api.operators.AbstractStreamOperator

    getContainingTask, getExecutionConfig, getKeyedStateBackend, getKeyedStateStore, getMetricGroup, getOperatorConfig, getOperatorID, getOperatorName, getOperatorStateBackend, getOrCreateKeyedState, getPartitionedState, getPartitionedState, getProcessingTimeService, getRuntimeContext, getStateKeySelector1, getStateKeySelector2, getTimeServiceManager, getUserCodeClassloader, hasKeyContext1, hasKeyContext2, initializeState, isUsingCustomRawKeyedState, processLatencyMarker, processLatencyMarker1, processLatencyMarker2, processWatermark1, processWatermark2, processWatermarkStatus1, processWatermarkStatus2, setCurrentKey, setMailboxExecutor, setProcessingTimeService, snapshotState, useSplittableTimers

    Methods inherited from class java.lang.Object

    clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

    Methods inherited from interface org.apache.flink.api.common.state.CheckpointListener

    notifyCheckpointAborted, notifyCheckpointComplete

    Methods inherited from interface org.apache.flink.streaming.api.operators.Input

    processLatencyMarker, processRecordAttributes, processWatermark, processWatermark, processWatermarkStatus

    Methods inherited from interface org.apache.flink.streaming.api.operators.KeyContext

    getCurrentKey, setCurrentKey

    Methods inherited from interface org.apache.flink.streaming.api.operators.KeyContextHandler

    hasKeyContext

    Methods inherited from interface org.apache.flink.streaming.api.operators.OneInputStreamOperator

    setKeyContextElement

    Methods inherited from interface org.apache.flink.streaming.api.operators.StreamOperator

    finish, getMetricGroup, getOperatorAttributes, getOperatorID, initializeState, prepareSnapshotPreBarrier, setKeyContextElement1, setKeyContextElement2, snapshotState

  • Field Details

    • context

      protected transient DefaultRuntimeContext context

    • partitionedContext

      protected transient DefaultPartitionedContext<OUT> partitionedContext

    • nonPartitionedContext

      protected transient org.apache.flink.datastream.api.context.NonPartitionedContext<OUT> nonPartitionedContext

    • outputCollector

      protected transient TimestampCollector<OUT> outputCollector

    • watermarkDeclarationMap

      protected transient Map<String,org.apache.flink.streaming.runtime.watermark.AbstractInternalWatermarkDeclaration<?>> watermarkDeclarationMap

    • eventTimeWatermarkHandler

      protected transient org.apache.flink.streaming.runtime.watermark.extension.eventtime.EventTimeWatermarkHandler eventTimeWatermarkHandler

  • Constructor Details

    • ProcessOperator

      public ProcessOperator(org.apache.flink.datastream.api.function.OneInputStreamProcessFunction<IN,OUT> userFunction)

  • Method Details

    • open

      public void open() throws Exception
      Specified by:
      open in interface org.apache.flink.streaming.api.operators.StreamOperator<IN>
      Overrides:
      open in class org.apache.flink.runtime.asyncprocessing.operators.AbstractAsyncStateUdfStreamOperator<OUT,org.apache.flink.datastream.api.function.OneInputStreamProcessFunction<IN,OUT>>
      Throws:
      Exception

    • processElement

      public void processElement(org.apache.flink.streaming.runtime.streamrecord.StreamRecord<IN> element) throws Exception
      Specified by:
      processElement in interface org.apache.flink.streaming.api.operators.Input<IN>
      Throws:
      Exception

    • processWatermarkInternal

      public void processWatermarkInternal(org.apache.flink.runtime.event.WatermarkEvent watermark) throws Exception
      Overrides:
      processWatermarkInternal in class org.apache.flink.runtime.asyncprocessing.operators.AbstractAsyncStateStreamOperator<OUT>
      Throws:
      Exception

    • getOutputCollector

      protected TimestampCollector<OUT> getOutputCollector()

    • endInput

      public void endInput() throws Exception
      Specified by:
      endInput in interface org.apache.flink.streaming.api.operators.BoundedOneInput
      Throws:
      Exception

    • currentKey

      protected Object currentKey()

    • getProcessorWithKey

      protected BiConsumer<Runnable,Object> getProcessorWithKey()

    • getProcessingTimeManager

      protected org.apache.flink.datastream.api.context.ProcessingTimeManager getProcessingTimeManager()

    • getNonPartitionedContext

      protected org.apache.flink.datastream.api.context.NonPartitionedContext<OUT> getNonPartitionedContext()

    • close

      public void close() throws Exception
      Specified by:
      close in interface org.apache.flink.streaming.api.operators.StreamOperator<IN>
      Overrides:
      close in class org.apache.flink.runtime.asyncprocessing.operators.AbstractAsyncStateUdfStreamOperator<OUT,org.apache.flink.datastream.api.function.OneInputStreamProcessFunction<IN,OUT>>
      Throws:
      Exception

    • isAsyncStateProcessingEnabled

      public boolean isAsyncStateProcessingEnabled()
      Specified by:
      isAsyncStateProcessingEnabled in interface org.apache.flink.streaming.runtime.operators.asyncprocessing.AsyncStateProcessing
      Overrides:
      isAsyncStateProcessingEnabled in class org.apache.flink.runtime.asyncprocessing.operators.AbstractAsyncStateStreamOperator<OUT>

    • getTimerService

      protected org.apache.flink.streaming.api.operators.InternalTimerService<org.apache.flink.runtime.state.VoidNamespace> getTimerService()

    • getEventTimeSupplier

      protected Supplier<Long> getEventTimeSupplier()