Package org.apache.flink.table.runtime.operators.python

Class AbstractEmbeddedStatelessFunctionOperator

java.lang.Object
org.apache.flink.streaming.api.operators.AbstractStreamOperator<OUT>
org.apache.flink.streaming.api.operators.python.AbstractPythonFunctionOperator<OUT>
org.apache.flink.streaming.api.operators.python.embedded.AbstractEmbeddedPythonFunctionOperator<org.apache.flink.table.data.RowData>
org.apache.flink.table.runtime.operators.python.AbstractEmbeddedStatelessFunctionOperator
All Implemented Interfaces:
Serializable, org.apache.flink.api.common.state.CheckpointListener, org.apache.flink.streaming.api.operators.BoundedOneInput, org.apache.flink.streaming.api.operators.Input<org.apache.flink.table.data.RowData>, org.apache.flink.streaming.api.operators.KeyContext, org.apache.flink.streaming.api.operators.KeyContextHandler, org.apache.flink.streaming.api.operators.OneInputStreamOperator<org.apache.flink.table.data.RowData,org.apache.flink.table.data.RowData>, org.apache.flink.streaming.api.operators.StreamOperator<org.apache.flink.table.data.RowData>, org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.CheckpointedStreamOperator, org.apache.flink.streaming.api.operators.YieldingOperator<org.apache.flink.table.data.RowData>
Direct Known Subclasses:
EmbeddedPythonScalarFunctionOperator, EmbeddedPythonTableFunctionOperator
@Internal public abstract class AbstractEmbeddedStatelessFunctionOperator extends AbstractEmbeddedPythonFunctionOperator<org.apache.flink.table.data.RowData> implements org.apache.flink.streaming.api.operators.OneInputStreamOperator<org.apache.flink.table.data.RowData,org.apache.flink.table.data.RowData>, org.apache.flink.streaming.api.operators.BoundedOneInput
Base class for all stream operators to execute Python Stateless Functions in embedded Python environment.
See Also:

  • Field Summary

    Fields
    Modifier and Type
    Field
    Description
    protected final org.apache.flink.table.types.logical.RowType
    inputType
    The input logical type.
    protected org.apache.flink.table.data.GenericRowData
    reuseResultRowData
    The GenericRowData reused holding the execution result of python udf.
    protected StreamRecordRowDataWrappingCollector
    rowDataWrapper
    The collector used to collect records.
    protected final int[]
    udfInputOffsets
    The offsets of user-defined function inputs.
    protected final org.apache.flink.table.types.logical.RowType
    udfInputType
    The user-defined function input logical type.
    protected final org.apache.flink.table.types.logical.RowType
    udfOutputType
    The user-defined function output logical type.
    protected Object[]
    userDefinedFunctionInputArgs
     
    protected PythonTypeUtils.DataConverter[]
    userDefinedFunctionInputConverters
     
    protected PythonTypeUtils.DataConverter[]
    userDefinedFunctionOutputConverters
     

    Fields inherited from class org.apache.flink.streaming.api.operators.python.embedded.AbstractEmbeddedPythonFunctionOperator

    interpreter

    Fields inherited from class org.apache.flink.streaming.api.operators.python.AbstractPythonFunctionOperator

    bundleFinishedCallback, config, elementCount, lastFinishBundleTime, maxBundleSize, systemEnvEnabled

    Fields inherited from class org.apache.flink.streaming.api.operators.AbstractStreamOperator

    combinedWatermark, lastRecordAttributes1, lastRecordAttributes2, latencyStats, LOG, metrics, output, processingTimeService, stateHandler, stateKeySelector1, stateKeySelector2, timeServiceManager

  • Constructor Summary

    Constructors
    Constructor
    Description
    AbstractEmbeddedStatelessFunctionOperator(org.apache.flink.configuration.Configuration config, org.apache.flink.table.types.logical.RowType inputType, org.apache.flink.table.types.logical.RowType udfInputType, org.apache.flink.table.types.logical.RowType udfOutputType, int[] udfInputOffsets)
     

  • Method Summary

    Modifier and Type
    Method
    Description
    void
    open()
     

    Methods inherited from class org.apache.flink.streaming.api.operators.python.embedded.AbstractEmbeddedPythonFunctionOperator

    close, createPythonEnvironmentManager, invokeFinishBundle, openPythonInterpreter

    Methods inherited from class org.apache.flink.streaming.api.operators.python.AbstractPythonFunctionOperator

    checkInvokeFinishBundleByCount, drainUnregisteredTimers, finish, getConfiguration, getFlinkMetricContainer, isBundleFinished, prepareSnapshotPreBarrier, processWatermark, setCurrentKey

    Methods inherited from class org.apache.flink.streaming.api.operators.AbstractStreamOperator

    beforeInitializeStateHandler, getContainingTask, getCurrentKey, getExecutionConfig, getInternalTimerService, getKeyedStateBackend, getKeyedStateStore, getMetricGroup, getOperatorConfig, getOperatorID, getOperatorName, getOperatorStateBackend, getOrCreateKeyedState, getPartitionedState, getPartitionedState, getProcessingTimeService, getRuntimeContext, getStateKeySelector1, getStateKeySelector2, getTimeServiceManager, getUserCodeClassloader, hasKeyContext1, hasKeyContext2, initializeState, initializeState, isAsyncStateProcessingEnabled, isUsingCustomRawKeyedState, notifyCheckpointAborted, notifyCheckpointComplete, processLatencyMarker, processLatencyMarker1, processLatencyMarker2, processRecordAttributes, processRecordAttributes1, processRecordAttributes2, processWatermark, processWatermark1, processWatermark1, processWatermark2, processWatermark2, processWatermarkStatus, processWatermarkStatus, processWatermarkStatus1, processWatermarkStatus2, reportOrForwardLatencyMarker, setKeyContextElement1, setKeyContextElement2, setMailboxExecutor, setProcessingTimeService, setup, snapshotState, snapshotState, useSplittableTimers

    Methods inherited from class java.lang.Object

    clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

    Methods inherited from interface org.apache.flink.streaming.api.operators.BoundedOneInput

    endInput

    Methods inherited from interface org.apache.flink.api.common.state.CheckpointListener

    notifyCheckpointAborted, notifyCheckpointComplete

    Methods inherited from interface org.apache.flink.streaming.api.operators.Input

    processElement, processLatencyMarker, processRecordAttributes, processWatermark, processWatermark, processWatermarkStatus

    Methods inherited from interface org.apache.flink.streaming.api.operators.KeyContext

    getCurrentKey, setCurrentKey

    Methods inherited from interface org.apache.flink.streaming.api.operators.KeyContextHandler

    hasKeyContext

    Methods inherited from interface org.apache.flink.streaming.api.operators.OneInputStreamOperator

    setKeyContextElement

    Methods inherited from interface org.apache.flink.streaming.api.operators.StreamOperator

    close, finish, getMetricGroup, getOperatorAttributes, getOperatorID, initializeState, prepareSnapshotPreBarrier, setKeyContextElement1, setKeyContextElement2, snapshotState

  • Field Details

    • udfInputOffsets

      protected final int[] udfInputOffsets
      The offsets of user-defined function inputs.

    • inputType

      protected final org.apache.flink.table.types.logical.RowType inputType
      The input logical type.

    • udfInputType

      protected final org.apache.flink.table.types.logical.RowType udfInputType
      The user-defined function input logical type.

    • udfOutputType

      protected final org.apache.flink.table.types.logical.RowType udfOutputType
      The user-defined function output logical type.

    • reuseResultRowData

      protected transient org.apache.flink.table.data.GenericRowData reuseResultRowData
      The GenericRowData reused holding the execution result of python udf.

    • rowDataWrapper

      protected transient StreamRecordRowDataWrappingCollector rowDataWrapper
      The collector used to collect records.

    • userDefinedFunctionInputConverters

      protected transient PythonTypeUtils.DataConverter[] userDefinedFunctionInputConverters

    • userDefinedFunctionInputArgs

      protected transient Object[] userDefinedFunctionInputArgs

    • userDefinedFunctionOutputConverters

      protected transient PythonTypeUtils.DataConverter[] userDefinedFunctionOutputConverters

  • Constructor Details

    • AbstractEmbeddedStatelessFunctionOperator

      public AbstractEmbeddedStatelessFunctionOperator(org.apache.flink.configuration.Configuration config, org.apache.flink.table.types.logical.RowType inputType, org.apache.flink.table.types.logical.RowType udfInputType, org.apache.flink.table.types.logical.RowType udfOutputType, int[] udfInputOffsets)

  • Method Details