Package org.apache.flink.streaming.api.transformations.python

Class DelegateOperatorTransformation.DelegateOperator<OUT>

java.lang.Object

org.apache.flink.streaming.api.operators.AbstractStreamOperator<OUT>

org.apache.flink.streaming.api.operators.python.AbstractPythonFunctionOperator<OUT>

org.apache.flink.streaming.api.transformations.python.DelegateOperatorTransformation.DelegateOperator<OUT>

All Implemented Interfaces:

Serializable, org.apache.flink.api.common.state.CheckpointListener, org.apache.flink.api.java.typeutils.ResultTypeQueryable<OUT>, org.apache.flink.streaming.api.operators.KeyContext, org.apache.flink.streaming.api.operators.KeyContextHandler, DataStreamPythonFunctionOperator<OUT>, org.apache.flink.streaming.api.operators.StreamOperator<OUT>, org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.CheckpointedStreamOperator, org.apache.flink.streaming.api.operators.YieldingOperator<OUT>

Enclosing interface:

DelegateOperatorTransformation<OUT>

public static class DelegateOperatorTransformation.DelegateOperator<OUT>
extends AbstractPythonFunctionOperator<OUT>
implements DataStreamPythonFunctionOperator<OUT>

DelegateOperatorTransformation.DelegateOperator holds configurations, e.g. OutputTags, which will be applied to the actual python operator at translation stage.

See Also:

• Serialized Form

Field Summary

Fields inherited from class org.apache.flink.streaming.api.operators.python.AbstractPythonFunctionOperator

bundleFinishedCallback, config, elementCount, lastFinishBundleTime, maxBundleSize, systemEnvEnabled

Fields inherited from class org.apache.flink.streaming.api.operators.AbstractStreamOperator

combinedWatermark, lastRecordAttributes1, lastRecordAttributes2, latencyStats, LOG, metrics, output, processingTimeService, stateHandler, stateKeySelector1, stateKeySelector2, timeServiceManager

Constructor Summary

Constructors

Constructor	Description
DelegateOperator()

Method Summary

Modifier and Type	Method	Description
void	addSideOutputTags(Collection<org.apache.flink.util.OutputTag<?>> outputTags)	Add a collection of OutputTags to the operator.
<T> DataStreamPythonFunctionOperator<T>	copy(DataStreamPythonFunctionInfo pythonFunctionInfo, org.apache.flink.api.common.typeinfo.TypeInformation<T> outputTypeInfo)	Make a copy of the DataStreamPythonFunctionOperator with the given pythonFunctionInfo and outputTypeInfo.
protected PythonEnvironmentManager	createPythonEnvironmentManager()
Integer	getNumPartitions()
org.apache.flink.api.common.typeinfo.TypeInformation<OUT>	getProducedType()
DataStreamPythonFunctionInfo	getPythonFunctionInfo()	Returns the underlying DataStreamPythonFunctionInfo.
Collection<org.apache.flink.util.OutputTag<?>>	getSideOutputTags()	Gets the OutputTags belongs to the operator.
protected void	invokeFinishBundle()
void	setNumPartitions(int numPartitions)	Sets the number of partitions.

Methods inherited from class org.apache.flink.streaming.api.operators.python.AbstractPythonFunctionOperator

checkInvokeFinishBundleByCount, close, drainUnregisteredTimers, finish, getConfiguration, getFlinkMetricContainer, isBundleFinished, open, prepareSnapshotPreBarrier, processWatermark, setCurrentKey

Methods inherited from class org.apache.flink.streaming.api.operators.AbstractStreamOperator

beforeInitializeStateHandler, getContainingTask, getCurrentKey, getExecutionConfig, getInternalTimerService, getKeyedStateBackend, getKeyedStateStore, getMetricGroup, getOperatorConfig, getOperatorID, getOperatorName, getOperatorStateBackend, getOrCreateKeyedState, getPartitionedState, getPartitionedState, getProcessingTimeService, getRuntimeContext, getStateKeySelector1, getStateKeySelector2, getTimeServiceManager, getUserCodeClassloader, hasKeyContext1, hasKeyContext2, initializeState, initializeState, isAsyncStateProcessingEnabled, isUsingCustomRawKeyedState, notifyCheckpointAborted, notifyCheckpointComplete, processLatencyMarker, processLatencyMarker1, processLatencyMarker2, processRecordAttributes, processRecordAttributes1, processRecordAttributes2, processWatermark, processWatermark1, processWatermark1, processWatermark2, processWatermark2, processWatermarkStatus, processWatermarkStatus, processWatermarkStatus1, processWatermarkStatus2, reportOrForwardLatencyMarker, setKeyContextElement1, setKeyContextElement2, setMailboxExecutor, setProcessingTimeService, setup, snapshotState, snapshotState, useSplittableTimers

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface org.apache.flink.streaming.api.operators.KeyContextHandler

hasKeyContext

Methods inherited from interface org.apache.flink.streaming.api.operators.StreamOperator

getOperatorAttributes

Constructor Details

DelegateOperator

public DelegateOperator()

Method Details

addSideOutputTags

public void addSideOutputTags(Collection<org.apache.flink.util.OutputTag<?>> outputTags)

Description copied from interface: DataStreamPythonFunctionOperator

Add a collection of OutputTags to the operator.

Specified by:

addSideOutputTags in interface DataStreamPythonFunctionOperator<OUT>

getSideOutputTags

public Collection<org.apache.flink.util.OutputTag<?>> getSideOutputTags()

Description copied from interface: DataStreamPythonFunctionOperator

Gets the OutputTags belongs to the operator.

Specified by:

getSideOutputTags in interface DataStreamPythonFunctionOperator<OUT>

setNumPartitions

public void setNumPartitions(int numPartitions)

Description copied from interface: DataStreamPythonFunctionOperator

Sets the number of partitions. This is used for partitionCustom which takes the number of partitions to partition into as input.

Specified by:

setNumPartitions in interface DataStreamPythonFunctionOperator<OUT>

getNumPartitions

@Nullable
public Integer getNumPartitions()

getProducedType

public org.apache.flink.api.common.typeinfo.TypeInformation<OUT> getProducedType()

Specified by:

getProducedType in interface org.apache.flink.api.java.typeutils.ResultTypeQueryable<OUT>

getPythonFunctionInfo

public DataStreamPythonFunctionInfo getPythonFunctionInfo()

Description copied from interface: DataStreamPythonFunctionOperator

Returns the underlying DataStreamPythonFunctionInfo.

Specified by:

getPythonFunctionInfo in interface DataStreamPythonFunctionOperator<OUT>

copy

public <T> DataStreamPythonFunctionOperator<T> copy(DataStreamPythonFunctionInfo pythonFunctionInfo,
 org.apache.flink.api.common.typeinfo.TypeInformation<T> outputTypeInfo)

Description copied from interface: DataStreamPythonFunctionOperator

Make a copy of the DataStreamPythonFunctionOperator with the given pythonFunctionInfo and outputTypeInfo. This is used for chaining optimization which may need to update the underlying pythonFunctionInfo and outputTypeInfo with the other fields not changed.

Specified by:

copy in interface DataStreamPythonFunctionOperator<OUT>

invokeFinishBundle

protected void invokeFinishBundle()
                           throws Exception

Specified by:

invokeFinishBundle in class AbstractPythonFunctionOperator<OUT>

Throws:

Exception

createPythonEnvironmentManager

protected PythonEnvironmentManager createPythonEnvironmentManager()

Specified by:

createPythonEnvironmentManager in class AbstractPythonFunctionOperator<OUT>