Package org.apache.flink.python.util

Class PythonConfigUtil

java.lang.Object

org.apache.flink.python.util.PythonConfigUtil

public class PythonConfigUtil
extends Object

A Util class to handle the configurations of Python jobs.

Field Summary

Fields

Modifier and Type	Field	Description
static final String	KEYED_STREAM_VALUE_OPERATOR_NAME
static final String	STREAM_KEY_BY_MAP_OPERATOR_NAME
static final String	STREAM_PARTITION_CUSTOM_MAP_OPERATOR_NAME

Constructor Summary

Constructors

Constructor	Description
PythonConfigUtil()

Method Summary

Modifier and Type	Method	Description
static void	configPythonOperator(org.apache.flink.streaming.api.environment.StreamExecutionEnvironment env)
static List<org.apache.flink.api.common.state.MapStateDescriptor<ByteArrayWrapper,byte[]>>	convertStateNamesToStateDescriptors(String[] names)
static org.apache.flink.streaming.api.datastream.SingleOutputStreamOperator<?>	createSingleOutputStreamOperator(org.apache.flink.streaming.api.environment.StreamExecutionEnvironment env, org.apache.flink.api.dag.Transformation<?> transformation)
static org.apache.flink.configuration.Configuration	extractPythonConfiguration(org.apache.flink.configuration.ReadableConfig config)	Extract the configurations which is used in the Python operators.
static org.apache.flink.configuration.Configuration	getEnvironmentConfig(org.apache.flink.streaming.api.environment.StreamExecutionEnvironment env)
static org.apache.flink.streaming.api.operators.StreamOperatorFactory<?>	getOperatorFactory(org.apache.flink.api.dag.Transformation<?> transform)
static boolean	isPythonDataStreamOperator(org.apache.flink.api.dag.Transformation<?> transform)
static void	registerPythonBroadcastTransformationTranslator()
static void	setPartitionCustomOperatorNumPartitions(List<org.apache.flink.api.dag.Transformation<?>> transformations)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Details

KEYED_STREAM_VALUE_OPERATOR_NAME

public static final String KEYED_STREAM_VALUE_OPERATOR_NAME

See Also:

• Constant Field Values

STREAM_KEY_BY_MAP_OPERATOR_NAME

public static final String STREAM_KEY_BY_MAP_OPERATOR_NAME

See Also:

• Constant Field Values

STREAM_PARTITION_CUSTOM_MAP_OPERATOR_NAME

public static final String STREAM_PARTITION_CUSTOM_MAP_OPERATOR_NAME

See Also:

• Constant Field Values

Constructor Details

PythonConfigUtil

public PythonConfigUtil()

Method Details

getEnvironmentConfig

public static org.apache.flink.configuration.Configuration getEnvironmentConfig(org.apache.flink.streaming.api.environment.StreamExecutionEnvironment env)

configPythonOperator

public static void configPythonOperator(org.apache.flink.streaming.api.environment.StreamExecutionEnvironment env)
                                 throws Exception

Throws:

Exception

extractPythonConfiguration

public static org.apache.flink.configuration.Configuration extractPythonConfiguration(org.apache.flink.configuration.ReadableConfig config)

Extract the configurations which is used in the Python operators.

getOperatorFactory

public static org.apache.flink.streaming.api.operators.StreamOperatorFactory<?> getOperatorFactory(org.apache.flink.api.dag.Transformation<?> transform)

isPythonDataStreamOperator

public static boolean isPythonDataStreamOperator(org.apache.flink.api.dag.Transformation<?> transform)

setPartitionCustomOperatorNumPartitions

public static void setPartitionCustomOperatorNumPartitions(List<org.apache.flink.api.dag.Transformation<?>> transformations)

convertStateNamesToStateDescriptors

public static List<org.apache.flink.api.common.state.MapStateDescriptor<ByteArrayWrapper,byte[]>> convertStateNamesToStateDescriptors(String[] names)

registerPythonBroadcastTransformationTranslator

public static void registerPythonBroadcastTransformationTranslator()
                                                            throws Exception

Throws:

Exception

createSingleOutputStreamOperator

public static org.apache.flink.streaming.api.datastream.SingleOutputStreamOperator<?> createSingleOutputStreamOperator(org.apache.flink.streaming.api.environment.StreamExecutionEnvironment env,
 org.apache.flink.api.dag.Transformation<?> transformation)
                                                                                                                throws Exception

Throws:

Exception