Package org.apache.flink.table.planner.plan.nodes.exec.batch

Class BatchExecLookupJoin

java.lang.Object

org.apache.flink.table.planner.plan.nodes.exec.ExecNodeBase<org.apache.flink.table.data.RowData>

org.apache.flink.table.planner.plan.nodes.exec.common.CommonExecLookupJoin

org.apache.flink.table.planner.plan.nodes.exec.batch.BatchExecLookupJoin

All Implemented Interfaces:

BatchExecNode<org.apache.flink.table.data.RowData>, ExecNode<org.apache.flink.table.data.RowData>, ExecNodeTranslator<org.apache.flink.table.data.RowData>, FusionCodegenExecNode, SingleTransformationTranslator<org.apache.flink.table.data.RowData>

@ExecNodeMetadata(name="batch-exec-lookup-join",
                  version=1,
                  producedTransformations="lookup-join",
                  consumedOptions={"table.exec.async-lookup.buffer-capacity","table.exec.async-lookup.timeout","table.exec.async-lookup.output-mode"},
                  minPlanVersion=v2_0,
                  minStateVersion=v2_0)
public class BatchExecLookupJoin
extends CommonExecLookupJoin
implements BatchExecNode<org.apache.flink.table.data.RowData>, SingleTransformationTranslator<org.apache.flink.table.data.RowData>

BatchExecNode for temporal table join that implemented by lookup.

Field Summary

Fields inherited from class org.apache.flink.table.planner.plan.nodes.exec.common.CommonExecLookupJoin

CUSTOM_SHUFFLE_TRANSFORMATION, FIELD_NAME_ASYNC_OPTIONS, FIELD_NAME_FILTER_ON_TEMPORAL_TABLE, FIELD_NAME_INPUT_CHANGELOG_MODE, FIELD_NAME_JOIN_TYPE, FIELD_NAME_LOOKUP_KEYS, FIELD_NAME_PRE_FILTER_CONDITION, FIELD_NAME_PREFER_CUSTOM_SHUFFLE, FIELD_NAME_PROJECTION_ON_TEMPORAL_TABLE, FIELD_NAME_REMAINING_JOIN_CONDITION, FIELD_NAME_RETRY_OPTIONS, FIELD_NAME_TEMPORAL_TABLE, LOOKUP_JOIN_MATERIALIZE_TRANSFORMATION, LOOKUP_JOIN_TRANSFORMATION

Fields inherited from interface org.apache.flink.table.planner.plan.nodes.exec.ExecNode

FIELD_NAME_CONFIGURATION, FIELD_NAME_DESCRIPTION, FIELD_NAME_ID, FIELD_NAME_INPUT_PROPERTIES, FIELD_NAME_OUTPUT_TYPE, FIELD_NAME_STATE, FIELD_NAME_TYPE

Constructor Summary

Constructors

Constructor	Description
BatchExecLookupJoin(int id, ExecNodeContext context, org.apache.flink.configuration.ReadableConfig persistedConfig, org.apache.flink.table.runtime.operators.join.FlinkJoinType joinType, org.apache.calcite.rex.RexNode preFilterCondition, org.apache.calcite.rex.RexNode remainingJoinCondition, TemporalTableSourceSpec temporalTableSourceSpec, Map<Integer,LookupJoinUtil.LookupKey> lookupKeys, List<org.apache.calcite.rex.RexNode> projectionOnTemporalTable, org.apache.calcite.rex.RexNode filterOnTemporalTable, LookupJoinUtil.AsyncLookupOptions asyncLookupOptions, List<InputProperty> inputProperties, org.apache.flink.table.types.logical.RowType outputType, String description, boolean preferCustomShuffle)
BatchExecLookupJoin(org.apache.flink.configuration.ReadableConfig tableConfig, org.apache.flink.table.runtime.operators.join.FlinkJoinType joinType, org.apache.calcite.rex.RexNode preFilterCondition, org.apache.calcite.rex.RexNode remainingJoinCondition, TemporalTableSourceSpec temporalTableSourceSpec, Map<Integer,LookupJoinUtil.LookupKey> lookupKeys, List<org.apache.calcite.rex.RexNode> projectionOnTemporalTable, org.apache.calcite.rex.RexNode filterOnTemporalTable, LookupJoinUtil.AsyncLookupOptions asyncLookupOptions, InputProperty inputProperty, org.apache.flink.table.types.logical.RowType outputType, String description, boolean preferCustomShuffle)

Method Summary

Modifier and Type	Method	Description
protected org.apache.flink.api.dag.Transformation<org.apache.flink.table.data.RowData>	createSyncLookupJoinWithState(org.apache.flink.api.dag.Transformation<org.apache.flink.table.data.RowData> inputTransformation, org.apache.calcite.plan.RelOptTable temporalTable, ExecNodeConfig config, ClassLoader classLoader, Map<Integer,LookupJoinUtil.LookupKey> allLookupKeys, org.apache.flink.table.functions.TableFunction<?> syncLookupFunction, RelBuilder relBuilder, org.apache.flink.table.types.logical.RowType inputRowType, org.apache.flink.table.types.logical.RowType tableSourceRowType, org.apache.flink.table.types.logical.RowType resultRowType, boolean isLeftOuterJoin, boolean isObjectReuseEnabled, boolean lookupKeyContainsPrimaryKey)
org.apache.flink.api.dag.Transformation<org.apache.flink.table.data.RowData>	translateToPlanInternal(PlannerBase planner, ExecNodeConfig config)	Internal method, translates this node into a Flink operator.

Methods inherited from class org.apache.flink.table.planner.plan.nodes.exec.common.CommonExecLookupJoin

createJoinTransformation, createSyncLookupJoinFunction, getProjectionOutputRelDataType, getRightOutputRowType, getTemporalTableSourceSpec, validateLookupKeyType

Methods inherited from class org.apache.flink.table.planner.plan.nodes.exec.ExecNodeBase

accept, createFormattedTransformationDescription, createFormattedTransformationName, createTransformationDescription, createTransformationMeta, createTransformationMeta, createTransformationName, createTransformationUid, getContextFromAnnotation, getDescription, getId, getInputEdges, getInputProperties, getOutputType, getPersistedConfig, getSimplifiedName, getTransformation, inputsContainSingleton, replaceInputEdge, setCompiled, setInputEdges, supportFusionCodegen, translateToFusionCodegenSpec, translateToFusionCodegenSpecInternal, translateToPlan

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface org.apache.flink.table.planner.plan.nodes.exec.ExecNode

accept, getDescription, getId, getInputEdges, getInputProperties, getOutputType, replaceInputEdge, setCompiled, setInputEdges

Methods inherited from interface org.apache.flink.table.planner.plan.nodes.exec.ExecNodeTranslator

translateToPlan

Methods inherited from interface org.apache.flink.table.planner.plan.nodes.exec.FusionCodegenExecNode

supportFusionCodegen, translateToFusionCodegenSpec

Constructor Details

BatchExecLookupJoin

public BatchExecLookupJoin(org.apache.flink.configuration.ReadableConfig tableConfig,
 org.apache.flink.table.runtime.operators.join.FlinkJoinType joinType,
 @Nullable
 org.apache.calcite.rex.RexNode preFilterCondition,
 @Nullable
 org.apache.calcite.rex.RexNode remainingJoinCondition,
 TemporalTableSourceSpec temporalTableSourceSpec,
 Map<Integer,LookupJoinUtil.LookupKey> lookupKeys,
 @Nullable
 List<org.apache.calcite.rex.RexNode> projectionOnTemporalTable,
 @Nullable
 org.apache.calcite.rex.RexNode filterOnTemporalTable,
 @Nullable
 LookupJoinUtil.AsyncLookupOptions asyncLookupOptions,
 InputProperty inputProperty,
 org.apache.flink.table.types.logical.RowType outputType,
 String description,
 boolean preferCustomShuffle)

BatchExecLookupJoin

public BatchExecLookupJoin(int id,
 ExecNodeContext context,
 org.apache.flink.configuration.ReadableConfig persistedConfig,
 org.apache.flink.table.runtime.operators.join.FlinkJoinType joinType,
 @Nullable
 org.apache.calcite.rex.RexNode preFilterCondition,
 @Nullable
 org.apache.calcite.rex.RexNode remainingJoinCondition,
 TemporalTableSourceSpec temporalTableSourceSpec,
 Map<Integer,LookupJoinUtil.LookupKey> lookupKeys,
 @Nullable
 List<org.apache.calcite.rex.RexNode> projectionOnTemporalTable,
 @Nullable
 org.apache.calcite.rex.RexNode filterOnTemporalTable,
 @Nullable
 LookupJoinUtil.AsyncLookupOptions asyncLookupOptions,
 List<InputProperty> inputProperties,
 org.apache.flink.table.types.logical.RowType outputType,
 String description,
 boolean preferCustomShuffle)

Method Details

translateToPlanInternal

public org.apache.flink.api.dag.Transformation<org.apache.flink.table.data.RowData> translateToPlanInternal(PlannerBase planner,
 ExecNodeConfig config)

Description copied from class: ExecNodeBase

Internal method, translates this node into a Flink operator.

Specified by:

translateToPlanInternal in class ExecNodeBase<org.apache.flink.table.data.RowData>

Parameters:

planner - The planner.

config - per-ExecNode configuration that contains the merged configuration from various layers which all the nodes implementing this method should use, instead of retrieving configuration from the planner. For more details check ExecNodeConfig.

createSyncLookupJoinWithState

protected org.apache.flink.api.dag.Transformation<org.apache.flink.table.data.RowData> createSyncLookupJoinWithState(org.apache.flink.api.dag.Transformation<org.apache.flink.table.data.RowData> inputTransformation,
 org.apache.calcite.plan.RelOptTable temporalTable,
 ExecNodeConfig config,
 ClassLoader classLoader,
 Map<Integer,LookupJoinUtil.LookupKey> allLookupKeys,
 org.apache.flink.table.functions.TableFunction<?> syncLookupFunction,
 RelBuilder relBuilder,
 org.apache.flink.table.types.logical.RowType inputRowType,
 org.apache.flink.table.types.logical.RowType tableSourceRowType,
 org.apache.flink.table.types.logical.RowType resultRowType,
 boolean isLeftOuterJoin,
 boolean isObjectReuseEnabled,
 boolean lookupKeyContainsPrimaryKey)

Specified by:

createSyncLookupJoinWithState in class CommonExecLookupJoin