Uses of Class
org.apache.flink.streaming.runtime.partitioner.StreamPartitioner
Packages that use StreamPartitioner
Package
Description
-
Uses of StreamPartitioner in org.apache.flink.streaming.api.datastream
Methods in org.apache.flink.streaming.api.datastream with parameters of type StreamPartitionerModifier and TypeMethodDescriptionprotected DataStream<T>DataStream.setConnectionType(StreamPartitioner<T> partitioner) Internal function for setting the partitioner for the DataStream.protected DataStream<T>KeyedStream.setConnectionType(StreamPartitioner<T> partitioner) -
Uses of StreamPartitioner in org.apache.flink.streaming.api.graph
Methods in org.apache.flink.streaming.api.graph that return StreamPartitionerModifier and TypeMethodDescriptionDefaultStreamGraphContext.getOutputPartitioner(String edgeId, Integer sourceId, Integer targetId) StreamGraphContext.getOutputPartitioner(String edgeId, Integer sourceId, Integer targetId) Gets the output partitioner of the specified edge.NonChainedOutput.getPartitioner()StreamEdge.getPartitioner()Methods in org.apache.flink.streaming.api.graph with parameters of type StreamPartitionerModifier and TypeMethodDescriptionvoidStreamGraph.addVirtualPartitionNode(Integer originalId, Integer virtualId, StreamPartitioner<?> partitioner, StreamExchangeMode exchangeMode) Adds a new virtual node that is used to connect a downstream vertex to an input with a certain partitioning.voidNonChainedOutput.setPartitioner(StreamPartitioner<?> partitioner) voidStreamEdge.setPartitioner(StreamPartitioner<?> partitioner) Constructors in org.apache.flink.streaming.api.graph with parameters of type StreamPartitionerModifierConstructorDescriptionNonChainedOutput(boolean supportsUnalignedCheckpoints, int sourceNodeId, int consumerParallelism, int consumerMaxParallelism, long bufferTimeout, boolean isPersistentDataSet, IntermediateDataSetID dataSetId, org.apache.flink.util.OutputTag<?> outputTag, StreamPartitioner<?> partitioner, ResultPartitionType partitionType) StreamEdge(StreamNode sourceVertex, StreamNode targetVertex, int typeNumber, long bufferTimeout, StreamPartitioner<?> outputPartitioner, org.apache.flink.util.OutputTag outputTag, StreamExchangeMode exchangeMode, int uniqueId, IntermediateDataSetID intermediateDatasetId) StreamEdge(StreamNode sourceVertex, StreamNode targetVertex, int typeNumber, StreamPartitioner<?> outputPartitioner, org.apache.flink.util.OutputTag outputTag) StreamEdge(StreamNode sourceVertex, StreamNode targetVertex, int typeNumber, StreamPartitioner<?> outputPartitioner, org.apache.flink.util.OutputTag outputTag, StreamExchangeMode exchangeMode, int uniqueId, IntermediateDataSetID intermediateDatasetId) -
Uses of StreamPartitioner in org.apache.flink.streaming.api.graph.util
Methods in org.apache.flink.streaming.api.graph.util that return StreamPartitionerMethods in org.apache.flink.streaming.api.graph.util with parameters of type StreamPartitionerModifier and TypeMethodDescriptionStreamEdgeUpdateRequestInfo.withOutputPartitioner(StreamPartitioner<?> outputPartitioner) -
Uses of StreamPartitioner in org.apache.flink.streaming.api.transformations
Methods in org.apache.flink.streaming.api.transformations that return StreamPartitionerModifier and TypeMethodDescriptionPartitionTransformation.getPartitioner()Returns theStreamPartitionerthat must be used for partitioning the elements of the inputTransformation.Constructors in org.apache.flink.streaming.api.transformations with parameters of type StreamPartitionerModifierConstructorDescriptionPartitionTransformation(org.apache.flink.api.dag.Transformation<T> input, StreamPartitioner<T> partitioner) Creates a newPartitionTransformationfrom the given input andStreamPartitioner.PartitionTransformation(org.apache.flink.api.dag.Transformation<T> input, StreamPartitioner<T> partitioner, StreamExchangeMode exchangeMode) Creates a newPartitionTransformationfrom the given input andStreamPartitioner. -
Uses of StreamPartitioner in org.apache.flink.streaming.runtime.io
Method parameters in org.apache.flink.streaming.runtime.io with type arguments of type StreamPartitionerModifier and TypeMethodDescriptionstatic StreamMultipleInputProcessorStreamMultipleInputProcessorFactory.create(TaskInvokable ownerTask, CheckpointedInputGate[] checkpointedInputGates, StreamConfig.InputConfig[] configuredInputs, IOManager ioManager, MemoryManager memoryManager, TaskIOMetricGroup ioMetricGroup, org.apache.flink.metrics.Counter mainOperatorRecordsIn, MultipleInputStreamOperator<?> mainOperator, WatermarkGauge[] inputWatermarkGauges, StreamConfig streamConfig, org.apache.flink.configuration.Configuration taskManagerConfig, org.apache.flink.configuration.Configuration jobConfig, org.apache.flink.api.common.ExecutionConfig executionConfig, ClassLoader userClassloader, OperatorChain<?, ?> operatorChain, InflightDataRescalingDescriptor inflightDataRescalingDescriptor, Function<Integer, StreamPartitioner<?>> gatePartitioners, org.apache.flink.api.common.TaskInfo taskInfo, StreamTask.CanEmitBatchOfRecordsChecker canEmitBatchOfRecords) static <T> StreamTaskInput<T>StreamTaskNetworkInputFactory.create(CheckpointedInputGate checkpointedInputGate, org.apache.flink.api.common.typeutils.TypeSerializer<T> inputSerializer, IOManager ioManager, StatusWatermarkValve statusWatermarkValve, int inputIndex, InflightDataRescalingDescriptor rescalingDescriptorinflightDataRescalingDescriptor, Function<Integer, StreamPartitioner<?>> gatePartitioners, org.apache.flink.api.common.TaskInfo taskInfo, StreamTask.CanEmitBatchOfRecordsChecker canEmitBatchOfRecords, Set<AbstractInternalWatermarkDeclaration<?>> watermarkDeclarationSet) Factory method forStreamTaskNetworkInputorRescalingStreamTaskNetworkInputdepending onInflightDataRescalingDescriptor.static <IN1,IN2> StreamMultipleInputProcessor StreamTwoInputProcessorFactory.create(TaskInvokable ownerTask, CheckpointedInputGate[] checkpointedInputGates, IOManager ioManager, MemoryManager memoryManager, TaskIOMetricGroup taskIOMetricGroup, TwoInputStreamOperator<IN1, IN2, ?> streamOperator, WatermarkGauge input1WatermarkGauge, WatermarkGauge input2WatermarkGauge, OperatorChain<?, ?> operatorChain, StreamConfig streamConfig, org.apache.flink.configuration.Configuration taskManagerConfig, org.apache.flink.configuration.Configuration jobConfig, org.apache.flink.api.common.ExecutionConfig executionConfig, ClassLoader userClassloader, org.apache.flink.metrics.Counter numRecordsIn, InflightDataRescalingDescriptor inflightDataRescalingDescriptor, Function<Integer, StreamPartitioner<?>> gatePartitioners, org.apache.flink.api.common.TaskInfo taskInfo, StreamTask.CanEmitBatchOfRecordsChecker canEmitBatchOfRecords) -
Uses of StreamPartitioner in org.apache.flink.streaming.runtime.io.recovery
Constructor parameters in org.apache.flink.streaming.runtime.io.recovery with type arguments of type StreamPartitionerModifierConstructorDescriptionRescalingStreamTaskNetworkInput(CheckpointedInputGate checkpointedInputGate, org.apache.flink.api.common.typeutils.TypeSerializer<T> inputSerializer, IOManager ioManager, StatusWatermarkValve statusWatermarkValve, int inputIndex, InflightDataRescalingDescriptor inflightDataRescalingDescriptor, Function<Integer, StreamPartitioner<?>> gatePartitioners, org.apache.flink.api.common.TaskInfo taskInfo, StreamTask.CanEmitBatchOfRecordsChecker canEmitBatchOfRecords) -
Uses of StreamPartitioner in org.apache.flink.streaming.runtime.partitioner
Subclasses of StreamPartitioner in org.apache.flink.streaming.runtime.partitionerModifier and TypeClassDescriptionclassPartitioner that selects all the output channels.classPartitioner that selects the channel with a user defined partitioner function on a key.classIf there are multiple consecutive and the same hash shuffles, SQL planner will change them except the first one to use forward partitioner, so that these operators can be chained to reduce unnecessary shuffles.classWhen the parallelism of both upstream and downstream isExecutionConfig.PARALLELISM_DEFAULTand the edge's partitioner is not specified (partitioner==null), the edge's partitioner will be set to FORWARD by default(SeeStreamGraph.createActualEdge(java.lang.Integer, java.lang.Integer, int, org.apache.flink.streaming.runtime.partitioner.StreamPartitioner<?>, org.apache.flink.util.OutputTag, org.apache.flink.streaming.api.transformations.StreamExchangeMode, org.apache.flink.runtime.jobgraph.IntermediateDataSetID)method for details).classPartitioner that forwards elements only to the locally running downstream operation.classPartitioner that sends all elements to the downstream operator with subtask ID=0.classPartitioner selects the target channel based on the key group index.classPartitioner that distributes the data equally by cycling through the output channels.classPartitioner that distributes the data equally by cycling through the output channels.classPartitioner that distributes the data equally by selecting one output channel randomly.Methods in org.apache.flink.streaming.runtime.partitioner that return StreamPartitionerModifier and TypeMethodDescriptionBroadcastPartitioner.copy()CustomPartitionerWrapper.copy()ForwardForConsecutiveHashPartitioner.copy()ForwardForUnspecifiedPartitioner.copy()ForwardPartitioner.copy()GlobalPartitioner.copy()KeyGroupStreamPartitioner.copy()RebalancePartitioner.copy()RescalePartitioner.copy()ShufflePartitioner.copy()abstract StreamPartitioner<T>StreamPartitioner.copy()ForwardForConsecutiveHashPartitioner.getHashPartitioner()Constructors in org.apache.flink.streaming.runtime.partitioner with parameters of type StreamPartitionerModifierConstructorDescriptionForwardForConsecutiveHashPartitioner(StreamPartitioner<T> hashPartitioner) Create a new ForwardForConsecutiveHashPartitioner. -
Uses of StreamPartitioner in org.apache.flink.streaming.runtime.tasks
Method parameters in org.apache.flink.streaming.runtime.tasks with type arguments of type StreamPartitionerModifier and TypeMethodDescriptionprotected abstract voidAbstractTwoInputStreamTask.createInputProcessor(List<IndexedInputGate> inputGates1, List<IndexedInputGate> inputGates2, Function<Integer, StreamPartitioner<?>> gatePartitioners) protected voidMultipleInputStreamTask.createInputProcessor(List<IndexedInputGate>[] inputGates, StreamConfig.InputConfig[] inputs, WatermarkGauge[] inputWatermarkGauges, Function<Integer, StreamPartitioner<?>> gatePartitioners) protected voidTwoInputStreamTask.createInputProcessor(List<IndexedInputGate> inputGates1, List<IndexedInputGate> inputGates2, Function<Integer, StreamPartitioner<?>> gatePartitioners)