Uses of Class
org.apache.flink.runtime.scheduler.adaptivebatch.BlockingInputInfo
Packages that use BlockingInputInfo
Package
Description
-
Uses of BlockingInputInfo in org.apache.flink.runtime.scheduler.adaptivebatch
Method parameters in org.apache.flink.runtime.scheduler.adaptivebatch with type arguments of type BlockingInputInfoModifier and TypeMethodDescriptionDefaultVertexParallelismAndInputInfosDecider.decideParallelismAndInputInfosForVertex(JobVertexID jobVertexId, List<BlockingInputInfo> consumedResults, int vertexInitialParallelism, int vertexMinParallelism, int vertexMaxParallelism) VertexParallelismAndInputInfosDecider.decideParallelismAndInputInfosForVertex(JobVertexID jobVertexId, List<BlockingInputInfo> consumedResults, int vertexInitialParallelism, int vertexMinParallelism, int vertexMaxParallelism) Decide the parallelism andJobVertexInputInfos for this job vertex. -
Uses of BlockingInputInfo in org.apache.flink.runtime.scheduler.adaptivebatch.util
Methods in org.apache.flink.runtime.scheduler.adaptivebatch.util that return types with arguments of type BlockingInputInfoModifier and TypeMethodDescriptionstatic List<BlockingInputInfo>VertexParallelismAndInputInfosDeciderUtils.getNonBroadcastInputInfos(List<BlockingInputInfo> consumedResults) Methods in org.apache.flink.runtime.scheduler.adaptivebatch.util with parameters of type BlockingInputInfoModifier and TypeMethodDescriptionstatic JobVertexInputInfoVertexParallelismAndInputInfosDeciderUtils.createdJobVertexInputInfoForBroadcast(BlockingInputInfo inputInfo, int parallelism) static JobVertexInputInfoVertexParallelismAndInputInfosDeciderUtils.createdJobVertexInputInfoForNonBroadcast(BlockingInputInfo inputInfo, List<IndexRange> subpartitionSliceRanges, List<SubpartitionSlice> subpartitionSlices) static voidVertexParallelismAndInputInfosDeciderUtils.logBalancedDataDistributionOptimizationResult(org.slf4j.Logger logger, JobVertexID jobVertexId, BlockingInputInfo inputInfo, JobVertexInputInfo optimizedJobVertexInputInfo) Logs the data distribution optimization info when a balanced data distribution algorithm is effectively optimized compared to the num-based data distribution algorithm.Method parameters in org.apache.flink.runtime.scheduler.adaptivebatch.util with type arguments of type BlockingInputInfoModifier and TypeMethodDescriptionstatic longVertexParallelismAndInputInfosDeciderUtils.calculateDataVolumePerTaskForInputsGroup(long globalDataVolumePerTask, List<BlockingInputInfo> inputsGroup, List<BlockingInputInfo> allInputs) static booleanVertexParallelismAndInputInfosDeciderUtils.checkAndGetIntraCorrelation(List<BlockingInputInfo> inputInfos) static intVertexParallelismAndInputInfosDeciderUtils.checkAndGetSubpartitionNum(List<BlockingInputInfo> consumedResults) AllToAllVertexInputInfoComputer.compute(JobVertexID jobVertexId, List<BlockingInputInfo> inputInfos, int parallelism, int minParallelism, int maxParallelism, long dataVolumePerTask) Decide parallelism and input infos, which will make the data be evenly distributed to downstream subtasks for ALL_TO_ALL, such that different downstream subtasks consume roughly the same amount of data.PointwiseVertexInputInfoComputer.compute(List<BlockingInputInfo> inputInfos, int parallelism, int minParallelism, int maxParallelism, long dataVolumePerTask) Decide parallelism and input infos, which will make the data be evenly distributed to downstream subtasks for POINTWISE, such that different downstream subtasks consume roughly the same amount of data.static AggregatedBlockingInputInfoAggregatedBlockingInputInfo.createAggregatedBlockingInputInfo(long defaultSkewedThreshold, double skewedFactor, long dataVolumePerTask, List<BlockingInputInfo> inputInfos) VertexParallelismAndInputInfosDeciderUtils.createJobVertexInputInfos(List<BlockingInputInfo> inputInfos, Map<Integer, List<SubpartitionSlice>> subpartitionSlices, List<IndexRange> subpartitionSliceRanges, Function<Integer, Integer> subpartitionSliceKeyResolver) static intVertexParallelismAndInputInfosDeciderUtils.getMaxNumPartitions(List<BlockingInputInfo> consumedResults) static List<BlockingInputInfo>VertexParallelismAndInputInfosDeciderUtils.getNonBroadcastInputInfos(List<BlockingInputInfo> consumedResults) static booleanVertexParallelismAndInputInfosDeciderUtils.hasSameNumPartitions(List<BlockingInputInfo> inputInfos)