Uses of Interface
org.apache.flink.runtime.scheduler.VertexParallelismStore
Packages that use VertexParallelismStore
Package
Description
-
Uses of VertexParallelismStore in org.apache.flink.runtime.executiongraph
Methods in org.apache.flink.runtime.executiongraph with parameters of type VertexParallelismStoreModifier and TypeMethodDescriptionvoidDefaultExecutionGraph.addNewJobVertices(List<JobVertex> topologicallySortedNewlyJobVertices, JobManagerJobMetricGroup jobManagerJobMetricGroup, VertexParallelismStore newVerticesParallelismStore) voidExecutionGraph.addNewJobVertices(List<JobVertex> topologicallySortedNewlyJobVertices, JobManagerJobMetricGroup jobManagerJobMetricGroup, VertexParallelismStore newVerticesParallelismStore) Adds new job vertices to the execution graph based on the provided list of topologically sorted job vertices.static DefaultExecutionGraphDefaultExecutionGraphBuilder.buildGraph(JobGraph jobGraph, org.apache.flink.configuration.Configuration jobManagerConfig, ScheduledExecutorService futureExecutor, Executor ioExecutor, ClassLoader classLoader, CompletedCheckpointStore completedCheckpointStore, CheckpointsCleaner checkpointsCleaner, CheckpointIDCounter checkpointIdCounter, Duration rpcTimeout, BlobWriter blobWriter, org.slf4j.Logger log, ShuffleMaster<?> shuffleMaster, JobMasterPartitionTracker partitionTracker, TaskDeploymentDescriptorFactory.PartitionLocationConstraint partitionLocationConstraint, ExecutionDeploymentListener executionDeploymentListener, ExecutionStateUpdateListener executionStateUpdateListener, long initializationTimestamp, VertexAttemptNumberStore vertexAttemptNumberStore, VertexParallelismStore vertexParallelismStore, CheckpointStatsTracker checkpointStatsTracker, boolean isDynamicGraph, ExecutionJobVertex.Factory executionJobVertexFactory, MarkPartitionFinishedStrategy markPartitionFinishedStrategy, boolean nonFinishedHybridPartitionShouldBeUnknown, JobManagerJobMetricGroup jobManagerJobMetricGroup, ExecutionPlanSchedulingContext executionPlanSchedulingContext) static ArchivedExecutionGraphArchivedExecutionGraph.createSparseArchivedExecutionGraphWithJobVertices(org.apache.flink.api.common.JobID jobId, String jobName, org.apache.flink.api.common.JobStatus jobStatus, JobType jobType, Throwable throwable, JobCheckpointingSettings checkpointingSettings, long initializationTimestamp, Iterable<JobVertex> jobVertices, VertexParallelismStore initialParallelismStore) static voidDefaultExecutionGraphBuilder.initJobVerticesOnMaster(Iterable<JobVertex> jobVertices, ClassLoader classLoader, org.slf4j.Logger log, VertexParallelismStore vertexParallelismStore, String jobName, org.apache.flink.api.common.JobID jobId) Constructors in org.apache.flink.runtime.executiongraph with parameters of type VertexParallelismStoreModifierConstructorDescriptionDefaultExecutionGraph(JobInformation jobInformation, ScheduledExecutorService futureExecutor, Executor ioExecutor, Duration rpcTimeout, int executionHistorySizeLimit, ClassLoader userClassLoader, BlobWriter blobWriter, PartitionGroupReleaseStrategy.Factory partitionGroupReleaseStrategyFactory, ShuffleMaster<?> shuffleMaster, JobMasterPartitionTracker partitionTracker, ExecutionDeploymentListener executionDeploymentListener, ExecutionStateUpdateListener executionStateUpdateListener, long initializationTimestamp, VertexAttemptNumberStore initialAttemptCounts, VertexParallelismStore vertexParallelismStore, boolean isDynamic, ExecutionJobVertex.Factory executionJobVertexFactory, List<org.apache.flink.core.execution.JobStatusHook> jobStatusHooks, MarkPartitionFinishedStrategy markPartitionFinishedStrategy, TaskDeploymentDescriptorFactory taskDeploymentDescriptorFactory, List<org.apache.flink.core.execution.JobStatusChangedListener> jobStatusChangedListeners, ExecutionPlanSchedulingContext executionPlanSchedulingContext) -
Uses of VertexParallelismStore in org.apache.flink.runtime.scheduler
Subinterfaces of VertexParallelismStore in org.apache.flink.runtime.schedulerModifier and TypeInterfaceDescriptioninterfaceMutability extension to theVertexParallelismStore.Classes in org.apache.flink.runtime.scheduler that implement VertexParallelismStoreModifier and TypeClassDescriptionclassMaintains the configured parallelisms for vertices, which should be defined by a scheduler.Methods in org.apache.flink.runtime.scheduler that return VertexParallelismStoreModifier and TypeMethodDescriptionstatic VertexParallelismStoreSchedulerBase.computeVertexParallelismStore(Iterable<JobVertex> vertices) Compute theVertexParallelismStorefor all given vertices, which will set defaults and ensure that the returned store contains valid parallelisms.static VertexParallelismStoreSchedulerBase.computeVertexParallelismStore(Iterable<JobVertex> vertices, Function<JobVertex, Integer> defaultMaxParallelismFunc) static VertexParallelismStoreSchedulerBase.computeVertexParallelismStore(Iterable<JobVertex> vertices, Function<JobVertex, Integer> defaultMaxParallelismFunc, Function<Integer, Integer> normalizeParallelismFunc) Compute theVertexParallelismStorefor all given vertices, which will set defaults and ensure that the returned store contains valid parallelisms, with a custom function for default max parallelism calculation and a custom function for normalizing vertex parallelism.static VertexParallelismStoreSchedulerBase.computeVertexParallelismStore(JobGraph jobGraph) Compute theVertexParallelismStorefor all vertices of a given job graph, which will set defaults and ensure that the returned store contains valid parallelisms.Methods in org.apache.flink.runtime.scheduler that return types with arguments of type VertexParallelismStoreModifier and TypeMethodDescriptionstatic Optional<VertexParallelismStore>DefaultVertexParallelismStore.applyJobResourceRequirements(VertexParallelismStore oldVertexParallelismStore, JobResourceRequirements jobResourceRequirements) Create a newVertexParallelismStorethat reflects givenJobResourceRequirements.Methods in org.apache.flink.runtime.scheduler with parameters of type VertexParallelismStoreModifier and TypeMethodDescriptionstatic Optional<VertexParallelismStore>DefaultVertexParallelismStore.applyJobResourceRequirements(VertexParallelismStore oldVertexParallelismStore, JobResourceRequirements jobResourceRequirements) Create a newVertexParallelismStorethat reflects givenJobResourceRequirements.DefaultExecutionGraphFactory.createAndRestoreExecutionGraph(JobGraph jobGraph, CompletedCheckpointStore completedCheckpointStore, CheckpointsCleaner checkpointsCleaner, CheckpointIDCounter checkpointIdCounter, CheckpointStatsTracker checkpointStatsTracker, TaskDeploymentDescriptorFactory.PartitionLocationConstraint partitionLocationConstraint, long initializationTimestamp, VertexAttemptNumberStore vertexAttemptNumberStore, VertexParallelismStore vertexParallelismStore, ExecutionStateUpdateListener executionStateUpdateListener, MarkPartitionFinishedStrategy markPartitionFinishedStrategy, ExecutionPlanSchedulingContext executionPlanSchedulingContext, org.slf4j.Logger log) ExecutionGraphFactory.createAndRestoreExecutionGraph(JobGraph jobGraph, CompletedCheckpointStore completedCheckpointStore, CheckpointsCleaner checkpointsCleaner, CheckpointIDCounter checkpointIdCounter, CheckpointStatsTracker checkpointStatsTracker, TaskDeploymentDescriptorFactory.PartitionLocationConstraint partitionLocationConstraint, long initializationTimestamp, VertexAttemptNumberStore vertexAttemptNumberStore, VertexParallelismStore vertexParallelismStore, ExecutionStateUpdateListener executionStateUpdateListener, MarkPartitionFinishedStrategy markPartitionFinishedStrategy, ExecutionPlanSchedulingContext executionPlanSchedulingContext, org.slf4j.Logger log) Create and restoreExecutionGraphfrom the givenJobGraphand services.voidDefaultVertexParallelismStore.mergeParallelismStore(VertexParallelismStore parallelismStore) voidMutableVertexParallelismStore.mergeParallelismStore(VertexParallelismStore parallelismStore) Merges the given parallelism store into the current store.Constructors in org.apache.flink.runtime.scheduler with parameters of type VertexParallelismStoreModifierConstructorDescriptionprotectedDefaultScheduler(org.slf4j.Logger log, JobGraph jobGraph, Executor ioExecutor, org.apache.flink.configuration.Configuration jobMasterConfiguration, Consumer<org.apache.flink.runtime.concurrent.ComponentMainThreadExecutor> startUpAction, org.apache.flink.util.concurrent.ScheduledExecutor delayExecutor, ClassLoader userCodeLoader, CheckpointsCleaner checkpointsCleaner, CheckpointRecoveryFactory checkpointRecoveryFactory, JobManagerJobMetricGroup jobManagerJobMetricGroup, SchedulingStrategyFactory schedulingStrategyFactory, FailoverStrategy.Factory failoverStrategyFactory, RestartBackoffTimeStrategy restartBackoffTimeStrategy, ExecutionOperations executionOperations, ExecutionVertexVersioner executionVertexVersioner, ExecutionSlotAllocatorFactory executionSlotAllocatorFactory, long initializationTimestamp, org.apache.flink.runtime.concurrent.ComponentMainThreadExecutor mainThreadExecutor, JobStatusListener jobStatusListener, Collection<org.apache.flink.core.failure.FailureEnricher> failureEnrichers, ExecutionGraphFactory executionGraphFactory, ShuffleMaster<?> shuffleMaster, Duration rpcTimeout, VertexParallelismStore vertexParallelismStore, ExecutionDeployer.Factory executionDeployerFactory, ExecutionPlanSchedulingContext executionPlanSchedulingContext) SchedulerBase(org.slf4j.Logger log, JobGraph jobGraph, Executor ioExecutor, org.apache.flink.configuration.Configuration jobMasterConfiguration, CheckpointsCleaner checkpointsCleaner, CheckpointRecoveryFactory checkpointRecoveryFactory, JobManagerJobMetricGroup jobManagerJobMetricGroup, ExecutionVertexVersioner executionVertexVersioner, long initializationTimestamp, org.apache.flink.runtime.concurrent.ComponentMainThreadExecutor mainThreadExecutor, JobStatusListener jobStatusListener, ExecutionGraphFactory executionGraphFactory, VertexParallelismStore vertexParallelismStore, ExecutionPlanSchedulingContext executionPlanSchedulingContext) -
Uses of VertexParallelismStore in org.apache.flink.runtime.scheduler.adaptive
Methods in org.apache.flink.runtime.scheduler.adaptive that return VertexParallelismStoreConstructors in org.apache.flink.runtime.scheduler.adaptive with parameters of type VertexParallelismStoreModifierConstructorDescriptionJobGraphJobInformation(JobGraph jobGraph, VertexParallelismStore vertexParallelismStore) -
Uses of VertexParallelismStore in org.apache.flink.runtime.scheduler.adaptivebatch
Methods in org.apache.flink.runtime.scheduler.adaptivebatch that return VertexParallelismStoreModifier and TypeMethodDescriptionstatic VertexParallelismStoreAdaptiveBatchScheduler.computeVertexParallelismStoreForDynamicGraph(Iterable<JobVertex> vertices, int defaultMaxParallelism) Compute theVertexParallelismStorefor all given vertices in a dynamic graph, which will set defaults and ensure that the returned store contains valid parallelisms, with the configured default max parallelism.