Package org.apache.flink.runtime.scheduler.adaptivebatch

Class DefaultSpeculativeExecutionHandler

java.lang.Object

org.apache.flink.runtime.scheduler.adaptivebatch.DefaultSpeculativeExecutionHandler

All Implemented Interfaces:

SpeculativeExecutionHandler, SlowTaskDetectorListener

public class DefaultSpeculativeExecutionHandler
extends Object
implements SpeculativeExecutionHandler, SlowTaskDetectorListener

The default implementation of SpeculativeExecutionHandler.

Constructor Summary

Constructors

Constructor	Description
DefaultSpeculativeExecutionHandler(org.apache.flink.configuration.Configuration jobMasterConfiguration, BlocklistOperations blocklistOperations, Function<ExecutionVertexID,ExecutionVertex> executionVertexRetriever, Supplier<Map<ExecutionAttemptID,Execution>> registerExecutionsSupplier, BiConsumer<List<Execution>,Collection<ExecutionVertexID>> allocateSlotsAndDeployFunction, org.slf4j.Logger log)

Method Summary

Modifier and Type	Method	Description
boolean	handleTaskFailure(Execution failedExecution, Throwable error, BiConsumer<Execution,Throwable> handleLocalExecutionAttemptFailure)	Handles a task failure.
void	init(ExecutionGraph executionGraph, org.apache.flink.runtime.concurrent.ComponentMainThreadExecutor mainThreadExecutor, org.apache.flink.metrics.MetricGroup metricGroup)	Initial speculative execution handler.
void	notifySlowTasks(Map<ExecutionVertexID,Collection<ExecutionAttemptID>> slowTasks)	Notify detected slow tasks.
void	notifyTaskFailed(Execution execution)	Notifies that a task has failed its execution.
void	notifyTaskFinished(Execution execution, Function<ExecutionVertexID,CompletableFuture<?>> cancelPendingExecutionsFunction)	Notifies that a task has finished its execution.
void	resetForNewExecution(ExecutionVertexID executionVertexId)	Resets the state of the component for a new execution of a specific execution vertex.
void	stopSlowTaskDetector()	Stops the slow task detector.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Details

DefaultSpeculativeExecutionHandler

public DefaultSpeculativeExecutionHandler(org.apache.flink.configuration.Configuration jobMasterConfiguration,
 BlocklistOperations blocklistOperations,
 Function<ExecutionVertexID,ExecutionVertex> executionVertexRetriever,
 Supplier<Map<ExecutionAttemptID,Execution>> registerExecutionsSupplier,
 BiConsumer<List<Execution>,Collection<ExecutionVertexID>> allocateSlotsAndDeployFunction,
 org.slf4j.Logger log)

Method Details

init

public void init(ExecutionGraph executionGraph,
 org.apache.flink.runtime.concurrent.ComponentMainThreadExecutor mainThreadExecutor,
 org.apache.flink.metrics.MetricGroup metricGroup)

Description copied from interface: SpeculativeExecutionHandler

Initial speculative execution handler.

Specified by:

init in interface SpeculativeExecutionHandler

stopSlowTaskDetector

public void stopSlowTaskDetector()

Description copied from interface: SpeculativeExecutionHandler

Stops the slow task detector.

Specified by:

stopSlowTaskDetector in interface SpeculativeExecutionHandler

notifyTaskFinished

public void notifyTaskFinished(Execution execution,
 Function<ExecutionVertexID,CompletableFuture<?>> cancelPendingExecutionsFunction)

Description copied from interface: SpeculativeExecutionHandler

Notifies that a task has finished its execution.

Specified by:

notifyTaskFinished in interface SpeculativeExecutionHandler

Parameters:

execution - the execution that has finished

cancelPendingExecutionsFunction - the function to cancel pending executions

notifyTaskFailed

public void notifyTaskFailed(Execution execution)

Description copied from interface: SpeculativeExecutionHandler

Notifies that a task has failed its execution.

Specified by:

notifyTaskFailed in interface SpeculativeExecutionHandler

Parameters:

execution - the execution that has failed

handleTaskFailure

public boolean handleTaskFailure(Execution failedExecution,
 @Nullable
 Throwable error,
 BiConsumer<Execution,Throwable> handleLocalExecutionAttemptFailure)

Description copied from interface: SpeculativeExecutionHandler

Handles a task failure.

Specified by:

handleTaskFailure in interface SpeculativeExecutionHandler

Parameters:

failedExecution - the execution that failed

error - the error that caused the failure, if available

handleLocalExecutionAttemptFailure - a consumer that handles local execution attempt failure

Returns:

true if the failure was handled as a local failure, false otherwise

notifySlowTasks

public void notifySlowTasks(Map<ExecutionVertexID,Collection<ExecutionAttemptID>> slowTasks)

Description copied from interface: SlowTaskDetectorListener

Notify detected slow tasks.

Specified by:

notifySlowTasks in interface SlowTaskDetectorListener

Parameters:

slowTasks - the map of execution vertices and their execution attempts which are detected as slow.

resetForNewExecution

public void resetForNewExecution(ExecutionVertexID executionVertexId)

Description copied from interface: SpeculativeExecutionHandler

Resets the state of the component for a new execution of a specific execution vertex.

Specified by:

resetForNewExecution in interface SpeculativeExecutionHandler

Parameters:

executionVertexId - the ID of the execution vertex to reset