Interface ClusterPartitionManager

All Known Subinterfaces:
ResourceManagerGateway
All Known Implementing Classes:
ActiveResourceManager, ResourceManager, StandaloneResourceManager

public interface ClusterPartitionManager
Interface for components that manage cluster partitions.
  • Method Details

    • listDataSets

      Returns all datasets for which partitions are being tracked.
      Returns:
      tracked datasets
    • releaseClusterPartitions

      CompletableFuture<Void> releaseClusterPartitions(IntermediateDataSetID dataSetToRelease)
      Releases all partitions associated with the given dataset.
      Parameters:
      dataSetToRelease - dataset for which all associated partitions should be released
      Returns:
      future that is completed once all partitions have been released
    • reportClusterPartitions

      CompletableFuture<Void> reportClusterPartitions(ResourceID taskExecutorId, ClusterPartitionReport clusterPartitionReport)
      Report the cluster partitions status in the task executor.
      Parameters:
      taskExecutorId - The id of the task executor.
      clusterPartitionReport - The status of the cluster partitions.
      Returns:
      future that is completed once the report have been processed.
    • getClusterPartitionsShuffleDescriptors

      CompletableFuture<List<ShuffleDescriptor>> getClusterPartitionsShuffleDescriptors(IntermediateDataSetID intermediateDataSetID)
      Get the shuffle descriptors of the cluster partitions ordered by partition number.
      Parameters:
      intermediateDataSetID - The id of the dataset.
      Returns:
      shuffle descriptors of the cluster partitions.