Package org.apache.flink.runtime.taskmanager

Class NettyShuffleEnvironmentConfiguration

java.lang.Object
org.apache.flink.runtime.taskmanager.NettyShuffleEnvironmentConfiguration
public class NettyShuffleEnvironmentConfiguration extends Object
Configuration object for the network stack.

  • Constructor Details

    • NettyShuffleEnvironmentConfiguration

      public NettyShuffleEnvironmentConfiguration(int numNetworkBuffers, int networkBufferSize, int startingBufferSize, int partitionRequestInitialBackoff, int partitionRequestMaxBackoff, int partitionRequestListenerTimeout, int networkBuffersPerChannel, int floatingNetworkBuffersPerGate, Optional<Integer> maxRequiredBuffersPerGate, Duration requestSegmentsTimeout, boolean isNetworkDetailedMetrics, @Nullable NettyConfig nettyConfig, String[] tempDirs, BoundedBlockingSubpartitionType blockingSubpartitionType, boolean batchShuffleCompressionEnabled, org.apache.flink.configuration.NettyShuffleEnvironmentOptions.CompressionCodec compressionCodec, int maxBuffersPerChannel, long batchShuffleReadMemoryBytes, int sortShuffleMinBuffers, int sortShuffleMinParallelism, BufferDebloatConfiguration debloatConfiguration, boolean connectionReuseEnabled, int maxOverdraftBuffersPerGate, @Nullable TieredStorageConfiguration tieredStorageConfiguration)

  • Method Details

    • numNetworkBuffers

      public int numNetworkBuffers()

    • networkBufferSize

      public int networkBufferSize()

    • startingBufferSize

      public int startingBufferSize()

    • partitionRequestInitialBackoff

      public int partitionRequestInitialBackoff()

    • partitionRequestMaxBackoff

      public int partitionRequestMaxBackoff()

    • getPartitionRequestListenerTimeout

      public int getPartitionRequestListenerTimeout()

    • networkBuffersPerChannel

      public int networkBuffersPerChannel()

    • floatingNetworkBuffersPerGate

      public int floatingNetworkBuffersPerGate()

    • maxRequiredBuffersPerGate

      public Optional<Integer> maxRequiredBuffersPerGate()

    • batchShuffleReadMemoryBytes

      public long batchShuffleReadMemoryBytes()

    • sortShuffleMinBuffers

      public int sortShuffleMinBuffers()

    • sortShuffleMinParallelism

      public int sortShuffleMinParallelism()

    • getRequestSegmentsTimeout

      public Duration getRequestSegmentsTimeout()

    • nettyConfig

      public NettyConfig nettyConfig()

    • isNetworkDetailedMetrics

      public boolean isNetworkDetailedMetrics()

    • getTempDirs

      public String[] getTempDirs()

    • isConnectionReuseEnabled

      public boolean isConnectionReuseEnabled()

    • getBlockingSubpartitionType

      public BoundedBlockingSubpartitionType getBlockingSubpartitionType()

    • isBatchShuffleCompressionEnabled

      public boolean isBatchShuffleCompressionEnabled()

    • getDebloatConfiguration

      public BufferDebloatConfiguration getDebloatConfiguration()

    • isSSLEnabled

      public boolean isSSLEnabled()

    • getCompressionCodec

      public org.apache.flink.configuration.NettyShuffleEnvironmentOptions.CompressionCodec getCompressionCodec()

    • getMaxBuffersPerChannel

      public int getMaxBuffersPerChannel()

    • getMaxOverdraftBuffersPerGate

      public int getMaxOverdraftBuffersPerGate()

    • getTieredStorageConfiguration

      public TieredStorageConfiguration getTieredStorageConfiguration()

    • fromConfiguration

      public static NettyShuffleEnvironmentConfiguration fromConfiguration(org.apache.flink.configuration.Configuration configuration, org.apache.flink.configuration.MemorySize networkMemorySize, boolean localTaskManagerCommunication, InetAddress taskManagerAddress)
      Utility method to extract network related parameters from the configuration and to sanity check them.
      Parameters:
      configuration - configuration object
      networkMemorySize - the size of memory reserved for shuffle environment
      localTaskManagerCommunication - true, to skip initializing the network stack
      taskManagerAddress - identifying the IP address under which the TaskManager will be accessible
      Returns:
      NettyShuffleEnvironmentConfiguration

    • hashCode

      public int hashCode()
      Overrides:
      hashCode in class Object

    • equals

      public boolean equals(Object obj)
      Overrides:
      equals in class Object

    • toString

      public String toString()
      Overrides:
      toString in class Object