Package org.apache.flink.runtime.io.network.partition.hybrid.tiered.tier

Interface TierFactory

All Known Implementing Classes:

DiskTierFactory, MemoryTierFactory, RemoteTierFactory

public interface TierFactory

A factory that creates all the components of a tier.

Method Summary

Modifier and Type	Method	Description
TierConsumerAgent	createConsumerAgent(List<TieredStorageConsumerSpec> tieredStorageConsumerSpecs, List<TierShuffleDescriptor> shuffleDescriptors, TieredStorageNettyService nettyService)	Creates the consumer-side agent of a Tier.
TierMasterAgent	createMasterAgent(TieredStorageResourceRegistry tieredStorageResourceRegistry)	Creates the master-side agent of a Tier.
TierProducerAgent	createProducerAgent(int numPartitions, int numSubpartitions, TieredStoragePartitionId partitionID, String dataFileBasePath, boolean isBroadcastOnly, TieredStorageMemoryManager storageMemoryManager, TieredStorageNettyService nettyService, TieredStorageResourceRegistry resourceRegistry, BatchShuffleReadBufferPool bufferPool, ScheduledExecutorService ioExecutor, List<TierShuffleDescriptor> shuffleDescriptors, int maxRequestedBuffer, BufferCompressor bufferCompressor)	Creates the producer-side agent of a Tier.
TieredStorageMemorySpec	getConsumerAgentMemorySpec()	Get the TieredStorageMemorySpec of the consumer-side agent.
TieredStorageMemorySpec	getMasterAgentMemorySpec()	Get the TieredStorageMemorySpec of the master-side agent.
TieredStorageMemorySpec	getProducerAgentMemorySpec()	Get the TieredStorageMemorySpec of the producer-side agent.
String	identifier()	The unique identifier of this tier.
void	setup(org.apache.flink.configuration.Configuration configuration)	Sets up the tier factory based on the Configuration.

Method Details

setup

void setup(org.apache.flink.configuration.Configuration configuration)

Sets up the tier factory based on the Configuration.

getMasterAgentMemorySpec

TieredStorageMemorySpec getMasterAgentMemorySpec()

Get the TieredStorageMemorySpec of the master-side agent.

getProducerAgentMemorySpec

TieredStorageMemorySpec getProducerAgentMemorySpec()

Get the TieredStorageMemorySpec of the producer-side agent.

getConsumerAgentMemorySpec

TieredStorageMemorySpec getConsumerAgentMemorySpec()

Get the TieredStorageMemorySpec of the consumer-side agent.

createMasterAgent

TierMasterAgent createMasterAgent(TieredStorageResourceRegistry tieredStorageResourceRegistry)

Creates the master-side agent of a Tier.

createProducerAgent

TierProducerAgent createProducerAgent(int numPartitions,
 int numSubpartitions,
 TieredStoragePartitionId partitionID,
 String dataFileBasePath,
 boolean isBroadcastOnly,
 TieredStorageMemoryManager storageMemoryManager,
 TieredStorageNettyService nettyService,
 TieredStorageResourceRegistry resourceRegistry,
 BatchShuffleReadBufferPool bufferPool,
 ScheduledExecutorService ioExecutor,
 List<TierShuffleDescriptor> shuffleDescriptors,
 int maxRequestedBuffer,
 @Nullable
 BufferCompressor bufferCompressor)

Creates the producer-side agent of a Tier.

createConsumerAgent

TierConsumerAgent createConsumerAgent(List<TieredStorageConsumerSpec> tieredStorageConsumerSpecs,
 List<TierShuffleDescriptor> shuffleDescriptors,
 TieredStorageNettyService nettyService)

Creates the consumer-side agent of a Tier.

identifier

String identifier()

The unique identifier of this tier.