Uses of Class
org.apache.flink.runtime.io.network.partition.hybrid.tiered.common.TieredStoragePartitionId
Packages that use TieredStoragePartitionId
Package
Description
-
Uses of TieredStoragePartitionId in org.apache.flink.runtime.io.network.partition.hybrid.tiered.common
Methods in org.apache.flink.runtime.io.network.partition.hybrid.tiered.common that return TieredStoragePartitionIdModifier and TypeMethodDescriptionstatic TieredStoragePartitionIdTieredStorageIdMappingUtils.convertId(ResultPartitionID resultPartitionId) Methods in org.apache.flink.runtime.io.network.partition.hybrid.tiered.common with parameters of type TieredStoragePartitionIdModifier and TypeMethodDescriptionstatic ResultPartitionIDTieredStorageIdMappingUtils.convertId(TieredStoragePartitionId partitionId) -
Uses of TieredStoragePartitionId in org.apache.flink.runtime.io.network.partition.hybrid.tiered.file
Methods in org.apache.flink.runtime.io.network.partition.hybrid.tiered.file with parameters of type TieredStoragePartitionIdModifier and TypeMethodDescriptionstatic StringSegmentPartitionFile.getPartitionPath(TieredStoragePartitionId partitionId, String basePath) longPartitionFileReader.getPriority(TieredStoragePartitionId partitionId, TieredStorageSubpartitionId subpartitionId, int segmentId, int bufferIndex, PartitionFileReader.ReadProgress readProgress) Get the priority for reading a particular buffer from the partitioned file.longProducerMergedPartitionFileReader.getPriority(TieredStoragePartitionId partitionId, TieredStorageSubpartitionId subpartitionId, int segmentId, int bufferIndex, PartitionFileReader.ReadProgress readProgress) longSegmentPartitionFileReader.getPriority(TieredStoragePartitionId partitionId, TieredStorageSubpartitionId subpartitionId, int segmentId, int bufferIndex, PartitionFileReader.ReadProgress readProgress) static org.apache.flink.core.fs.PathSegmentPartitionFile.getSegmentFinishDirPath(String basePath, TieredStoragePartitionId partitionId, int subpartitionId) static org.apache.flink.core.fs.PathSegmentPartitionFile.getSegmentPath(String basePath, TieredStoragePartitionId partitionId, int subpartitionId, long segmentId) static StringSegmentPartitionFile.getSubpartitionPath(String basePath, TieredStoragePartitionId partitionId, int subpartitionId) PartitionFileReader.readBuffer(TieredStoragePartitionId partitionId, TieredStorageSubpartitionId subpartitionId, int segmentId, int bufferIndex, org.apache.flink.core.memory.MemorySegment memorySegment, BufferRecycler recycler, PartitionFileReader.ReadProgress readProgress, CompositeBuffer partialBuffer) Read a buffer from the partition file.ProducerMergedPartitionFileReader.readBuffer(TieredStoragePartitionId partitionId, TieredStorageSubpartitionId subpartitionId, int segmentId, int bufferIndex, org.apache.flink.core.memory.MemorySegment memorySegment, BufferRecycler recycler, PartitionFileReader.ReadProgress readProgress, CompositeBuffer partialBuffer) SegmentPartitionFileReader.readBuffer(TieredStoragePartitionId partitionId, TieredStorageSubpartitionId subpartitionId, int segmentId, int bufferIndex, org.apache.flink.core.memory.MemorySegment memorySegment, BufferRecycler recycler, PartitionFileReader.ReadProgress readProgress, CompositeBuffer partialBuffer) PartitionFileWriter.write(TieredStoragePartitionId partitionId, List<PartitionFileWriter.SubpartitionBufferContext> buffersToWrite) Write the buffers to the partition file.ProducerMergedPartitionFileWriter.write(TieredStoragePartitionId partitionId, List<PartitionFileWriter.SubpartitionBufferContext> buffersToWrite) SegmentPartitionFileWriter.write(TieredStoragePartitionId partitionId, List<PartitionFileWriter.SubpartitionBufferContext> buffersToWrite) static voidSegmentPartitionFile.writeSegmentFinishFile(String basePath, TieredStoragePartitionId partitionId, int subpartitionId, int segmentId) -
Uses of TieredStoragePartitionId in org.apache.flink.runtime.io.network.partition.hybrid.tiered.netty
Methods in org.apache.flink.runtime.io.network.partition.hybrid.tiered.netty with parameters of type TieredStoragePartitionIdModifier and TypeMethodDescriptionTieredStorageNettyServiceImpl.createResultSubpartitionView(TieredStoragePartitionId partitionId, TieredStorageSubpartitionId subpartitionId, BufferAvailabilityListener availabilityListener) Create aResultSubpartitionViewfor the netty server.TieredStorageNettyService.registerConsumer(TieredStoragePartitionId partitionId, TieredStorageSubpartitionId subpartitionId) TierConsumerAgentwill register toTieredStorageNettyServiceand get a future ofNettyConnectionReader.TieredStorageNettyServiceImpl.registerConsumer(TieredStoragePartitionId partitionId, TieredStorageSubpartitionId subpartitionId) voidTieredStorageNettyService.registerProducer(TieredStoragePartitionId partitionId, NettyServiceProducer serviceProducer) TierProducerAgentwill provide a callback namedNettyServiceProducerto register toTieredStorageNettyService.voidTieredStorageNettyServiceImpl.registerProducer(TieredStoragePartitionId partitionId, NettyServiceProducer serviceProducer) -
Uses of TieredStoragePartitionId in org.apache.flink.runtime.io.network.partition.hybrid.tiered.storage
Methods in org.apache.flink.runtime.io.network.partition.hybrid.tiered.storage that return TieredStoragePartitionIdMethods in org.apache.flink.runtime.io.network.partition.hybrid.tiered.storage with parameters of type TieredStoragePartitionIdModifier and TypeMethodDescriptionTieredStorageConsumerClient.getNextBuffer(TieredStoragePartitionId partitionId, TieredStorageSubpartitionId subpartitionId) voidAvailabilityNotifier.notifyAvailable(TieredStoragePartitionId partitionId, TieredStorageInputChannelId inputChannelId) Notify that the data for the specific partition and input channel is available in tiered storage.intTieredStorageConsumerClient.peekNextBufferSubpartitionId(TieredStoragePartitionId partitionId, ResultSubpartitionIndexSet indexSet) Returns the index of the subpartition where the next buffer locates, or -1 if there is no buffer available or the subpartition index does not belong to the specified indexSet.voidTieredStorageConsumerClient.updateTierShuffleDescriptors(TieredStoragePartitionId partitionId, TieredStorageInputChannelId inputChannelId, TieredStorageSubpartitionId subpartitionId, List<TierShuffleDescriptor> tierShuffleDescriptors) Constructors in org.apache.flink.runtime.io.network.partition.hybrid.tiered.storage with parameters of type TieredStoragePartitionIdModifierConstructorDescriptionTieredStorageConsumerSpec(int gateIndex, TieredStoragePartitionId tieredStoragePartitionId, TieredStorageInputChannelId tieredStorageInputChannelId, ResultSubpartitionIndexSet tieredStorageSubpartitionIds) -
Uses of TieredStoragePartitionId in org.apache.flink.runtime.io.network.partition.hybrid.tiered.tier
Methods in org.apache.flink.runtime.io.network.partition.hybrid.tiered.tier with parameters of type TieredStoragePartitionIdModifier and TypeMethodDescriptionTierFactory.createProducerAgent(int numPartitions, int numSubpartitions, TieredStoragePartitionId partitionID, String dataFileBasePath, boolean isBroadcastOnly, TieredStorageMemoryManager storageMemoryManager, TieredStorageNettyService nettyService, TieredStorageResourceRegistry resourceRegistry, BatchShuffleReadBufferPool bufferPool, ScheduledExecutorService ioExecutor, List<TierShuffleDescriptor> shuffleDescriptors, int maxRequestedBuffer, BufferCompressor bufferCompressor) Creates the producer-side agent of a Tier.TierConsumerAgent.getNextBuffer(TieredStoragePartitionId partitionId, TieredStorageSubpartitionId subpartitionId, int segmentId) Get buffer from the consumer agent.intTierConsumerAgent.peekNextBufferSubpartitionId(TieredStoragePartitionId partitionId, ResultSubpartitionIndexSet indexSet) Returns the index of the subpartition where the next buffer locates, or -1 if there is no buffer available or the subpartition index does not belong to the specified indexSet.voidTierConsumerAgent.updateTierShuffleDescriptor(TieredStoragePartitionId partitionId, TieredStorageInputChannelId inputChannelId, TieredStorageSubpartitionId subpartitionId, TierShuffleDescriptor tierShuffleDescriptor) Update theTierShuffleDescriptorfor the consumer agent.Method parameters in org.apache.flink.runtime.io.network.partition.hybrid.tiered.tier with type arguments of type TieredStoragePartitionIdModifier and TypeMethodDescriptionTierShuffleHandler.onReleasePartitions(Collection<TieredStoragePartitionId> partitionIds) A callback to process the event of releasing a collection of tiered result partitions. -
Uses of TieredStoragePartitionId in org.apache.flink.runtime.io.network.partition.hybrid.tiered.tier.disk
Methods in org.apache.flink.runtime.io.network.partition.hybrid.tiered.tier.disk with parameters of type TieredStoragePartitionIdModifier and TypeMethodDescriptionDiskTierFactory.createProducerAgent(int numPartitions, int numSubpartitions, TieredStoragePartitionId partitionId, String dataFileBasePath, boolean isBroadcastOnly, TieredStorageMemoryManager storageMemoryManager, TieredStorageNettyService nettyService, TieredStorageResourceRegistry resourceRegistry, BatchShuffleReadBufferPool bufferPool, ScheduledExecutorService ioExecutor, List<TierShuffleDescriptor> shuffleDescriptors, int maxRequestedBuffers, BufferCompressor bufferCompressor) DiskTierConsumerAgent.getNextBuffer(TieredStoragePartitionId partitionId, TieredStorageSubpartitionId subpartitionId, int segmentId) intDiskTierConsumerAgent.peekNextBufferSubpartitionId(TieredStoragePartitionId partitionId, ResultSubpartitionIndexSet indexSet) voidDiskTierConsumerAgent.updateTierShuffleDescriptor(TieredStoragePartitionId partitionId, TieredStorageInputChannelId inputChannelId, TieredStorageSubpartitionId subpartitionId, TierShuffleDescriptor tierShuffleDescriptor) Constructors in org.apache.flink.runtime.io.network.partition.hybrid.tiered.tier.disk with parameters of type TieredStoragePartitionIdModifierConstructorDescriptionDiskIOScheduler(TieredStoragePartitionId partitionId, BatchShuffleReadBufferPool bufferPool, ScheduledExecutorService ioExecutor, int maxRequestedBuffers, Duration bufferRequestTimeout, BiFunction<Integer, Integer, Integer> segmentIdGetter, PartitionFileReader partitionFileReader) -
Uses of TieredStoragePartitionId in org.apache.flink.runtime.io.network.partition.hybrid.tiered.tier.memory
Methods in org.apache.flink.runtime.io.network.partition.hybrid.tiered.tier.memory with parameters of type TieredStoragePartitionIdModifier and TypeMethodDescriptionMemoryTierFactory.createProducerAgent(int numPartitions, int numSubpartitions, TieredStoragePartitionId partitionID, String dataFileBasePath, boolean isBroadcastOnly, TieredStorageMemoryManager memoryManager, TieredStorageNettyService nettyService, TieredStorageResourceRegistry resourceRegistry, BatchShuffleReadBufferPool bufferPool, ScheduledExecutorService ioExecutor, List<TierShuffleDescriptor> shuffleDescriptors, int maxRequestedBuffers, BufferCompressor bufferCompressor) MemoryTierConsumerAgent.getNextBuffer(TieredStoragePartitionId partitionId, TieredStorageSubpartitionId subpartitionId, int segmentId) intMemoryTierConsumerAgent.peekNextBufferSubpartitionId(TieredStoragePartitionId partitionId, ResultSubpartitionIndexSet indexSet) voidMemoryTierConsumerAgent.updateTierShuffleDescriptor(TieredStoragePartitionId partitionId, TieredStorageInputChannelId inputChannelId, TieredStorageSubpartitionId subpartitionId, TierShuffleDescriptor tierShuffleDescriptor) Constructors in org.apache.flink.runtime.io.network.partition.hybrid.tiered.tier.memory with parameters of type TieredStoragePartitionIdModifierConstructorDescriptionMemoryTierProducerAgent(TieredStoragePartitionId partitionId, int numSubpartitions, int bufferSizeBytes, int segmentSizeBytes, int subpartitionMaxQueuedBuffers, boolean isBroadcastOnly, TieredStorageMemoryManager memoryManager, TieredStorageNettyService nettyService, TieredStorageResourceRegistry resourceRegistry, BufferCompressor bufferCompressor) -
Uses of TieredStoragePartitionId in org.apache.flink.runtime.io.network.partition.hybrid.tiered.tier.remote
Methods in org.apache.flink.runtime.io.network.partition.hybrid.tiered.tier.remote that return TieredStoragePartitionIdMethods in org.apache.flink.runtime.io.network.partition.hybrid.tiered.tier.remote with parameters of type TieredStoragePartitionIdModifier and TypeMethodDescriptionRemoteTierFactory.createProducerAgent(int numPartitions, int numSubpartitions, TieredStoragePartitionId partitionID, String dataFileBasePath, boolean isBroadcastOnly, TieredStorageMemoryManager storageMemoryManager, TieredStorageNettyService nettyService, TieredStorageResourceRegistry resourceRegistry, BatchShuffleReadBufferPool bufferPool, ScheduledExecutorService ioExecutor, List<TierShuffleDescriptor> shuffleDescriptors, int maxRequestedBuffers, BufferCompressor bufferCompressor) RemoteTierConsumerAgent.getNextBuffer(TieredStoragePartitionId partitionId, TieredStorageSubpartitionId subpartitionId, int segmentId) voidRemoteTierConsumerAgent.notifyAvailable(TieredStoragePartitionId partitionId, TieredStorageSubpartitionId subpartitionId) intRemoteTierConsumerAgent.peekNextBufferSubpartitionId(TieredStoragePartitionId partitionId, ResultSubpartitionIndexSet indexSet) voidRemoteTierConsumerAgent.updateTierShuffleDescriptor(TieredStoragePartitionId partitionId, TieredStorageInputChannelId inputChannelId, TieredStorageSubpartitionId subpartitionId, TierShuffleDescriptor tierShuffleDescriptor) voidRemoteStorageScanner.watchSegment(TieredStoragePartitionId partitionId, TieredStorageSubpartitionId subpartitionId, int segmentId) Watch the segment for a specific subpartition in theRemoteStorageScanner.Method parameters in org.apache.flink.runtime.io.network.partition.hybrid.tiered.tier.remote with type arguments of type TieredStoragePartitionIdModifier and TypeMethodDescriptionvoidRemoteStorageScanner.registerAvailabilityAndPriorityNotifier(BiConsumer<TieredStoragePartitionId, TieredStorageSubpartitionId> availabilityNotifier) Constructors in org.apache.flink.runtime.io.network.partition.hybrid.tiered.tier.remote with parameters of type TieredStoragePartitionId