Uses of Class
org.apache.flink.runtime.io.network.partition.hybrid.tiered.common.TieredStorageSubpartitionId
Packages that use TieredStorageSubpartitionId
Package
Description
-
Uses of TieredStorageSubpartitionId in org.apache.flink.runtime.io.network.partition.hybrid.tiered.common
Methods in org.apache.flink.runtime.io.network.partition.hybrid.tiered.common that return TieredStorageSubpartitionIdModifier and TypeMethodDescriptionstatic TieredStorageSubpartitionIdTieredStorageIdMappingUtils.convertId(int subpartitionId) Methods in org.apache.flink.runtime.io.network.partition.hybrid.tiered.common with parameters of type TieredStorageSubpartitionIdModifier and TypeMethodDescriptionstatic intTieredStorageIdMappingUtils.convertId(TieredStorageSubpartitionId subpartitionId) -
Uses of TieredStorageSubpartitionId in org.apache.flink.runtime.io.network.partition.hybrid.tiered.file
Methods in org.apache.flink.runtime.io.network.partition.hybrid.tiered.file with parameters of type TieredStorageSubpartitionIdModifier and TypeMethodDescriptionlongPartitionFileReader.getPriority(TieredStoragePartitionId partitionId, TieredStorageSubpartitionId subpartitionId, int segmentId, int bufferIndex, PartitionFileReader.ReadProgress readProgress) Get the priority for reading a particular buffer from the partitioned file.longProducerMergedPartitionFileReader.getPriority(TieredStoragePartitionId partitionId, TieredStorageSubpartitionId subpartitionId, int segmentId, int bufferIndex, PartitionFileReader.ReadProgress readProgress) longSegmentPartitionFileReader.getPriority(TieredStoragePartitionId partitionId, TieredStorageSubpartitionId subpartitionId, int segmentId, int bufferIndex, PartitionFileReader.ReadProgress readProgress) PartitionFileReader.readBuffer(TieredStoragePartitionId partitionId, TieredStorageSubpartitionId subpartitionId, int segmentId, int bufferIndex, org.apache.flink.core.memory.MemorySegment memorySegment, BufferRecycler recycler, PartitionFileReader.ReadProgress readProgress, CompositeBuffer partialBuffer) Read a buffer from the partition file.ProducerMergedPartitionFileReader.readBuffer(TieredStoragePartitionId partitionId, TieredStorageSubpartitionId subpartitionId, int segmentId, int bufferIndex, org.apache.flink.core.memory.MemorySegment memorySegment, BufferRecycler recycler, PartitionFileReader.ReadProgress readProgress, CompositeBuffer partialBuffer) SegmentPartitionFileReader.readBuffer(TieredStoragePartitionId partitionId, TieredStorageSubpartitionId subpartitionId, int segmentId, int bufferIndex, org.apache.flink.core.memory.MemorySegment memorySegment, BufferRecycler recycler, PartitionFileReader.ReadProgress readProgress, CompositeBuffer partialBuffer) -
Uses of TieredStorageSubpartitionId in org.apache.flink.runtime.io.network.partition.hybrid.tiered.netty
Methods in org.apache.flink.runtime.io.network.partition.hybrid.tiered.netty with parameters of type TieredStorageSubpartitionIdModifier and TypeMethodDescriptionvoidNettyServiceProducer.connectionEstablished(TieredStorageSubpartitionId subpartitionId, NettyConnectionWriter nettyConnectionWriter) NettyConnectionWriterwill be created when a netty connection is established for a subpartition.TieredStorageNettyServiceImpl.createResultSubpartitionView(TieredStoragePartitionId partitionId, TieredStorageSubpartitionId subpartitionId, BufferAvailabilityListener availabilityListener) Create aResultSubpartitionViewfor the netty server.TieredStorageNettyService.registerConsumer(TieredStoragePartitionId partitionId, TieredStorageSubpartitionId subpartitionId) TierConsumerAgentwill register toTieredStorageNettyServiceand get a future ofNettyConnectionReader.TieredStorageNettyServiceImpl.registerConsumer(TieredStoragePartitionId partitionId, TieredStorageSubpartitionId subpartitionId) -
Uses of TieredStorageSubpartitionId in org.apache.flink.runtime.io.network.partition.hybrid.tiered.storage
Methods in org.apache.flink.runtime.io.network.partition.hybrid.tiered.storage with parameters of type TieredStorageSubpartitionIdModifier and TypeMethodDescriptionvoidHashBufferAccumulator.flushAccumulatedBuffers(TieredStorageSubpartitionId subpartitionId, Buffer accumulatedBuffer, int numRemainingConsecutiveBuffers) voidHashSubpartitionBufferAccumulatorContext.flushAccumulatedBuffers(TieredStorageSubpartitionId subpartitionId, Buffer accumulatedBuffer, int numRemainingConsecutiveBuffers) Flush the accumulatedBuffers of the subpartition.TieredStorageConsumerClient.getNextBuffer(TieredStoragePartitionId partitionId, TieredStorageSubpartitionId subpartitionId) voidBufferAccumulator.receive(ByteBuffer record, TieredStorageSubpartitionId subpartitionId, Buffer.DataType dataType, boolean isBroadcast) Receives the records from tiered store producer, these records will be accumulated and transformed into finished buffers.voidHashBufferAccumulator.receive(ByteBuffer record, TieredStorageSubpartitionId subpartitionId, Buffer.DataType dataType, boolean isBroadcast) voidSortBufferAccumulator.receive(ByteBuffer record, TieredStorageSubpartitionId subpartitionId, Buffer.DataType dataType, boolean isBroadcast) voidTieredStorageConsumerClient.updateTierShuffleDescriptors(TieredStoragePartitionId partitionId, TieredStorageInputChannelId inputChannelId, TieredStorageSubpartitionId subpartitionId, List<TierShuffleDescriptor> tierShuffleDescriptors) voidTieredStorageProducerClient.write(ByteBuffer record, TieredStorageSubpartitionId subpartitionId, Buffer.DataType dataType, boolean isBroadcast) Write records to the producer client.Method parameters in org.apache.flink.runtime.io.network.partition.hybrid.tiered.storage with type arguments of type TieredStorageSubpartitionIdModifier and TypeMethodDescriptionvoidBufferAccumulator.setup(org.apache.flink.util.function.TriConsumer<TieredStorageSubpartitionId, Buffer, Integer> bufferFlusher) Setup the accumulator.voidHashBufferAccumulator.setup(org.apache.flink.util.function.TriConsumer<TieredStorageSubpartitionId, Buffer, Integer> accumulatedBufferFlusher) voidSortBufferAccumulator.setup(org.apache.flink.util.function.TriConsumer<TieredStorageSubpartitionId, Buffer, Integer> bufferFlusher) Constructors in org.apache.flink.runtime.io.network.partition.hybrid.tiered.storage with parameters of type TieredStorageSubpartitionIdModifierConstructorDescriptionHashSubpartitionBufferAccumulator(TieredStorageSubpartitionId subpartitionId, int bufferSize, HashSubpartitionBufferAccumulatorContext bufferAccumulatorContext, boolean isPartialRecordAllowed) -
Uses of TieredStorageSubpartitionId in org.apache.flink.runtime.io.network.partition.hybrid.tiered.tier
Methods in org.apache.flink.runtime.io.network.partition.hybrid.tiered.tier with parameters of type TieredStorageSubpartitionIdModifier and TypeMethodDescriptionTierConsumerAgent.getNextBuffer(TieredStoragePartitionId partitionId, TieredStorageSubpartitionId subpartitionId, int segmentId) Get buffer from the consumer agent.booleanTierProducerAgent.tryStartNewSegment(TieredStorageSubpartitionId subpartitionId, int segmentId, int minNumBuffers) Try to start a new segment in the Tier.booleanTierProducerAgent.tryWrite(TieredStorageSubpartitionId subpartitionId, Buffer finishedBuffer, Object bufferOwner, int numRemainingConsecutiveBuffers) Writes the finishedBufferto the consumer.voidTierConsumerAgent.updateTierShuffleDescriptor(TieredStoragePartitionId partitionId, TieredStorageInputChannelId inputChannelId, TieredStorageSubpartitionId subpartitionId, TierShuffleDescriptor tierShuffleDescriptor) Update theTierShuffleDescriptorfor the consumer agent. -
Uses of TieredStorageSubpartitionId in org.apache.flink.runtime.io.network.partition.hybrid.tiered.tier.disk
Methods in org.apache.flink.runtime.io.network.partition.hybrid.tiered.tier.disk with parameters of type TieredStorageSubpartitionIdModifier and TypeMethodDescriptionvoidDiskIOScheduler.connectionEstablished(TieredStorageSubpartitionId subpartitionId, NettyConnectionWriter nettyConnectionWriter) voidDiskTierProducerAgent.connectionEstablished(TieredStorageSubpartitionId subpartitionId, NettyConnectionWriter nettyConnectionWriter) DiskTierConsumerAgent.getNextBuffer(TieredStoragePartitionId partitionId, TieredStorageSubpartitionId subpartitionId, int segmentId) booleanDiskTierProducerAgent.tryStartNewSegment(TieredStorageSubpartitionId subpartitionId, int segmentId, int minNumBuffers) booleanDiskTierProducerAgent.tryWrite(TieredStorageSubpartitionId subpartitionId, Buffer finishedBuffer, Object bufferOwner, int numRemainingConsecutiveBuffers) voidDiskTierConsumerAgent.updateTierShuffleDescriptor(TieredStoragePartitionId partitionId, TieredStorageInputChannelId inputChannelId, TieredStorageSubpartitionId subpartitionId, TierShuffleDescriptor tierShuffleDescriptor) -
Uses of TieredStorageSubpartitionId in org.apache.flink.runtime.io.network.partition.hybrid.tiered.tier.memory
Methods in org.apache.flink.runtime.io.network.partition.hybrid.tiered.tier.memory with parameters of type TieredStorageSubpartitionIdModifier and TypeMethodDescriptionvoidMemoryTierProducerAgent.connectionEstablished(TieredStorageSubpartitionId subpartitionId, NettyConnectionWriter nettyConnectionWriter) MemoryTierConsumerAgent.getNextBuffer(TieredStoragePartitionId partitionId, TieredStorageSubpartitionId subpartitionId, int segmentId) booleanMemoryTierProducerAgent.tryStartNewSegment(TieredStorageSubpartitionId subpartitionId, int segmentId, int minNumBuffers) booleanMemoryTierProducerAgent.tryWrite(TieredStorageSubpartitionId subpartitionId, Buffer finishedBuffer, Object bufferOwner, int numRemainingConsecutiveBuffers) voidMemoryTierConsumerAgent.updateTierShuffleDescriptor(TieredStoragePartitionId partitionId, TieredStorageInputChannelId inputChannelId, TieredStorageSubpartitionId subpartitionId, TierShuffleDescriptor tierShuffleDescriptor) -
Uses of TieredStorageSubpartitionId in org.apache.flink.runtime.io.network.partition.hybrid.tiered.tier.remote
Methods in org.apache.flink.runtime.io.network.partition.hybrid.tiered.tier.remote with parameters of type TieredStorageSubpartitionIdModifier and TypeMethodDescriptionRemoteTierConsumerAgent.getNextBuffer(TieredStoragePartitionId partitionId, TieredStorageSubpartitionId subpartitionId, int segmentId) voidRemoteTierConsumerAgent.notifyAvailable(TieredStoragePartitionId partitionId, TieredStorageSubpartitionId subpartitionId) booleanRemoteTierProducerAgent.tryStartNewSegment(TieredStorageSubpartitionId subpartitionId, int segmentId, int minNumBuffers) booleanRemoteTierProducerAgent.tryWrite(TieredStorageSubpartitionId subpartitionId, Buffer buffer, Object bufferOwner, int numRemainingConsecutiveBuffers) voidRemoteTierConsumerAgent.updateTierShuffleDescriptor(TieredStoragePartitionId partitionId, TieredStorageInputChannelId inputChannelId, TieredStorageSubpartitionId subpartitionId, TierShuffleDescriptor tierShuffleDescriptor) voidRemoteStorageScanner.watchSegment(TieredStoragePartitionId partitionId, TieredStorageSubpartitionId subpartitionId, int segmentId) Watch the segment for a specific subpartition in theRemoteStorageScanner.Method parameters in org.apache.flink.runtime.io.network.partition.hybrid.tiered.tier.remote with type arguments of type TieredStorageSubpartitionIdModifier and TypeMethodDescriptionvoidRemoteStorageScanner.registerAvailabilityAndPriorityNotifier(BiConsumer<TieredStoragePartitionId, TieredStorageSubpartitionId> availabilityNotifier)