Package org.apache.flink.runtime.io.network.partition.hybrid.tiered.file
package org.apache.flink.runtime.io.network.partition.hybrid.tiered.file
-
ClassDescription
PartitionFileReaderdefines the read logic for different types of shuffle files.A wrapper class of the reading buffer result, including the read buffers, the hint of continue reading, and the read progress, etc.ThisPartitionFileReader.ReadProgressdefines the read progress of thePartitionFileReader.ThePartitionFileWriterinterface defines the write logic for different types of shuffle files.ThePartitionFileWriter.SegmentBufferContextcontains all the buffers belonging to the segment.ThePartitionFileWriter.SubpartitionBufferContextcontains all the buffers belonging to one subpartition.The partition file in the producer-merge mode.TheProducerMergedPartitionFileIndexis used byProducerMergedPartitionFileWriterandProducerMergedPartitionFileReader, to maintain the offset of each buffer in the physical file.Represents a series of buffers that are: From the same subpartition Logically (i.e. buffer index) consecutive Physically (i.e. offset in the file) consecutiveThe implementation ofPartitionFileReaderwith producer-merge mode.The implementation ofPartitionFileReader.ReadProgressmainly includes current reading offset, end of read offset, etc.The implementation ofPartitionFileWriterwith producer-side merge mode.The partition file with segment file mode.The implementation ofPartitionFileReaderwith segment file mode.The implementation ofPartitionFileWriterwith segment file mode.