Package org.apache.flink.formats.parquet

Class ParquetVectorizedInputFormat.ParquetReaderBatch<T>

java.lang.Object
org.apache.flink.formats.parquet.ParquetVectorizedInputFormat.ParquetReaderBatch<T>
Enclosing class:
ParquetVectorizedInputFormat<T,SplitT extends org.apache.flink.connector.file.src.FileSourceSplit>
protected abstract static class ParquetVectorizedInputFormat.ParquetReaderBatch<T> extends Object
Reader batch that provides writing and reading capabilities. Provides BulkFormat.RecordIterator reading interface from convertAndGetIterator(long).

  • Field Summary

    Fields
    Modifier and Type
    Field
    Description
    protected final org.apache.flink.table.data.columnar.vector.VectorizedColumnBatch
    columnarBatch
     

  • Constructor Summary

    Constructors
    Modifier
    Constructor
    Description
    protected
    ParquetReaderBatch(org.apache.flink.table.data.columnar.vector.writable.WritableColumnVector[] writableVectors, org.apache.flink.table.data.columnar.vector.VectorizedColumnBatch columnarBatch, org.apache.flink.connector.file.src.util.Pool.Recycler<ParquetVectorizedInputFormat.ParquetReaderBatch<T>> recycler)
     

  • Method Summary

    Modifier and Type
    Method
    Description
    abstract org.apache.flink.connector.file.src.reader.BulkFormat.RecordIterator<T>
    convertAndGetIterator(long rowsReturned)
    Provides reading iterator after the records are written to the columnarBatch.
    void
    recycle()
     

    Methods inherited from class java.lang.Object

    clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

  • Field Details

    • columnarBatch

      protected final org.apache.flink.table.data.columnar.vector.VectorizedColumnBatch columnarBatch

  • Constructor Details

    • ParquetReaderBatch

      protected ParquetReaderBatch(org.apache.flink.table.data.columnar.vector.writable.WritableColumnVector[] writableVectors, org.apache.flink.table.data.columnar.vector.VectorizedColumnBatch columnarBatch, org.apache.flink.connector.file.src.util.Pool.Recycler<ParquetVectorizedInputFormat.ParquetReaderBatch<T>> recycler)

  • Method Details

    • recycle

      public void recycle()

    • convertAndGetIterator

      public abstract org.apache.flink.connector.file.src.reader.BulkFormat.RecordIterator<T> convertAndGetIterator(long rowsReturned) throws IOException
      Provides reading iterator after the records are written to the columnarBatch.
      Parameters:
      rowsReturned - The number of rows that have been returned before this batch.
      Throws:
      IOException