Package org.apache.flink.formats.csv

Class AbstractCsvInputFormat<T>

java.lang.Object
org.apache.flink.api.common.io.RichInputFormat<OT,org.apache.flink.core.fs.FileInputSplit>
org.apache.flink.api.common.io.FileInputFormat<T>
org.apache.flink.formats.csv.AbstractCsvInputFormat<T>
All Implemented Interfaces:
Serializable, org.apache.flink.api.common.io.InputFormat<T,org.apache.flink.core.fs.FileInputSplit>, org.apache.flink.core.io.InputSplitSource<org.apache.flink.core.fs.FileInputSplit>
Direct Known Subclasses:
RowCsvInputFormat
public abstract class AbstractCsvInputFormat<T> extends org.apache.flink.api.common.io.FileInputFormat<T>
Input format that reads csv. This abstract class is responsible for cutting the boundary of InputSplit.
See Also:

  • Nested Class Summary

    Nested classes/interfaces inherited from class org.apache.flink.api.common.io.FileInputFormat

    org.apache.flink.api.common.io.FileInputFormat.FileBaseStatistics, org.apache.flink.api.common.io.FileInputFormat.InputSplitOpenThread

  • Field Summary

    Fields
    Modifier and Type
    Field
    Description
    protected InputStream
    csvInputStream
     
    protected final org.apache.flink.shaded.jackson2.com.fasterxml.jackson.dataformat.csv.CsvSchema
    csvSchema
     

    Fields inherited from class org.apache.flink.api.common.io.FileInputFormat

    currentSplit, enumerateNestedFiles, INFLATER_INPUT_STREAM_FACTORIES, minSplitSize, numSplits, openTimeout, READ_WHOLE_SPLIT_FLAG, splitLength, splitStart, stream, unsplittable

  • Constructor Summary

    Constructors
    Constructor
    Description
    AbstractCsvInputFormat(org.apache.flink.core.fs.Path[] filePaths, org.apache.flink.shaded.jackson2.com.fasterxml.jackson.dataformat.csv.CsvSchema csvSchema)
     

  • Method Summary

    Modifier and Type
    Method
    Description
    void
    open(org.apache.flink.core.fs.FileInputSplit split)
     

    Methods inherited from class org.apache.flink.api.common.io.FileInputFormat

    acceptFile, close, configure, createInputSplits, decorateInputStream, extractFileExtension, getFilePaths, getFileStats, getFileStats, getInflaterInputStreamFactory, getInputSplitAssigner, getMinSplitSize, getNestedFileEnumeration, getNumSplits, getOpenTimeout, getSplitLength, getSplitStart, getStatistics, getSupportedCompressionFormats, registerInflaterInputStreamFactory, setFilePath, setFilePath, setFilePaths, setFilePaths, setFilesFilter, setMinSplitSize, setNestedFileEnumeration, setNumSplits, setOpenTimeout, testForUnsplittable, toString

    Methods inherited from class org.apache.flink.api.common.io.RichInputFormat

    closeInputFormat, getRuntimeContext, openInputFormat, setRuntimeContext

    Methods inherited from class java.lang.Object

    clone, equals, finalize, getClass, hashCode, notify, notifyAll, wait, wait, wait

    Methods inherited from interface org.apache.flink.api.common.io.InputFormat

    nextRecord, reachedEnd

  • Field Details

    • csvSchema

      protected final org.apache.flink.shaded.jackson2.com.fasterxml.jackson.dataformat.csv.CsvSchema csvSchema

    • csvInputStream

      protected transient InputStream csvInputStream

  • Constructor Details

    • AbstractCsvInputFormat

      public AbstractCsvInputFormat(org.apache.flink.core.fs.Path[] filePaths, org.apache.flink.shaded.jackson2.com.fasterxml.jackson.dataformat.csv.CsvSchema csvSchema)

  • Method Details

    • open

      public void open(org.apache.flink.core.fs.FileInputSplit split) throws IOException
      Specified by:
      open in interface org.apache.flink.api.common.io.InputFormat<T,org.apache.flink.core.fs.FileInputSplit>
      Overrides:
      open in class org.apache.flink.api.common.io.FileInputFormat<T>
      Throws:
      IOException