Uses of Class
org.apache.flink.connector.file.src.FileSourceSplit
Packages that use FileSourceSplit
Package
Description
-
Uses of FileSourceSplit in org.apache.flink.connector.file.src
Classes in org.apache.flink.connector.file.src with type parameters of type FileSourceSplitModifier and TypeClassDescriptionclassAbstractFileSource<T,SplitT extends FileSourceSplit> The base class for File Sources.protected static classAbstractFileSource.AbstractFileSourceBuilder<T,SplitT extends FileSourceSplit, SELF extends AbstractFileSource.AbstractFileSourceBuilder<T, SplitT, SELF>> The generic base builder.final classFileSourceSplitState<SplitT extends FileSourceSplit>State of the reader, essentially a mutable version of theFileSourceSplit.classPendingSplitsCheckpoint<SplitT extends FileSourceSplit>A checkpoint of the current state of the containing the currently pending splits that are not yet assigned.final classPendingSplitsCheckpointSerializer<T extends FileSourceSplit>A serializer for thePendingSplitsCheckpoint.Methods in org.apache.flink.connector.file.src with type parameters of type FileSourceSplitModifier and TypeMethodDescriptionstatic <T extends FileSourceSplit>
PendingSplitsCheckpoint<T>PendingSplitsCheckpoint.fromCollectionSnapshot(Collection<T> splits) static <T extends FileSourceSplit>
PendingSplitsCheckpoint<T>PendingSplitsCheckpoint.fromCollectionSnapshot(Collection<T> splits, Collection<org.apache.flink.core.fs.Path> alreadyProcessedPaths) Methods in org.apache.flink.connector.file.src that return FileSourceSplitModifier and TypeMethodDescriptionFileSourceSplitSerializer.deserialize(int version, byte[] serialized) FileSourceSplit.updateWithCheckpointedPosition(CheckpointedPosition position) Creates a copy of this split where the checkpointed position is replaced by the given new position.Methods in org.apache.flink.connector.file.src that return types with arguments of type FileSourceSplitModifier and TypeMethodDescriptionorg.apache.flink.core.io.SimpleVersionedSerializer<FileSourceSplit>FileSource.getSplitSerializer()Methods in org.apache.flink.connector.file.src with parameters of type FileSourceSplitModifier and TypeMethodDescriptionbyte[]FileSourceSplitSerializer.serialize(FileSourceSplit split) Method parameters in org.apache.flink.connector.file.src with type arguments of type FileSourceSplitModifier and TypeMethodDescriptionstatic <T> FileSource.FileSourceBuilder<T>FileSource.forBulkFileFormat(BulkFormat<T, FileSourceSplit> bulkFormat, org.apache.flink.core.fs.Path... paths) Builds a newFileSourceusing aBulkFormatto read batches of records from files. -
Uses of FileSourceSplit in org.apache.flink.connector.file.src.assigners
Methods in org.apache.flink.connector.file.src.assigners that return types with arguments of type FileSourceSplitModifier and TypeMethodDescriptionGets the next split.FileSplitAssigner.remainingSplits()Gets the remaining splits that this assigner has pending.LocalityAwareSplitAssigner.remainingSplits()SimpleSplitAssigner.remainingSplits()Method parameters in org.apache.flink.connector.file.src.assigners with type arguments of type FileSourceSplitModifier and TypeMethodDescriptionvoidFileSplitAssigner.addSplits(Collection<FileSourceSplit> splits) Adds a set of splits to this assigner.voidLocalityAwareSplitAssigner.addSplits(Collection<FileSourceSplit> splits) voidSimpleSplitAssigner.addSplits(Collection<FileSourceSplit> newSplits) FileSplitAssigner.Provider.create(Collection<FileSourceSplit> initialSplits) Creates a newFileSplitAssignerthat starts with the given set of initial splits.Constructor parameters in org.apache.flink.connector.file.src.assigners with type arguments of type FileSourceSplit -
Uses of FileSourceSplit in org.apache.flink.connector.file.src.enumerate
Methods in org.apache.flink.connector.file.src.enumerate that return types with arguments of type FileSourceSplitModifier and TypeMethodDescriptionFileEnumerator.enumerateSplits(org.apache.flink.core.fs.Path[] paths, int minDesiredSplits) Generates all file splits for the relevant files under the given paths.NonSplittingRecursiveEnumerator.enumerateSplits(org.apache.flink.core.fs.Path[] paths, int minDesiredSplits) Method parameters in org.apache.flink.connector.file.src.enumerate with type arguments of type FileSourceSplitModifier and TypeMethodDescriptionprotected voidBlockSplittingRecursiveAllDirEnumerator.addSplitsForPath(org.apache.flink.core.fs.FileStatus fileStatus, org.apache.flink.core.fs.FileSystem fs, ArrayList<FileSourceSplit> target) protected voidNonSplittingRecursiveAllDirEnumerator.addSplitsForPath(org.apache.flink.core.fs.FileStatus fileStatus, org.apache.flink.core.fs.FileSystem fs, ArrayList<FileSourceSplit> target) protected voidNonSplittingRecursiveEnumerator.addSplitsForPath(org.apache.flink.core.fs.FileStatus fileStatus, org.apache.flink.core.fs.FileSystem fs, ArrayList<FileSourceSplit> target) protected voidBlockSplittingRecursiveEnumerator.convertToSourceSplits(org.apache.flink.core.fs.FileStatus file, org.apache.flink.core.fs.FileSystem fs, List<FileSourceSplit> target) protected voidNonSplittingRecursiveEnumerator.convertToSourceSplits(org.apache.flink.core.fs.FileStatus file, org.apache.flink.core.fs.FileSystem fs, List<FileSourceSplit> target) -
Uses of FileSourceSplit in org.apache.flink.connector.file.src.impl
Classes in org.apache.flink.connector.file.src.impl with type parameters of type FileSourceSplitModifier and TypeClassDescriptionclassDynamicFileSplitEnumerator<SplitT extends FileSourceSplit>A SplitEnumerator implementation that supports dynamic filtering.final classFileSourceReader<T,SplitT extends FileSourceSplit> ASourceReaderthat read records fromFileSourceSplit.Methods in org.apache.flink.connector.file.src.impl that return types with arguments of type FileSourceSplitModifier and TypeMethodDescriptionContinuousFileSplitEnumerator.snapshotState(long checkpointId) StaticFileSplitEnumerator.snapshotState(long checkpointId) Methods in org.apache.flink.connector.file.src.impl with parameters of type FileSourceSplitModifier and TypeMethodDescriptionStreamFormatAdapter.createReader(org.apache.flink.configuration.Configuration config, FileSourceSplit split) StreamFormatAdapter.restoreReader(org.apache.flink.configuration.Configuration config, FileSourceSplit split) Method parameters in org.apache.flink.connector.file.src.impl with type arguments of type FileSourceSplitModifier and TypeMethodDescriptionvoidContinuousFileSplitEnumerator.addSplitsBack(List<FileSourceSplit> splits, int subtaskId) voidStaticFileSplitEnumerator.addSplitsBack(List<FileSourceSplit> splits, int subtaskId) Constructor parameters in org.apache.flink.connector.file.src.impl with type arguments of type FileSourceSplitModifierConstructorDescriptionContinuousFileSplitEnumerator(org.apache.flink.api.connector.source.SplitEnumeratorContext<FileSourceSplit> context, FileEnumerator enumerator, FileSplitAssigner splitAssigner, org.apache.flink.core.fs.Path[] paths, Collection<org.apache.flink.core.fs.Path> alreadyDiscoveredPaths, long discoveryInterval) StaticFileSplitEnumerator(org.apache.flink.api.connector.source.SplitEnumeratorContext<FileSourceSplit> context, FileSplitAssigner splitAssigner) -
Uses of FileSourceSplit in org.apache.flink.connector.file.src.reader
Classes in org.apache.flink.connector.file.src.reader with type parameters of type FileSourceSplitModifier and TypeInterfaceDescriptioninterfaceBulkFormat<T,SplitT extends FileSourceSplit> TheBulkFormatreads and decodes batches of records at a time. -
Uses of FileSourceSplit in org.apache.flink.connector.file.table
Classes in org.apache.flink.connector.file.table with type parameters of type FileSourceSplitModifier and TypeClassDescriptionclassLimitableBulkFormat<T,SplitT extends FileSourceSplit> ABulkFormatthat can limit output record number.interfacePartitionFieldExtractor<T extends FileSourceSplit>Interface to extract partition field from split.Methods in org.apache.flink.connector.file.table with type parameters of type FileSourceSplitModifier and TypeMethodDescriptionstatic <T,SplitT extends FileSourceSplit>
BulkFormat<T,SplitT> LimitableBulkFormat.create(BulkFormat<T, SplitT> format, Long limit) Methods in org.apache.flink.connector.file.table that return types with arguments of type FileSourceSplitMethods in org.apache.flink.connector.file.table with parameters of type FileSourceSplitModifier and TypeMethodDescriptionorg.apache.flink.connector.file.table.DeserializationSchemaAdapter.ReaderDeserializationSchemaAdapter.createReader(org.apache.flink.configuration.Configuration config, FileSourceSplit split) org.apache.flink.connector.file.table.DeserializationSchemaAdapter.ReaderDeserializationSchemaAdapter.restoreReader(org.apache.flink.configuration.Configuration config, FileSourceSplit split) Constructor parameters in org.apache.flink.connector.file.table with type arguments of type FileSourceSplitModifierConstructorDescriptionFileSystemTableSource(org.apache.flink.table.catalog.ObjectIdentifier tableIdentifier, org.apache.flink.table.types.DataType physicalRowDataType, List<String> partitionKeys, org.apache.flink.configuration.ReadableConfig tableOptions, org.apache.flink.table.connector.format.DecodingFormat<BulkFormat<org.apache.flink.table.data.RowData, FileSourceSplit>> bulkReaderFormat, org.apache.flink.table.connector.format.DecodingFormat<org.apache.flink.api.common.serialization.DeserializationSchema<org.apache.flink.table.data.RowData>> deserializationFormat) -
Uses of FileSourceSplit in org.apache.flink.connector.file.table.stream.compact
Method parameters in org.apache.flink.connector.file.table.stream.compact with type arguments of type FileSourceSplitModifier and TypeMethodDescriptionstatic <T> CompactReader.Factory<T>CompactBulkReader.factory(BulkFormat<T, FileSourceSplit> format)