Package org.apache.flink.connector.file.table
package org.apache.flink.connector.file.table
-
ClassDescriptionA bin packing implementation.A
BulkFormat.RecordIteratorthat returnsRowDatas.ContinuousPartitionFetcher<P,T extends Comparable<T>> Partition fetcher for helping continuously fetch partitioned table.ContinuousPartitionFetcher.Context<P,T extends Comparable<T>> Context for fetch partitions, partition information is stored in hive meta store.DefaultPartitionTimeExtractor.Adapter to turn aDeserializationSchemainto aBulkFormat.Dynamic partition writer to writing multiple partitions at the same time, it maybe consumes more memory.Empty implementationTableMetaStoreFactory.An implementation ofRowDatawhich is backed by twoRowDatawith a well-defined index mapping, One of the rows is fixed, while the other can be swapped for performant changes in hot code paths.File system file committer implementation.Options for the filesystem connector.Statistics types for file system, seeFileSystemConnectorOptions.SOURCE_REPORT_STATISTICS.Trigger types for partition commit, seeFileSystemConnectorOptions.SINK_PARTITION_COMMIT_TRIGGER.A factory to create file systems.File systemOutputFormatfor batch job.Builder to buildFileSystemOutputFormat.File systemTableFactory.File systemDynamicTableSink.Project row to non-partition fields.Table bucket assigner, wrapPartitionComputer.TableRollingPolicy, it extendsCheckpointRollingPolicyfor bulk writers.File system table source.PartitionWriterfor grouped dynamic partition inserting.LimitableBulkFormat<T,SplitT extends FileSourceSplit> ABulkFormatthat can limit output record number.Partition commit policy to update metastore.A factory to create anOutputFormat.Policy for commit a partition.Context of policy, including table information and partition information.A factory to createPartitionCommitPolicychain.Compute partition path from record and project non-partition columns for output writer.Fetcher to fetch the suitable partitions of a filesystem table.Context for fetch partitions, partition information is stored in hive meta store.PartitionFetcher.Context.ComparablePartitionValue<P,T extends Comparable<T>> A comparable partition value that can compare order by using its comparator.PartitionFieldExtractor<T extends FileSourceSplit>Interface to extract partition field from split.Loader to temporary files to final output path and meta store.PartitionReader<P,OUT> Reader that reads record from given partitions.Manage temporary files for writing files.Time extractor to extract time from partition values.Partition writer to write records with partition.Context for partition writer, provide some information and generation utils.Default implementation for PartitionWriterListener.Listener for partition writer.Factory ofPartitionWriterto avoid virtual function calls.PartitionComputerforRowData.PartitionComputerforRow.Adapter to turn aSerializationSchemainto aEncoder.PartitionWriterfor single directory writer.Partition commit policy to add success file to directory.Meta store factory to createTableMetaStoreFactory.TableMetaStore.Meta store to manage the location paths of this table and its partitions.