Interface PartitionableTableSource
Deprecated.
An interface for partitionable
TableSource.
A PartitionableTableSource can exclude partitions from reading, which includes
skipping the metadata. This is especially useful when there are thousands of partitions in a
table.
A partition is represented as a Map<String, String> which maps from partition field
name to partition value. Since the map is NOT ordered, the correct order of partition fields
should be obtained via partition keys of catalog table.
-
Method Summary
Modifier and TypeMethodDescriptionapplyPartitionPruning(List<Map<String, String>> remainingPartitions) Deprecated.Applies the remaining partitions to the table source.Deprecated.Returns all the partitions of thisPartitionableTableSource.
-
Method Details
-
getPartitions
Deprecated.Returns all the partitions of thisPartitionableTableSource. -
applyPartitionPruning
Deprecated.Applies the remaining partitions to the table source. TheremainingPartitionsis the remaining partitions ofgetPartitions()after partition pruning applied.After trying to apply partition pruning, we should return a new
TableSourceinstance which holds all pruned-partitions.- Parameters:
remainingPartitions- Remaining partitions after partition pruning applied.- Returns:
- A new cloned instance of
TableSourceholds all pruned-partitions.
-
DynamicTableSource. UseSupportsPartitionPushDowninstead. See FLIP-95 for more information.