Type Members

1.  class Spark3Util extends AnyRef

   Derived from Apache Iceberg's Spark3Util class.

2.  class SparkConfParser extends AnyRef

   Derived from Apache Iceberg's SparkConfParser class.

3.  class SparkFilters extends AnyRef

   Derived from Apache Iceberg's SparkFilters class.

4.  class SparkReadConf extends AnyRef

   A class for common Iceberg configs for Spark reads.

   A class for common Iceberg configs for Spark reads. Derived from Apache Iceberg's SparkReadConf class.

   If a config is set at multiple levels, the following order of precedence is used (top to bottom):

   • Read options
   • Session configuration
   • Table metadata

   The most specific value is set in read options and takes precedence over all other configs. If no read option is provided, this class checks the session configuration for any overrides. If no applicable value is found in the session configuration, this class uses the table metadata.

   Note this class is NOT meant to be serialized and sent to executors.

5.  class SparkReadOptions extends AnyRef

   Spark DF read options.

   Spark DF read options. Derived from Apache Iceberg's SparkReadOptions class.

6.  class SparkSQLProperties extends AnyRef

   Derived from Apache Iceberg's SparkSQLProperties class.

7.  class SparkSchemaUtil extends AnyRef

   Helper methods for working with Spark/Hive metadata.

   Helper methods for working with Spark/Hive metadata. Derived from Apache Iceberg's SparkSchemaUtil class.

8.  class SparkUtil extends AnyRef

   Derived from Apache Iceberg's SparkUtil class.

9.  class TypeToSparkType extends SchemaVisitor[DataType]

   Derived from Apache Iceberg's TypeToSparkType class.