Class DeltaHelper

java.lang.Object
org.apache.polaris.spark.utils.DeltaHelper

public class DeltaHelper extends Object
Helper class for integrating Delta table functionality with Polaris Spark Catalog.

This class is responsible for dynamically loading and configuring a Delta Catalog implementation to work with Polaris. It sets up the Delta Catalog as a delegating catalog extension with Polaris Spark Catalog as the delegate, enabling Delta table operations through Polaris.

The class uses reflection to configure the Delta Catalog to behave identically to Unity Catalog, as the current Delta Catalog implementation is hardcoded for Unity Catalog. This is a temporary workaround until Delta extends support for other catalog implementations (see https://github.com/delta-io/delta/issues/4306).

  • Field Details

  • Constructor Details

    • DeltaHelper

      public DeltaHelper(org.apache.spark.sql.util.CaseInsensitiveStringMap options)
  • Method Details

    • loadDeltaCatalog

      public org.apache.spark.sql.connector.catalog.TableCatalog loadDeltaCatalog(PolarisSparkCatalog polarisSparkCatalog)