Class PaimonHelper

java.lang.Object
org.apache.polaris.spark.utils.PaimonHelper

public class PaimonHelper extends Object
Helper class for integrating Apache Paimon table functionality with Polaris Spark Catalog.

This class is responsible for dynamically loading and configuring a Paimon Catalog implementation to work with Polaris. It sets up the Paimon Catalog as a delegating catalog extension with Polaris Spark Catalog as the delegate, enabling Paimon table operations through Polaris.

Apache Paimon is a streaming data lake platform with high-speed data ingestion, changelog tracking and efficient real-time analytics. This helper enables Polaris to manage Paimon tables alongside Iceberg, Delta, and Hudi tables in a unified catalog.

  • Field Details

  • Constructor Details

    • PaimonHelper

      public PaimonHelper(org.apache.spark.sql.util.CaseInsensitiveStringMap options)
  • Method Details

    • loadPaimonCatalog

      public org.apache.spark.sql.connector.catalog.TableCatalog loadPaimonCatalog(PolarisSparkCatalog polarisSparkCatalog)
      Load and configure the Paimon catalog with Polaris Spark Catalog as the delegate.
      Parameters:
      polarisSparkCatalog - the Polaris Spark Catalog to set as delegate
      Returns:
      the configured Paimon TableCatalog