Package org.apache.polaris.spark

Class SparkCatalog

java.lang.Object

org.apache.polaris.spark.BasePolarisSparkCatalog

org.apache.polaris.spark.SparkCatalog

All Implemented Interfaces:

org.apache.iceberg.spark.SupportsReplaceView, org.apache.spark.sql.connector.catalog.CatalogPlugin, org.apache.spark.sql.connector.catalog.StagingTableCatalog, org.apache.spark.sql.connector.catalog.SupportsNamespaces, org.apache.spark.sql.connector.catalog.TableCatalog, org.apache.spark.sql.connector.catalog.ViewCatalog

public class SparkCatalog
extends BasePolarisSparkCatalog
implements org.apache.spark.sql.connector.catalog.ViewCatalog, org.apache.iceberg.spark.SupportsReplaceView

Spark 4.0 SparkCatalog implementation.

Field Summary

Fields inherited from class org.apache.polaris.spark.BasePolarisSparkCatalog

catalogName, deltaHelper, hudiHelper, icebergsSparkCatalog, paimonHelper, polarisSparkCatalog

Fields inherited from interface org.apache.spark.sql.connector.catalog.SupportsNamespaces

PROP_COMMENT, PROP_LOCATION, PROP_OWNER

Fields inherited from interface org.apache.spark.sql.connector.catalog.TableCatalog

OPTION_PREFIX, PROP_COLLATION, PROP_COMMENT, PROP_EXTERNAL, PROP_IS_MANAGED_LOCATION, PROP_LOCATION, PROP_OWNER, PROP_PROVIDER

Fields inherited from interface org.apache.spark.sql.connector.catalog.ViewCatalog

PROP_COMMENT, PROP_CREATE_ENGINE_VERSION, PROP_ENGINE_VERSION, PROP_OWNER, RESERVED_PROPERTIES

Constructor Summary

Constructors

Constructor	Description
SparkCatalog()

Method Summary

Modifier and Type	Method	Description
protected PolarisCatalogUtils	createCatalogUtils()
org.apache.spark.sql.connector.catalog.View	createView(org.apache.spark.sql.connector.catalog.ViewInfo viewInfo)
org.apache.spark.sql.connector.catalog.View	replaceView(org.apache.spark.sql.connector.catalog.ViewInfo viewInfo, boolean orCreate)

Methods inherited from class org.apache.polaris.spark.BasePolarisSparkCatalog

alterNamespace, alterTable, alterView, createNamespace, createTable, defaultNamespace, dropNamespace, dropTable, dropView, initialize, invalidateTable, listNamespaces, listNamespaces, listTables, listViews, loadNamespaceMetadata, loadTable, loadView, name, purgeTable, renameTable, renameView, replaceView, stageCreate, stageCreateOrReplace, stageReplace, validateAndResolveCatalogOptions

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface org.apache.spark.sql.connector.catalog.CatalogPlugin

defaultNamespace, initialize, name

Methods inherited from interface org.apache.spark.sql.connector.catalog.StagingTableCatalog

stageCreate, stageCreateOrReplace, stageReplace, supportedCustomMetrics

Methods inherited from interface org.apache.spark.sql.connector.catalog.SupportsNamespaces

namespaceExists

Methods inherited from interface org.apache.iceberg.spark.SupportsReplaceView

replaceView

Methods inherited from interface org.apache.spark.sql.connector.catalog.TableCatalog

capabilities, createTable, loadTable, loadTable, loadTable, tableExists, useNullableQuerySchema

Methods inherited from interface org.apache.spark.sql.connector.catalog.ViewCatalog

alterView, dropView, invalidateView, listViews, loadView, renameView, viewExists

Constructor Details

SparkCatalog

public SparkCatalog()

Method Details

createCatalogUtils

protected PolarisCatalogUtils createCatalogUtils()

Specified by:

createCatalogUtils in class BasePolarisSparkCatalog

createView

public org.apache.spark.sql.connector.catalog.View createView(org.apache.spark.sql.connector.catalog.ViewInfo viewInfo)
                                                       throws org.apache.spark.sql.catalyst.analysis.ViewAlreadyExistsException,
org.apache.spark.sql.catalyst.analysis.NoSuchNamespaceException

Specified by:

createView in interface org.apache.spark.sql.connector.catalog.ViewCatalog

Throws:

org.apache.spark.sql.catalyst.analysis.ViewAlreadyExistsException

org.apache.spark.sql.catalyst.analysis.NoSuchNamespaceException

replaceView

public org.apache.spark.sql.connector.catalog.View replaceView(org.apache.spark.sql.connector.catalog.ViewInfo viewInfo,
 boolean orCreate)
                                                        throws org.apache.spark.sql.catalyst.analysis.NoSuchNamespaceException,
org.apache.spark.sql.catalyst.analysis.NoSuchViewException

Specified by:

replaceView in interface org.apache.spark.sql.connector.catalog.ViewCatalog

Throws:

org.apache.spark.sql.catalyst.analysis.NoSuchNamespaceException

org.apache.spark.sql.catalyst.analysis.NoSuchViewException