Packages

class StateStoreConf extends Serializable

A class that contains configuration parameters for StateStores.

Linear Supertypes
Serializable, Serializable, AnyRef, Any
Ordering
  1. Alphabetic
  2. By Inheritance
Inherited
  1. StateStoreConf
  2. Serializable
  3. Serializable
  4. AnyRef
  5. Any
  1. Hide All
  2. Show All
Visibility
  1. Public
  2. All

Instance Constructors

  1. new StateStoreConf()
  2. new StateStoreConf(sqlConf: SQLConf, extraOptions: Map[String, String] = Map.empty)

Value Members

  1. final def !=(arg0: Any): Boolean
    Definition Classes
    AnyRef → Any
  2. final def ##(): Int
    Definition Classes
    AnyRef → Any
  3. final def ==(arg0: Any): Boolean
    Definition Classes
    AnyRef → Any
  4. final def asInstanceOf[T0]: T0
    Definition Classes
    Any
  5. def clone(): AnyRef
    Attributes
    protected[lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( ... ) @native() @HotSpotIntrinsicCandidate()
  6. val compressionCodec: String

    The compression codec used to compress delta and snapshot files.

  7. val confs: Map[String, String]

    Additional configurations related to state store.

    Additional configurations related to state store. This will capture all configs in SQLConf that start with spark.sql.streaming.stateStore. and extraOptions for a specific operator.

  8. final def eq(arg0: AnyRef): Boolean
    Definition Classes
    AnyRef
  9. def equals(arg0: Any): Boolean
    Definition Classes
    AnyRef → Any
  10. val formatValidationCheckValue: Boolean

    Whether validate the value format when the format invalidation enabled.

  11. val formatValidationEnabled: Boolean

    Whether validate the underlying format or not.

  12. final def getClass(): Class[_]
    Definition Classes
    AnyRef → Any
    Annotations
    @native() @HotSpotIntrinsicCandidate()
  13. def hashCode(): Int
    Definition Classes
    AnyRef → Any
    Annotations
    @native() @HotSpotIntrinsicCandidate()
  14. final def isInstanceOf[T0]: Boolean
    Definition Classes
    Any
  15. val maintenanceInterval: Long

    The interval of maintenance tasks.

  16. val maxVersionsToRetainInMemory: Int

    Maximum count of versions a State Store implementation should retain in memory

  17. val minDeltasForSnapshot: Int

    Minimum number of delta files in a chain after which HDFSBackedStateStore will consider generating a snapshot.

  18. val minVersionsToRetain: Int

    Minimum versions a State Store implementation should retain to allow rollbacks

  19. final def ne(arg0: AnyRef): Boolean
    Definition Classes
    AnyRef
  20. final def notify(): Unit
    Definition Classes
    AnyRef
    Annotations
    @native() @HotSpotIntrinsicCandidate()
  21. final def notifyAll(): Unit
    Definition Classes
    AnyRef
    Annotations
    @native() @HotSpotIntrinsicCandidate()
  22. val providerClass: String

    Optional fully qualified name of the subclass of StateStoreProvider managing state data.

    Optional fully qualified name of the subclass of StateStoreProvider managing state data. That is, the implementation of the State Store to use.

  23. val stateSchemaCheckEnabled: Boolean

    whether to validate state schema during query run.

  24. final def synchronized[T0](arg0: ⇒ T0): T0
    Definition Classes
    AnyRef
  25. def toString(): String
    Definition Classes
    AnyRef → Any
  26. final def wait(arg0: Long, arg1: Int): Unit
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  27. final def wait(arg0: Long): Unit
    Definition Classes
    AnyRef
    Annotations
    @throws( ... ) @native()
  28. final def wait(): Unit
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )

Deprecated Value Members

  1. def finalize(): Unit
    Attributes
    protected[lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( classOf[java.lang.Throwable] ) @Deprecated
    Deprecated

Inherited from Serializable

Inherited from Serializable

Inherited from AnyRef

Inherited from Any

Ungrouped