package spark
- Alphabetic
- Public
- All
Type Members
- abstract class CurrentBatchIterator extends Iterator[ColumnarBatch] with AutoCloseable
-
class
ExclusiveModeGpuDiscoveryPlugin extends ResourceDiscoveryPlugin with Proxy
A Spark Resource Discovery Plugin that relies on the NVIDIA GPUs being in PROCESS_EXCLUSIVE mode so that it can discover free GPUs.
A Spark Resource Discovery Plugin that relies on the NVIDIA GPUs being in PROCESS_EXCLUSIVE mode so that it can discover free GPUs. This plugin iterates through all the GPUs on the node and tries to initialize a CUDA context on each one. When the GPUs are in process exclusive mode this will result in that GPU being assigned to the specific process running this plugin and other executors will not be able to use it.
This plugin can be activated in spark with the configuration:
--conf spark.resources.discoveryPlugin=com.nvidia.spark.ExclusiveModeGpuDiscoveryPlugin - trait GpuCachedBatchSerializer extends CachedBatchSerializer
-
class
ParquetCachedBatchSerializer extends GpuCachedBatchSerializer with Proxy
User facing wrapper class that calls into the internal version.
-
trait
RapidsUDF extends AnyRef
A RAPIDS accelerated version of a user-defined function (UDF).
-
class
SQLPlugin extends SparkPlugin with Logging
The RAPIDS plugin for Spark.
The RAPIDS plugin for Spark. To enable this plugin, set the config "spark.plugins" to
com.nvidia.spark.SQLPlugin
Value Members
- object RebaseHelper extends Arm
- object TimingUtils