Type Members

1.  abstract class BaseHashJoinIterator extends SplittableJoinIterator
2.  class BatchPartitionIdPassthrough extends Partitioner

   A dummy partitioner for use with records whose partition ids have been pre-computed (i.e.

   A dummy partitioner for use with records whose partition ids have been pre-computed (i.e. for use on RDDs of (Int, Row) pairs where the Int is a partition id in the expected range).

3.  class CoalescedBatchPartitioner extends Partitioner

   A Partitioner that might group together one or more partitions from the parent.

4.  class ConditionalHashJoinIterator extends BaseHashJoinIterator

   An iterator that does a hash join against a stream of batches with an inequality condition.

   An iterator that does a hash join against a stream of batches with an inequality condition. The compiled condition will be closed when this iterator is closed.

5.  class ConditionalNestedLoopExistenceJoinIterator extends ExistenceJoinIterator
6.  class ConditionalNestedLoopJoinIterator extends SplittableJoinIterator
7.  class CrossJoinIterator extends AbstractGpuJoinIterator

   An iterator that does a cross join against a stream of batches.

8.  abstract class ExistenceJoinIterator extends Iterator[ColumnarBatch] with TaskAutoCloseableResource with Arm

   Existence join generates an exists boolean column with true or false in it, then appends it to the output columns.

   Existence join generates an exists boolean column with true or false in it, then appends it to the output columns. The true in exists column indicates left table should retain that row, the row number of exists equals to the row number of left table.

   e.g.: select * from left_table where left_table.column_0 >= 3 or exists (select * from right_table where left_table.column_1 < right_table.column_1) Explanation of this sql is: Filter(left_table.column_0 >= 3 or `exists`) Existence_join (left + `exists`) // `exists` do not shrink or expand the rows of left table left_table right_table

9.  case class GpuBroadcastExchangeExec(mode: BroadcastMode, child: SparkPlan) extends GpuBroadcastExchangeExecBase with Product with Serializable
10.  abstract class GpuBroadcastExchangeExecBase extends Exchange with ShimBroadcastExchangeLike with ShimUnaryExecNode with GpuExec
11.  class GpuBroadcastMeta extends SparkPlanMeta[BroadcastExchangeExec]
12.  case class GpuBroadcastNestedLoopJoinExec(left: SparkPlan, right: SparkPlan, joinType: JoinType, gpuBuildSide: GpuBuildSide, condition: Option[Expression], targetSizeBytes: Long) extends SparkPlan with ShimBinaryExecNode with GpuExec with Product with Serializable
13.  class GpuBroadcastNestedLoopJoinMeta extends GpuBroadcastJoinMeta[BroadcastNestedLoopJoinExec]
14.  class GpuColumnToRowMapPartitionsRDD extends MapPartitionsRDD[InternalRow, ColumnarBatch]
15.  case class GpuCustomShuffleReaderExec(child: SparkPlan, partitionSpecs: Seq[ShufflePartitionSpec]) extends SparkPlan with ShimUnaryExecNode with GpuExec with Product with Serializable

    A wrapper of shuffle query stage, which follows the given partition arrangement.

    A wrapper of shuffle query stage, which follows the given partition arrangement.

    child

    It is usually ShuffleQueryStageExec, but can be the shuffle exchange node during canonicalization.

    partitionSpecs

    The partition specs that defines the arrangement.

16.  trait GpuHashJoin extends SparkPlan with GpuExec
17.  abstract class GpuShuffleExchangeExecBase extends Exchange with ShimUnaryExecNode with GpuExec

    Performs a shuffle that will result in the desired partitioning.

18.  abstract class GpuShuffleExchangeExecBaseWithMetrics extends GpuShuffleExchangeExecBase

    Performs a shuffle that will result in the desired partitioning.

19.  class GpuShuffleMeta extends SparkPlanMeta[ShuffleExchangeExec]
20.  case class GpuSubqueryBroadcastExec(name: String, index: Int, buildKeys: Seq[Expression], child: SparkPlan)(modeKeys: Option[Seq[Expression]]) extends BaseSubqueryExec with GpuExec with ShimUnaryExecNode with Product with Serializable
21.  class GpuSubqueryBroadcastMeta extends SparkPlanMeta[SubqueryBroadcastExec]
22.  class HashJoinIterator extends BaseHashJoinIterator

    An iterator that does a hash join against a stream of batches.

23.  class HashedExistenceJoinIterator extends ExistenceJoinIterator
24.  class SerializeBatchDeserializeHostBuffer extends Serializable with AutoCloseable with Arm

    Annotations

    @SerialVersionUID()

25.  class SerializeConcatHostBuffersDeserializeBatch extends Serializable with Arm with AutoCloseable

    Annotations

    @SerialVersionUID()

26.  class ShuffledBatchRDD extends RDD[ColumnarBatch]

    This is a specialized version of org.apache.spark.rdd.ShuffledRDD that is optimized for shuffling ColumnarBatch instead of Java key-value pairs.

    This is a specialized version of org.apache.spark.rdd.ShuffledRDD that is optimized for shuffling ColumnarBatch instead of Java key-value pairs.

    This RDD takes a ShuffleDependency (dependency), and an array of ShufflePartitionSpec as input arguments.

    The dependency has the parent RDD of this RDD, which represents the dataset before shuffle (i.e. map output). Elements of this RDD are (partitionId, Row) pairs. Partition ids should be in the range [0, numPartitions - 1]. dependency.partitioner is the original partitioner used to partition map output, and dependency.partitioner.numPartitions is the number of pre-shuffle partitions (i.e. the number of partitions of the map output).

    This code is made to try and match the Spark code as closely as possible to make maintenance simpler. Fixing compiler or IDE warnings in this code may not be ideal if the same warnings are in Spark.

27.  case class ShuffledBatchRDDPartition(index: Int, spec: ShufflePartitionSpec) extends Partition with Product with Serializable