object SpillPriorities
Utility methods for managing spillable buffer priorities. The spill priority numerical space is divided into potentially overlapping ranges based on the type of buffer.
- Alphabetic
- By Inheritance
- SpillPriorities
- AnyRef
- Any
- Hide All
- Show All
- Public
- All
Value Members
-
final
def
!=(arg0: Any): Boolean
- Definition Classes
- AnyRef → Any
-
final
def
##(): Int
- Definition Classes
- AnyRef → Any
-
final
def
==(arg0: Any): Boolean
- Definition Classes
- AnyRef → Any
-
val
ACTIVE_BATCHING_PRIORITY: Long
Priority for multiple buffers being buffered within a call to next.
-
val
ACTIVE_ON_DECK_PRIORITY: Long
Priority for buffers that are waiting for next to be called.
Priority for buffers that are waiting for next to be called. i.e. data held between calls to
hasNextandnextor between different calls tonext. -
val
HOST_MEMORY_BUFFER_DIRECT_OFFSET: Long
Priority offset for host memory buffers directly allocated from the OS.
Priority offset for host memory buffers directly allocated from the OS. They are at higher priorities, thus freeing up memory pools first.
-
val
HOST_MEMORY_BUFFER_PAGEABLE_OFFSET: Long
Priority offset for host memory buffers allocated from the internal pageable memory pool.
Priority offset for host memory buffers allocated from the internal pageable memory pool. They are at higher priorities than pinned memory buffers, thus making more pinned memory available; but at lower priorities than directly allocated buffers, thus freeing up the internal pageable memory pool.
-
val
HOST_MEMORY_BUFFER_PINNED_OFFSET: Long
Priority offset for host memory buffers allocated from the pinned memory pool.
Priority offset for host memory buffers allocated from the pinned memory pool. They are at lower priorities, so will be spilled first, making more pinned memory available.
-
val
INPUT_FROM_SHUFFLE_PRIORITY: Long
Priorities for buffers received from shuffle.
Priorities for buffers received from shuffle. Shuffle input buffers are about to be read by a task, so spill them if there's no other choice, but leave some space at the end of the priority range so there can be some things after it.
-
val
OUTPUT_FOR_SHUFFLE_INITIAL_PRIORITY: Long
Priorities for task output buffers intended for shuffle.
-
def
applyPriorityOffset(originalPriority: Long, offset: Long): Long
Calculate a new priority based on an offset, clamping it to avoid wraparound.
Calculate a new priority based on an offset, clamping it to avoid wraparound.
- originalPriority
the original priority
- offset
the desired offset
- returns
the resulting priority, with clamping if needed
-
final
def
asInstanceOf[T0]: T0
- Definition Classes
- Any
-
def
clone(): AnyRef
- Attributes
- protected[lang]
- Definition Classes
- AnyRef
- Annotations
- @throws( ... ) @native() @HotSpotIntrinsicCandidate()
-
final
def
eq(arg0: AnyRef): Boolean
- Definition Classes
- AnyRef
-
def
equals(arg0: Any): Boolean
- Definition Classes
- AnyRef → Any
-
final
def
getClass(): Class[_]
- Definition Classes
- AnyRef → Any
- Annotations
- @native() @HotSpotIntrinsicCandidate()
- def getShuffleOutputBufferReadPriority: Long
-
def
hashCode(): Int
- Definition Classes
- AnyRef → Any
- Annotations
- @native() @HotSpotIntrinsicCandidate()
-
final
def
isInstanceOf[T0]: Boolean
- Definition Classes
- Any
-
final
def
ne(arg0: AnyRef): Boolean
- Definition Classes
- AnyRef
-
final
def
notify(): Unit
- Definition Classes
- AnyRef
- Annotations
- @native() @HotSpotIntrinsicCandidate()
-
final
def
notifyAll(): Unit
- Definition Classes
- AnyRef
- Annotations
- @native() @HotSpotIntrinsicCandidate()
-
final
def
synchronized[T0](arg0: ⇒ T0): T0
- Definition Classes
- AnyRef
-
def
toString(): String
- Definition Classes
- AnyRef → Any
-
final
def
wait(arg0: Long, arg1: Int): Unit
- Definition Classes
- AnyRef
- Annotations
- @throws( ... )
-
final
def
wait(arg0: Long): Unit
- Definition Classes
- AnyRef
- Annotations
- @throws( ... ) @native()
-
final
def
wait(): Unit
- Definition Classes
- AnyRef
- Annotations
- @throws( ... )