Package org.apache.flink.runtime.operators.resettable

Class SpillingResettableIterator<T>

java.lang.Object

org.apache.flink.runtime.operators.resettable.SpillingResettableIterator<T>

Type Parameters:

T - The type of record that the iterator handles.

All Implemented Interfaces:

Iterator<T>, ResettableIterator<T>

public class SpillingResettableIterator<T>
extends Object
implements ResettableIterator<T>

Implementation of a resettable iterator. While iterating the first time over the data, the iterator writes the records to a spillable buffer. Any subsequent iteration re-reads the data from that buffer.

Field Summary

Fields

Modifier and Type	Field	Description
protected final SpillingBuffer	buffer
protected final Iterator<T>	input
protected org.apache.flink.core.memory.DataInputView	inView
protected final MemoryManager	memoryManager
protected final org.apache.flink.api.common.typeutils.TypeSerializer<T>	serializer

Constructor Summary

Constructors

Constructor	Description
SpillingResettableIterator(Iterator<T> input, org.apache.flink.api.common.typeutils.TypeSerializer<T> serializer, MemoryManager memoryManager, IOManager ioManager, int numPages, AbstractInvokable parentTask)
SpillingResettableIterator(Iterator<T> input, org.apache.flink.api.common.typeutils.TypeSerializer<T> serializer, MemoryManager memoryManager, IOManager ioManager, List<org.apache.flink.core.memory.MemorySegment> memory)

Method Summary

Modifier and Type	Method	Description
List<org.apache.flink.core.memory.MemorySegment>	close()
boolean	hasNext()
T	next()
void	open()
void	remove()
void	reset()	Resets the iterator.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface java.util.Iterator

forEachRemaining

Field Details

inView

protected org.apache.flink.core.memory.DataInputView inView

serializer

protected final org.apache.flink.api.common.typeutils.TypeSerializer<T> serializer

buffer

protected final SpillingBuffer buffer

input

protected final Iterator<T> input

memoryManager

protected final MemoryManager memoryManager

Constructor Details

SpillingResettableIterator

public SpillingResettableIterator(Iterator<T> input,
 org.apache.flink.api.common.typeutils.TypeSerializer<T> serializer,
 MemoryManager memoryManager,
 IOManager ioManager,
 int numPages,
 AbstractInvokable parentTask)
                           throws MemoryAllocationException

Throws:

MemoryAllocationException

SpillingResettableIterator

public SpillingResettableIterator(Iterator<T> input,
 org.apache.flink.api.common.typeutils.TypeSerializer<T> serializer,
 MemoryManager memoryManager,
 IOManager ioManager,
 List<org.apache.flink.core.memory.MemorySegment> memory)

Method Details

open

public void open()

reset

public void reset()
           throws IOException

Description copied from interface: ResettableIterator

Resets the iterator.

Specified by:

reset in interface ResettableIterator<T>

Throws:

IOException

hasNext

public boolean hasNext()

Specified by:

hasNext in interface Iterator<T>

next

public T next()

Specified by:

next in interface Iterator<T>

remove

public void remove()

Specified by:

remove in interface Iterator<T>

close

public List<org.apache.flink.core.memory.MemorySegment> close()
                                                       throws IOException

Throws:

IOException