Package org.apache.flink.runtime.operators.resettable

Class SpillingResettableMutableObjectIterator<T>

java.lang.Object

org.apache.flink.runtime.operators.resettable.SpillingResettableMutableObjectIterator<T>

Type Parameters:

T - The type of record that the iterator handles.

All Implemented Interfaces:

ResettableMutableObjectIterator<T>, org.apache.flink.util.MutableObjectIterator<T>

public class SpillingResettableMutableObjectIterator<T>
extends Object
implements ResettableMutableObjectIterator<T>

Implementation of a resettable iterator. While iterating the first time over the data, the iterator writes the records to a spillable buffer. Any subsequent iteration re-reads the data from that buffer.

Field Summary

Fields

Modifier and Type	Field	Description
protected final SpillingBuffer	buffer
protected final org.apache.flink.util.MutableObjectIterator<T>	input
protected org.apache.flink.core.memory.DataInputView	inView
protected final MemoryManager	memoryManager
protected final org.apache.flink.api.common.typeutils.TypeSerializer<T>	serializer

Constructor Summary

Constructors

Constructor	Description
SpillingResettableMutableObjectIterator(org.apache.flink.util.MutableObjectIterator<T> input, org.apache.flink.api.common.typeutils.TypeSerializer<T> serializer, MemoryManager memoryManager, IOManager ioManager, int numPages, AbstractInvokable parentTask)
SpillingResettableMutableObjectIterator(org.apache.flink.util.MutableObjectIterator<T> input, org.apache.flink.api.common.typeutils.TypeSerializer<T> serializer, MemoryManager memoryManager, IOManager ioManager, List<org.apache.flink.core.memory.MemorySegment> memory)

Method Summary

Modifier and Type	Method	Description
List<org.apache.flink.core.memory.MemorySegment>	close()
void	consumeAndCacheRemainingData()
T	next()
T	next(T reuse)
void	open()
void	reset()	Resets the iterator.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Details

inView

protected org.apache.flink.core.memory.DataInputView inView

serializer

protected final org.apache.flink.api.common.typeutils.TypeSerializer<T> serializer

buffer

protected final SpillingBuffer buffer

input

protected final org.apache.flink.util.MutableObjectIterator<T> input

memoryManager

protected final MemoryManager memoryManager

Constructor Details

SpillingResettableMutableObjectIterator

public SpillingResettableMutableObjectIterator(org.apache.flink.util.MutableObjectIterator<T> input,
 org.apache.flink.api.common.typeutils.TypeSerializer<T> serializer,
 MemoryManager memoryManager,
 IOManager ioManager,
 int numPages,
 AbstractInvokable parentTask)
                                        throws MemoryAllocationException

Throws:

MemoryAllocationException

SpillingResettableMutableObjectIterator

public SpillingResettableMutableObjectIterator(org.apache.flink.util.MutableObjectIterator<T> input,
 org.apache.flink.api.common.typeutils.TypeSerializer<T> serializer,
 MemoryManager memoryManager,
 IOManager ioManager,
 List<org.apache.flink.core.memory.MemorySegment> memory)

Method Details

open

public void open()

reset

public void reset()
           throws IOException

Description copied from interface: ResettableMutableObjectIterator

Resets the iterator.

Specified by:

reset in interface ResettableMutableObjectIterator<T>

Throws:

IOException - May be thrown when the serialization into buffers or the spilling to secondary storage fails.

close

public List<org.apache.flink.core.memory.MemorySegment> close()
                                                       throws IOException

Throws:

IOException

next

public T next(T reuse)
       throws IOException

Specified by:

next in interface org.apache.flink.util.MutableObjectIterator<T>

Throws:

IOException

next

public T next()
       throws IOException

Specified by:

next in interface org.apache.flink.util.MutableObjectIterator<T>

Throws:

IOException

consumeAndCacheRemainingData

public void consumeAndCacheRemainingData()
                                  throws IOException

Throws:

IOException