Package org.apache.flink.streaming.api.operators

Class MapPartitionIterator<IN>

java.lang.Object

org.apache.flink.streaming.api.operators.MapPartitionIterator<IN>

All Implemented Interfaces:

Iterator<IN>

@Internal
public class MapPartitionIterator<IN>
extends Object
implements Iterator<IN>

The MapPartitionIterator is an iterator used in the MapPartitionOperator.The task main thread will add records to it. It will set itself as the input parameter of MapPartitionFunction and execute the function.

Field Summary

Fields

Modifier and Type	Field	Description
static final int	DEFAULT_MAX_CACHE_NUM	Max number of caches.

Constructor Summary

Constructors

Constructor	Description
MapPartitionIterator(Consumer<Iterator<IN>> udf)

Method Summary

Modifier and Type	Method	Description
void	addRecord(IN record)
void	close()
boolean	hasNext()
IN	next()

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface java.util.Iterator

forEachRemaining, remove

Field Details

DEFAULT_MAX_CACHE_NUM

public static final int DEFAULT_MAX_CACHE_NUM

Max number of caches.

The constant defines the maximum number of caches that can be created. Its value is set to 100, which is considered sufficient for most parallel jobs. Each cache is a record and occupies a minimal amount of memory so the value is not excessively large.

See Also:

• Constant Field Values

Constructor Details

MapPartitionIterator

public MapPartitionIterator(Consumer<Iterator<IN>> udf)

Method Details

hasNext

public boolean hasNext()

Specified by:

hasNext in interface Iterator<IN>

next

public IN next()

Specified by:

next in interface Iterator<IN>

addRecord

public void addRecord(IN record)

close

public void close()