Package org.apache.flink.connector.file.src.impl

Class ContinuousFileSplitEnumerator

java.lang.Object

org.apache.flink.connector.file.src.impl.ContinuousFileSplitEnumerator

All Implemented Interfaces:

AutoCloseable, org.apache.flink.api.common.state.CheckpointListener, org.apache.flink.api.connector.source.SplitEnumerator<FileSourceSplit,PendingSplitsCheckpoint<FileSourceSplit>>, org.apache.flink.api.connector.source.SupportsBatchSnapshot

@Internal
public class ContinuousFileSplitEnumerator
extends Object
implements org.apache.flink.api.connector.source.SplitEnumerator<FileSourceSplit,PendingSplitsCheckpoint<FileSourceSplit>>, org.apache.flink.api.connector.source.SupportsBatchSnapshot

A continuously monitoring enumerator.

Constructor Summary

Constructors

Constructor	Description
ContinuousFileSplitEnumerator(org.apache.flink.api.connector.source.SplitEnumeratorContext<FileSourceSplit> context, FileEnumerator enumerator, FileSplitAssigner splitAssigner, org.apache.flink.core.fs.Path[] paths, Collection<org.apache.flink.core.fs.Path> alreadyDiscoveredPaths, long discoveryInterval)

Method Summary

Modifier and Type	Method	Description
void	addReader(int subtaskId)
void	addSplitsBack(List<FileSourceSplit> splits, int subtaskId)
void	close()
void	handleSourceEvent(int subtaskId, org.apache.flink.api.connector.source.SourceEvent sourceEvent)
void	handleSplitRequest(int subtaskId, String requesterHostname)
PendingSplitsCheckpoint<FileSourceSplit>	snapshotState(long checkpointId)
void	start()

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface org.apache.flink.api.common.state.CheckpointListener

notifyCheckpointAborted

Methods inherited from interface org.apache.flink.api.connector.source.SplitEnumerator

notifyCheckpointComplete

Constructor Details

ContinuousFileSplitEnumerator

public ContinuousFileSplitEnumerator(org.apache.flink.api.connector.source.SplitEnumeratorContext<FileSourceSplit> context,
 FileEnumerator enumerator,
 FileSplitAssigner splitAssigner,
 org.apache.flink.core.fs.Path[] paths,
 Collection<org.apache.flink.core.fs.Path> alreadyDiscoveredPaths,
 long discoveryInterval)

Method Details

start

public void start()

Specified by:

start in interface org.apache.flink.api.connector.source.SplitEnumerator<FileSourceSplit,PendingSplitsCheckpoint<FileSourceSplit>>

close

public void close()
           throws IOException

Specified by:

close in interface AutoCloseable

Specified by:

close in interface org.apache.flink.api.connector.source.SplitEnumerator<FileSourceSplit,PendingSplitsCheckpoint<FileSourceSplit>>

Throws:

IOException

addReader

public void addReader(int subtaskId)

Specified by:

addReader in interface org.apache.flink.api.connector.source.SplitEnumerator<FileSourceSplit,PendingSplitsCheckpoint<FileSourceSplit>>

handleSplitRequest

public void handleSplitRequest(int subtaskId,
 @Nullable
 String requesterHostname)

Specified by:

handleSplitRequest in interface org.apache.flink.api.connector.source.SplitEnumerator<FileSourceSplit,PendingSplitsCheckpoint<FileSourceSplit>>

handleSourceEvent

public void handleSourceEvent(int subtaskId,
 org.apache.flink.api.connector.source.SourceEvent sourceEvent)

Specified by:

handleSourceEvent in interface org.apache.flink.api.connector.source.SplitEnumerator<FileSourceSplit,PendingSplitsCheckpoint<FileSourceSplit>>

addSplitsBack

public void addSplitsBack(List<FileSourceSplit> splits,
 int subtaskId)

Specified by:

addSplitsBack in interface org.apache.flink.api.connector.source.SplitEnumerator<FileSourceSplit,PendingSplitsCheckpoint<FileSourceSplit>>

snapshotState

public PendingSplitsCheckpoint<FileSourceSplit> snapshotState(long checkpointId)
                                                       throws Exception

Specified by:

snapshotState in interface org.apache.flink.api.connector.source.SplitEnumerator<FileSourceSplit,PendingSplitsCheckpoint<FileSourceSplit>>

Throws:

Exception