Package org.apache.flink.streaming.api.functions.sink.filesystem

Class RowWisePartWriter<IN,BucketID>

java.lang.Object

org.apache.flink.streaming.api.functions.sink.filesystem.AbstractPartFileWriter<IN,BucketID>

org.apache.flink.streaming.api.functions.sink.filesystem.OutputStreamBasedPartFileWriter<IN,BucketID>

org.apache.flink.streaming.api.functions.sink.filesystem.RowWisePartWriter<IN,BucketID>

All Implemented Interfaces:

CompactingFileWriter, InProgressFileWriter<IN,BucketID>, OutputStreamBasedCompactingFileWriter, PartFileInfo<BucketID>, RecordWiseCompactingFileWriter<IN>

@Internal
public final class RowWisePartWriter<IN,BucketID>
extends OutputStreamBasedPartFileWriter<IN,BucketID>

A InProgressFileWriter for row-wise formats that use an Encoder. This also implements the PartFileInfo and the OutputStreamBasedCompactingFileWriter.

Nested Class Summary

Nested classes/interfaces inherited from class org.apache.flink.streaming.api.functions.sink.filesystem.OutputStreamBasedPartFileWriter

OutputStreamBasedPartFileWriter.OutputStreamBasedInProgressFileRecoverable, OutputStreamBasedPartFileWriter.OutputStreamBasedInProgressFileRecoverableSerializer, OutputStreamBasedPartFileWriter.OutputStreamBasedPendingFileRecoverable, OutputStreamBasedPartFileWriter.OutputStreamBasedPendingFileRecoverableSerializer

Nested classes/interfaces inherited from interface org.apache.flink.streaming.api.functions.sink.filesystem.CompactingFileWriter

CompactingFileWriter.Type

Nested classes/interfaces inherited from interface org.apache.flink.streaming.api.functions.sink.filesystem.InProgressFileWriter

InProgressFileWriter.InProgressFileRecoverable, InProgressFileWriter.PendingFileRecoverable

Constructor Summary

Constructors

Constructor	Description
RowWisePartWriter(BucketID bucketId, org.apache.flink.core.fs.Path path, org.apache.flink.core.fs.RecoverableFsDataOutputStream currentPartStream, org.apache.flink.api.common.serialization.Encoder<IN> encoder, long creationTime)

Method Summary

Modifier and Type	Method	Description
void	write(IN element, long currentTime)	Write an element to the part file.

Methods inherited from class org.apache.flink.streaming.api.functions.sink.filesystem.OutputStreamBasedPartFileWriter

asOutputStream, closeForCommit, dispose, ensureWriteType, getSize, persist

Methods inherited from class org.apache.flink.streaming.api.functions.sink.filesystem.AbstractPartFileWriter

getBucketId, getCreationTime, getLastUpdateTime, markWrite

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface org.apache.flink.streaming.api.functions.sink.filesystem.InProgressFileWriter

write

Constructor Details

RowWisePartWriter

public RowWisePartWriter(BucketID bucketId,
 org.apache.flink.core.fs.Path path,
 org.apache.flink.core.fs.RecoverableFsDataOutputStream currentPartStream,
 org.apache.flink.api.common.serialization.Encoder<IN> encoder,
 long creationTime)

Method Details

write

public void write(IN element,
 long currentTime)
           throws IOException

Description copied from interface: InProgressFileWriter

Write an element to the part file.

Parameters:

element - the element to be written.

currentTime - the writing time.

Throws:

IOException - Thrown if writing the element fails.