Index
All Classes and Interfaces|All Packages|Serialized Form
A
- AbstractPartFileWriter<IN,
BucketID> - Class in org.apache.flink.streaming.api.functions.sink.filesystem -
An abstract writer for the currently open part file in a specific
Bucket. - AbstractPartFileWriter(BucketID, long) - Constructor for class org.apache.flink.streaming.api.functions.sink.filesystem.AbstractPartFileWriter
- asOutputStream() - Method in interface org.apache.flink.streaming.api.functions.sink.filesystem.OutputStreamBasedCompactingFileWriter
-
Gets the output stream underlying the writer.
- asOutputStream() - Method in class org.apache.flink.streaming.api.functions.sink.filesystem.OutputStreamBasedPartFileWriter
B
- BasePathBucketAssigner<T> - Class in org.apache.flink.streaming.api.functions.sink.filesystem.bucketassigners
-
A
BucketAssignerthat does not perform any bucketing of files. - BasePathBucketAssigner() - Constructor for class org.apache.flink.streaming.api.functions.sink.filesystem.bucketassigners.BasePathBucketAssigner
- BucketAssigner<IN,
BucketID> - Interface in org.apache.flink.streaming.api.functions.sink.filesystem -
A BucketAssigner is used with a file sink to determine the bucket each incoming element should be put into.
- BucketAssigner.Context - Interface in org.apache.flink.streaming.api.functions.sink.filesystem
-
Context that the
BucketAssignercan use for getting additional data about an input record. - BucketWriter<IN,
BucketID> - Interface in org.apache.flink.streaming.api.functions.sink.filesystem -
An interface for factories that create the different
writers. - BucketWriter.PendingFile - Interface in org.apache.flink.streaming.api.functions.sink.filesystem
-
This represents the file that can not write any data to.
- build() - Method in class org.apache.flink.streaming.api.functions.sink.filesystem.OutputFileConfig.OutputFileConfigBuilder
- build() - Method in class org.apache.flink.streaming.api.functions.sink.filesystem.rollingpolicies.CheckpointRollingPolicy.PolicyBuilder
- build() - Method in class org.apache.flink.streaming.api.functions.sink.filesystem.rollingpolicies.DefaultRollingPolicy.PolicyBuilder
-
Creates the actual policy.
- build() - Static method in class org.apache.flink.streaming.api.functions.sink.filesystem.rollingpolicies.OnCheckpointRollingPolicy
- builder() - Static method in class org.apache.flink.streaming.api.functions.sink.filesystem.OutputFileConfig
- builder() - Static method in class org.apache.flink.streaming.api.functions.sink.filesystem.rollingpolicies.DefaultRollingPolicy
-
Creates a new
DefaultRollingPolicy.PolicyBuilderthat is used to configure and build an instance ofDefaultRollingPolicy. - BulkBucketWriter<IN,
BucketID> - Class in org.apache.flink.streaming.api.functions.sink.filesystem -
A factory that creates
BulkPartWriters. - BulkBucketWriter(RecoverableWriter, BulkWriter.Factory<IN>) - Constructor for class org.apache.flink.streaming.api.functions.sink.filesystem.BulkBucketWriter
C
- CheckpointRollingPolicy<IN,
BucketID> - Class in org.apache.flink.streaming.api.functions.sink.filesystem.rollingpolicies -
An abstract
RollingPolicywhich rolls on every checkpoint. - CheckpointRollingPolicy() - Constructor for class org.apache.flink.streaming.api.functions.sink.filesystem.rollingpolicies.CheckpointRollingPolicy
- CheckpointRollingPolicy.PolicyBuilder<IN,
BucketID, T extends CheckpointRollingPolicy.PolicyBuilder<IN, BucketID, T>> - Class in org.apache.flink.streaming.api.functions.sink.filesystem.rollingpolicies -
The base abstract builder class for
CheckpointRollingPolicy. - cleanupInProgressFileRecoverable(InProgressFileWriter.InProgressFileRecoverable) - Method in interface org.apache.flink.streaming.api.functions.sink.filesystem.BucketWriter
-
Frees up any resources that were previously occupied in order to be able to recover from a (potential) failure.
- cleanupInProgressFileRecoverable(InProgressFileWriter.InProgressFileRecoverable) - Method in class org.apache.flink.streaming.api.functions.sink.filesystem.BulkBucketWriter
- closeForCommit() - Method in interface org.apache.flink.streaming.api.functions.sink.filesystem.CompactingFileWriter
-
Closes the writer and gets the
InProgressFileWriter.PendingFileRecoverableof the written compacting file. - closeForCommit() - Method in interface org.apache.flink.streaming.api.functions.sink.filesystem.InProgressFileWriter
- closeForCommit() - Method in class org.apache.flink.streaming.api.functions.sink.filesystem.OutputStreamBasedPartFileWriter
- commit() - Method in interface org.apache.flink.streaming.api.functions.sink.filesystem.BucketWriter.PendingFile
-
Commits the pending file, making it visible.
- commitAfterRecovery() - Method in interface org.apache.flink.streaming.api.functions.sink.filesystem.BucketWriter.PendingFile
-
Commits the pending file, making it visible.
- CompactingFileWriter - Interface in org.apache.flink.streaming.api.functions.sink.filesystem
-
The file sink compactors use the
CompactingFileWriterto write a compacting file. - CompactingFileWriter.Type - Enum in org.apache.flink.streaming.api.functions.sink.filesystem
-
Enum defining the types of
CompactingFileWriter. - create() - Static method in class org.apache.flink.streaming.api.functions.sink.filesystem.rollingpolicies.DefaultRollingPolicy
-
Deprecated.
- currentProcessingTime() - Method in interface org.apache.flink.streaming.api.functions.sink.filesystem.BucketAssigner.Context
-
Returns the current processing time.
- currentWatermark() - Method in interface org.apache.flink.streaming.api.functions.sink.filesystem.BucketAssigner.Context
-
Returns the current event-time watermark.
D
- DateTimeBucketAssigner<IN> - Class in org.apache.flink.streaming.api.functions.sink.filesystem.bucketassigners
-
A
BucketAssignerthat assigns to buckets based on current system time. - DateTimeBucketAssigner() - Constructor for class org.apache.flink.streaming.api.functions.sink.filesystem.bucketassigners.DateTimeBucketAssigner
-
Creates a new
DateTimeBucketAssignerwith format string"yyyy-MM-dd--HH". - DateTimeBucketAssigner(String) - Constructor for class org.apache.flink.streaming.api.functions.sink.filesystem.bucketassigners.DateTimeBucketAssigner
-
Creates a new
DateTimeBucketAssignerwith the given date/time format string. - DateTimeBucketAssigner(String, ZoneId) - Constructor for class org.apache.flink.streaming.api.functions.sink.filesystem.bucketassigners.DateTimeBucketAssigner
-
Creates a new
DateTimeBucketAssignerwith the given date/time format string using the given timezone. - DateTimeBucketAssigner(ZoneId) - Constructor for class org.apache.flink.streaming.api.functions.sink.filesystem.bucketassigners.DateTimeBucketAssigner
-
Creates a new
DateTimeBucketAssignerwith format string"yyyy-MM-dd--HH"using the given timezone. - DefaultRollingPolicy<IN,
BucketID> - Class in org.apache.flink.streaming.api.functions.sink.filesystem.rollingpolicies -
The default implementation of the
RollingPolicy. - DefaultRollingPolicy.PolicyBuilder - Class in org.apache.flink.streaming.api.functions.sink.filesystem.rollingpolicies
-
A helper class that holds the configuration properties for the
DefaultRollingPolicy. - deserialize(int, byte[]) - Method in class org.apache.flink.streaming.api.functions.sink.filesystem.bucketassigners.SimpleVersionedStringSerializer
- deserialize(int, byte[]) - Method in class org.apache.flink.streaming.api.functions.sink.filesystem.OutputStreamBasedPartFileWriter.OutputStreamBasedInProgressFileRecoverableSerializer
- deserialize(int, byte[]) - Method in class org.apache.flink.streaming.api.functions.sink.filesystem.OutputStreamBasedPartFileWriter.OutputStreamBasedPendingFileRecoverableSerializer
- dispose() - Method in interface org.apache.flink.streaming.api.functions.sink.filesystem.InProgressFileWriter
-
Dispose the part file.
- dispose() - Method in class org.apache.flink.streaming.api.functions.sink.filesystem.OutputStreamBasedPartFileWriter
E
- ensureWriteType(CompactingFileWriter.Type) - Method in class org.apache.flink.streaming.api.functions.sink.filesystem.OutputStreamBasedPartFileWriter
- equals(Object) - Method in class org.apache.flink.streaming.api.functions.sink.filesystem.OutputStreamBasedPartFileWriter.OutputStreamBasedInProgressFileRecoverable
- equals(Object) - Method in class org.apache.flink.streaming.api.functions.sink.filesystem.OutputStreamBasedPartFileWriter.OutputStreamBasedPendingFileRecoverable
G
- getBucketId() - Method in class org.apache.flink.streaming.api.functions.sink.filesystem.AbstractPartFileWriter
- getBucketId() - Method in interface org.apache.flink.streaming.api.functions.sink.filesystem.PartFileInfo
- getBucketId(IN, BucketAssigner.Context) - Method in interface org.apache.flink.streaming.api.functions.sink.filesystem.BucketAssigner
-
Returns the identifier of the bucket the provided element should be put into.
- getBucketId(IN, BucketAssigner.Context) - Method in class org.apache.flink.streaming.api.functions.sink.filesystem.bucketassigners.DateTimeBucketAssigner
- getBucketId(T, BucketAssigner.Context) - Method in class org.apache.flink.streaming.api.functions.sink.filesystem.bucketassigners.BasePathBucketAssigner
- getCommitSerializer() - Method in class org.apache.flink.streaming.api.functions.sink.filesystem.OutputStreamBasedPartFileWriter.OutputStreamBasedPendingFileRecoverableSerializer
- getCreationTime() - Method in class org.apache.flink.streaming.api.functions.sink.filesystem.AbstractPartFileWriter
- getCreationTime() - Method in interface org.apache.flink.streaming.api.functions.sink.filesystem.PartFileInfo
- getInactivityInterval() - Method in class org.apache.flink.streaming.api.functions.sink.filesystem.rollingpolicies.DefaultRollingPolicy
-
Returns time duration of allowed inactivity after which a part file will have to roll.
- getInProgressFileRecoverableSerializer() - Method in class org.apache.flink.streaming.api.functions.sink.filesystem.WriterProperties
- getLastUpdateTime() - Method in class org.apache.flink.streaming.api.functions.sink.filesystem.AbstractPartFileWriter
- getLastUpdateTime() - Method in interface org.apache.flink.streaming.api.functions.sink.filesystem.PartFileInfo
- getMaxPartSize() - Method in class org.apache.flink.streaming.api.functions.sink.filesystem.rollingpolicies.DefaultRollingPolicy
-
Returns the maximum part file size before rolling.
- getPartPrefix() - Method in class org.apache.flink.streaming.api.functions.sink.filesystem.OutputFileConfig
-
The prefix for the part name.
- getPartSuffix() - Method in class org.apache.flink.streaming.api.functions.sink.filesystem.OutputFileConfig
-
The suffix for the part name.
- getPath() - Method in interface org.apache.flink.streaming.api.functions.sink.filesystem.InProgressFileWriter.PendingFileRecoverable
- getPath() - Method in class org.apache.flink.streaming.api.functions.sink.filesystem.OutputStreamBasedPartFileWriter.OutputStreamBasedInProgressFileRecoverable
- getPath() - Method in class org.apache.flink.streaming.api.functions.sink.filesystem.OutputStreamBasedPartFileWriter.OutputStreamBasedPendingFileRecoverable
- getPendingFileRecoverableSerializer() - Method in class org.apache.flink.streaming.api.functions.sink.filesystem.WriterProperties
- getProperties() - Method in interface org.apache.flink.streaming.api.functions.sink.filesystem.BucketWriter
- getProperties() - Method in class org.apache.flink.streaming.api.functions.sink.filesystem.BulkBucketWriter
- getResumeSerializer() - Method in class org.apache.flink.streaming.api.functions.sink.filesystem.OutputStreamBasedPartFileWriter.OutputStreamBasedInProgressFileRecoverableSerializer
- getRolloverInterval() - Method in class org.apache.flink.streaming.api.functions.sink.filesystem.rollingpolicies.DefaultRollingPolicy
-
Returns the maximum time duration a part file can stay open before rolling.
- getSerializer() - Method in interface org.apache.flink.streaming.api.functions.sink.filesystem.BucketAssigner
- getSerializer() - Method in class org.apache.flink.streaming.api.functions.sink.filesystem.bucketassigners.BasePathBucketAssigner
- getSerializer() - Method in class org.apache.flink.streaming.api.functions.sink.filesystem.bucketassigners.DateTimeBucketAssigner
- getSize() - Method in interface org.apache.flink.streaming.api.functions.sink.filesystem.InProgressFileWriter.PendingFileRecoverable
- getSize() - Method in class org.apache.flink.streaming.api.functions.sink.filesystem.OutputStreamBasedPartFileWriter
- getSize() - Method in class org.apache.flink.streaming.api.functions.sink.filesystem.OutputStreamBasedPartFileWriter.OutputStreamBasedInProgressFileRecoverable
- getSize() - Method in class org.apache.flink.streaming.api.functions.sink.filesystem.OutputStreamBasedPartFileWriter.OutputStreamBasedPendingFileRecoverable
- getSize() - Method in interface org.apache.flink.streaming.api.functions.sink.filesystem.PartFileInfo
- getVersion() - Method in class org.apache.flink.streaming.api.functions.sink.filesystem.bucketassigners.SimpleVersionedStringSerializer
- getVersion() - Method in class org.apache.flink.streaming.api.functions.sink.filesystem.OutputStreamBasedPartFileWriter.OutputStreamBasedInProgressFileRecoverableSerializer
- getVersion() - Method in class org.apache.flink.streaming.api.functions.sink.filesystem.OutputStreamBasedPartFileWriter.OutputStreamBasedPendingFileRecoverableSerializer
H
- hashCode() - Method in class org.apache.flink.streaming.api.functions.sink.filesystem.OutputStreamBasedPartFileWriter.OutputStreamBasedInProgressFileRecoverable
- hashCode() - Method in class org.apache.flink.streaming.api.functions.sink.filesystem.OutputStreamBasedPartFileWriter.OutputStreamBasedPendingFileRecoverable
I
- InProgressFileWriter<IN,
BucketID> - Interface in org.apache.flink.streaming.api.functions.sink.filesystem -
The
Bucketuses theInProgressFileWriterto write element to a part file. - InProgressFileWriter.InProgressFileRecoverable - Interface in org.apache.flink.streaming.api.functions.sink.filesystem
-
A handle can be used to recover in-progress file..
- InProgressFileWriter.PendingFileRecoverable - Interface in org.apache.flink.streaming.api.functions.sink.filesystem
-
The handle can be used to recover pending file.
- INSTANCE - Static variable in class org.apache.flink.streaming.api.functions.sink.filesystem.bucketassigners.SimpleVersionedStringSerializer
M
- markWrite(long) - Method in class org.apache.flink.streaming.api.functions.sink.filesystem.AbstractPartFileWriter
O
- OnCheckpointRollingPolicy<IN,
BucketID> - Class in org.apache.flink.streaming.api.functions.sink.filesystem.rollingpolicies -
A
RollingPolicywhich rolls (ONLY) on every checkpoint. - openNew(BucketID, RecoverableFsDataOutputStream, Path, long) - Method in class org.apache.flink.streaming.api.functions.sink.filesystem.BulkBucketWriter
- openNew(BucketID, RecoverableFsDataOutputStream, Path, long) - Method in class org.apache.flink.streaming.api.functions.sink.filesystem.RowWiseBucketWriter
- openNewCompactingFile(CompactingFileWriter.Type, BucketID, Path, long) - Method in interface org.apache.flink.streaming.api.functions.sink.filesystem.BucketWriter
-
Used to create a new
CompactingFileWriterof the requesting type. - openNewCompactingFile(CompactingFileWriter.Type, BucketID, Path, long) - Method in class org.apache.flink.streaming.api.functions.sink.filesystem.BulkBucketWriter
- openNewInProgressFile(BucketID, Path, long) - Method in interface org.apache.flink.streaming.api.functions.sink.filesystem.BucketWriter
-
Used to create a new
InProgressFileWriter. - openNewInProgressFile(BucketID, Path, long) - Method in class org.apache.flink.streaming.api.functions.sink.filesystem.BulkBucketWriter
- org.apache.flink.streaming.api.functions.sink.filesystem - package org.apache.flink.streaming.api.functions.sink.filesystem
- org.apache.flink.streaming.api.functions.sink.filesystem.bucketassigners - package org.apache.flink.streaming.api.functions.sink.filesystem.bucketassigners
- org.apache.flink.streaming.api.functions.sink.filesystem.rollingpolicies - package org.apache.flink.streaming.api.functions.sink.filesystem.rollingpolicies
- OUTPUT_STREAM - Enum constant in enum org.apache.flink.streaming.api.functions.sink.filesystem.CompactingFileWriter.Type
- OutputFileConfig - Class in org.apache.flink.streaming.api.functions.sink.filesystem
-
Part file name configuration.
- OutputFileConfig(String, String) - Constructor for class org.apache.flink.streaming.api.functions.sink.filesystem.OutputFileConfig
-
Initiates the
PartFileConfigwith values passed as parameters. - OutputFileConfig.OutputFileConfigBuilder - Class in org.apache.flink.streaming.api.functions.sink.filesystem
-
A builder to create the part file configuration.
- OutputStreamBasedCompactingFileWriter - Interface in org.apache.flink.streaming.api.functions.sink.filesystem
-
The compactors use the
OutputStreamBasedCompactingFileWriterto directly write a compacting file as anOutputStream. - OutputStreamBasedInProgressFileRecoverable(RecoverableWriter.ResumeRecoverable) - Constructor for class org.apache.flink.streaming.api.functions.sink.filesystem.OutputStreamBasedPartFileWriter.OutputStreamBasedInProgressFileRecoverable
-
Deprecated.
- OutputStreamBasedInProgressFileRecoverable(RecoverableWriter.ResumeRecoverable, Path) - Constructor for class org.apache.flink.streaming.api.functions.sink.filesystem.OutputStreamBasedPartFileWriter.OutputStreamBasedInProgressFileRecoverable
- OutputStreamBasedPartFileWriter<IN,
BucketID> - Class in org.apache.flink.streaming.api.functions.sink.filesystem -
The base class for all the part file writer that use
RecoverableFsDataOutputStream. - OutputStreamBasedPartFileWriter.OutputStreamBasedInProgressFileRecoverable - Class in org.apache.flink.streaming.api.functions.sink.filesystem
-
The
InProgressFileWriter.InProgressFileRecoverableimplementation forOutputStreamBasedPartFileWriter.OutputStreamBasedBucketWriter. - OutputStreamBasedPartFileWriter.OutputStreamBasedInProgressFileRecoverableSerializer - Class in org.apache.flink.streaming.api.functions.sink.filesystem
-
The serializer for
OutputStreamBasedPartFileWriter.OutputStreamBasedInProgressFileRecoverable. - OutputStreamBasedPartFileWriter.OutputStreamBasedPendingFileRecoverable - Class in org.apache.flink.streaming.api.functions.sink.filesystem
-
The
InProgressFileWriter.PendingFileRecoverableimplementation forOutputStreamBasedPartFileWriter.OutputStreamBasedBucketWriter. - OutputStreamBasedPartFileWriter.OutputStreamBasedPendingFileRecoverableSerializer - Class in org.apache.flink.streaming.api.functions.sink.filesystem
-
The serializer for
OutputStreamBasedPartFileWriter.OutputStreamBasedPendingFileRecoverable. - OutputStreamBasedPendingFileRecoverable(RecoverableWriter.CommitRecoverable) - Constructor for class org.apache.flink.streaming.api.functions.sink.filesystem.OutputStreamBasedPartFileWriter.OutputStreamBasedPendingFileRecoverable
-
Deprecated.
- OutputStreamBasedPendingFileRecoverable(RecoverableWriter.CommitRecoverable, Path, long) - Constructor for class org.apache.flink.streaming.api.functions.sink.filesystem.OutputStreamBasedPartFileWriter.OutputStreamBasedPendingFileRecoverable
P
- PartFileInfo<BucketID> - Interface in org.apache.flink.streaming.api.functions.sink.filesystem
-
An interface exposing the information concerning the current (open) part file that is necessary to the
RollingPolicyin order to determine if it should roll the part file or not. - persist() - Method in interface org.apache.flink.streaming.api.functions.sink.filesystem.InProgressFileWriter
- persist() - Method in class org.apache.flink.streaming.api.functions.sink.filesystem.OutputStreamBasedPartFileWriter
- PolicyBuilder() - Constructor for class org.apache.flink.streaming.api.functions.sink.filesystem.rollingpolicies.CheckpointRollingPolicy.PolicyBuilder
R
- RECORD_WISE - Enum constant in enum org.apache.flink.streaming.api.functions.sink.filesystem.CompactingFileWriter.Type
- RecordWiseCompactingFileWriter<IN> - Interface in org.apache.flink.streaming.api.functions.sink.filesystem
-
The compactors use the
RecordWiseCompactingFileWriterto write elements to a compacting file. - recoverPendingFile(InProgressFileWriter.PendingFileRecoverable) - Method in interface org.apache.flink.streaming.api.functions.sink.filesystem.BucketWriter
-
Recovers a pending file for finalizing and committing.
- recoverPendingFile(InProgressFileWriter.PendingFileRecoverable) - Method in class org.apache.flink.streaming.api.functions.sink.filesystem.BulkBucketWriter
- resumeFrom(BucketID, RecoverableFsDataOutputStream, Path, RecoverableWriter.ResumeRecoverable, long) - Method in class org.apache.flink.streaming.api.functions.sink.filesystem.BulkBucketWriter
- resumeFrom(BucketID, RecoverableFsDataOutputStream, Path, RecoverableWriter.ResumeRecoverable, long) - Method in class org.apache.flink.streaming.api.functions.sink.filesystem.RowWiseBucketWriter
- resumeInProgressFileFrom(BucketID, InProgressFileWriter.InProgressFileRecoverable, long) - Method in interface org.apache.flink.streaming.api.functions.sink.filesystem.BucketWriter
-
Used to resume a
InProgressFileWriterfrom aInProgressFileWriter.InProgressFileRecoverable. - resumeInProgressFileFrom(BucketID, InProgressFileWriter.InProgressFileRecoverable, long) - Method in class org.apache.flink.streaming.api.functions.sink.filesystem.BulkBucketWriter
- RollingPolicy<IN,
BucketID> - Interface in org.apache.flink.streaming.api.functions.sink.filesystem -
The policy based on which a
Bucketin theFilesystem Sinkrolls its currently open part file and opens a new one. - RowWiseBucketWriter<IN,
BucketID> - Class in org.apache.flink.streaming.api.functions.sink.filesystem -
A factory that creates
RowWisePartWriters. - RowWiseBucketWriter(RecoverableWriter, Encoder<IN>) - Constructor for class org.apache.flink.streaming.api.functions.sink.filesystem.RowWiseBucketWriter
- RowWisePartWriter<IN,
BucketID> - Class in org.apache.flink.streaming.api.functions.sink.filesystem -
A
InProgressFileWriterfor row-wise formats that use anEncoder. - RowWisePartWriter(BucketID, Path, RecoverableFsDataOutputStream, Encoder<IN>, long) - Constructor for class org.apache.flink.streaming.api.functions.sink.filesystem.RowWisePartWriter
S
- self() - Method in class org.apache.flink.streaming.api.functions.sink.filesystem.rollingpolicies.CheckpointRollingPolicy.PolicyBuilder
- serialize(String) - Method in class org.apache.flink.streaming.api.functions.sink.filesystem.bucketassigners.SimpleVersionedStringSerializer
- serialize(InProgressFileWriter.InProgressFileRecoverable) - Method in class org.apache.flink.streaming.api.functions.sink.filesystem.OutputStreamBasedPartFileWriter.OutputStreamBasedInProgressFileRecoverableSerializer
- serialize(InProgressFileWriter.PendingFileRecoverable) - Method in class org.apache.flink.streaming.api.functions.sink.filesystem.OutputStreamBasedPartFileWriter.OutputStreamBasedPendingFileRecoverableSerializer
- shouldRollOnCheckpoint(PartFileInfo<BucketID>) - Method in class org.apache.flink.streaming.api.functions.sink.filesystem.rollingpolicies.CheckpointRollingPolicy
- shouldRollOnCheckpoint(PartFileInfo<BucketID>) - Method in class org.apache.flink.streaming.api.functions.sink.filesystem.rollingpolicies.DefaultRollingPolicy
- shouldRollOnCheckpoint(PartFileInfo<BucketID>) - Method in interface org.apache.flink.streaming.api.functions.sink.filesystem.RollingPolicy
-
Determines if the in-progress part file for a bucket should roll on every checkpoint.
- shouldRollOnEvent(PartFileInfo<BucketID>, IN) - Method in class org.apache.flink.streaming.api.functions.sink.filesystem.rollingpolicies.CheckpointRollingPolicy
- shouldRollOnEvent(PartFileInfo<BucketID>, IN) - Method in class org.apache.flink.streaming.api.functions.sink.filesystem.rollingpolicies.DefaultRollingPolicy
- shouldRollOnEvent(PartFileInfo<BucketID>, IN) - Method in class org.apache.flink.streaming.api.functions.sink.filesystem.rollingpolicies.OnCheckpointRollingPolicy
- shouldRollOnEvent(PartFileInfo<BucketID>, IN) - Method in interface org.apache.flink.streaming.api.functions.sink.filesystem.RollingPolicy
-
Determines if the in-progress part file for a bucket should roll based on its current state, e.g. its size.
- shouldRollOnProcessingTime(PartFileInfo<BucketID>, long) - Method in class org.apache.flink.streaming.api.functions.sink.filesystem.rollingpolicies.CheckpointRollingPolicy
- shouldRollOnProcessingTime(PartFileInfo<BucketID>, long) - Method in class org.apache.flink.streaming.api.functions.sink.filesystem.rollingpolicies.DefaultRollingPolicy
- shouldRollOnProcessingTime(PartFileInfo<BucketID>, long) - Method in class org.apache.flink.streaming.api.functions.sink.filesystem.rollingpolicies.OnCheckpointRollingPolicy
- shouldRollOnProcessingTime(PartFileInfo<BucketID>, long) - Method in interface org.apache.flink.streaming.api.functions.sink.filesystem.RollingPolicy
-
Determines if the in-progress part file for a bucket should roll based on a time condition.
- SimpleVersionedStringSerializer - Class in org.apache.flink.streaming.api.functions.sink.filesystem.bucketassigners
-
A
SimpleVersionedSerializerimplementation for Strings. - supportsResume() - Method in class org.apache.flink.streaming.api.functions.sink.filesystem.WriterProperties
T
- timestamp() - Method in interface org.apache.flink.streaming.api.functions.sink.filesystem.BucketAssigner.Context
-
Returns the timestamp of the current input record or
nullif the element does not have an assigned timestamp. - toString() - Method in class org.apache.flink.streaming.api.functions.sink.filesystem.bucketassigners.BasePathBucketAssigner
- toString() - Method in class org.apache.flink.streaming.api.functions.sink.filesystem.bucketassigners.DateTimeBucketAssigner
V
- valueOf(String) - Static method in enum org.apache.flink.streaming.api.functions.sink.filesystem.CompactingFileWriter.Type
-
Returns the enum constant of this type with the specified name.
- values() - Static method in enum org.apache.flink.streaming.api.functions.sink.filesystem.CompactingFileWriter.Type
-
Returns an array containing the constants of this enum type, in the order they are declared.
W
- withInactivityInterval(long) - Method in class org.apache.flink.streaming.api.functions.sink.filesystem.rollingpolicies.DefaultRollingPolicy.PolicyBuilder
-
Deprecated.
- withInactivityInterval(Duration) - Method in class org.apache.flink.streaming.api.functions.sink.filesystem.rollingpolicies.DefaultRollingPolicy.PolicyBuilder
-
Sets the interval of allowed inactivity after which a part file will have to roll.
- withMaxPartSize(long) - Method in class org.apache.flink.streaming.api.functions.sink.filesystem.rollingpolicies.DefaultRollingPolicy.PolicyBuilder
-
Deprecated.
- withMaxPartSize(MemorySize) - Method in class org.apache.flink.streaming.api.functions.sink.filesystem.rollingpolicies.DefaultRollingPolicy.PolicyBuilder
-
Sets the part size above which a part file will have to roll.
- withPartPrefix(String) - Method in class org.apache.flink.streaming.api.functions.sink.filesystem.OutputFileConfig.OutputFileConfigBuilder
- withPartSuffix(String) - Method in class org.apache.flink.streaming.api.functions.sink.filesystem.OutputFileConfig.OutputFileConfigBuilder
- withRolloverInterval(long) - Method in class org.apache.flink.streaming.api.functions.sink.filesystem.rollingpolicies.DefaultRollingPolicy.PolicyBuilder
-
Deprecated.
- withRolloverInterval(Duration) - Method in class org.apache.flink.streaming.api.functions.sink.filesystem.rollingpolicies.DefaultRollingPolicy.PolicyBuilder
-
Sets the max time a part file can stay open before having to roll.
- write(IN) - Method in interface org.apache.flink.streaming.api.functions.sink.filesystem.InProgressFileWriter
- write(IN) - Method in interface org.apache.flink.streaming.api.functions.sink.filesystem.RecordWiseCompactingFileWriter
-
Write an element to the compacting file.
- write(IN, long) - Method in interface org.apache.flink.streaming.api.functions.sink.filesystem.InProgressFileWriter
-
Write an element to the part file.
- write(IN, long) - Method in class org.apache.flink.streaming.api.functions.sink.filesystem.RowWisePartWriter
- WriterProperties - Class in org.apache.flink.streaming.api.functions.sink.filesystem
-
This class describes the property of the
BucketWriter. - WriterProperties(SimpleVersionedSerializer<InProgressFileWriter.InProgressFileRecoverable>, SimpleVersionedSerializer<InProgressFileWriter.PendingFileRecoverable>, boolean) - Constructor for class org.apache.flink.streaming.api.functions.sink.filesystem.WriterProperties
All Classes and Interfaces|All Packages|Serialized Form
DefaultRollingPolicy.PolicyBuilder.withInactivityInterval(Duration)instead.