Package org.apache.flink.connector.file.table

Interface PartitionCommitPolicy

All Known Implementing Classes:

MetastoreCommitPolicy, SuccessFileCommitPolicy

@Experimental
public interface PartitionCommitPolicy

Policy for commit a partition.

The implemented commit method needs to be idempotent because the same partition may be committed multiple times.

Default implementations: See MetastoreCommitPolicy. See SuccessFileCommitPolicy.

Further more, you can implement your own policy, like: - RPC to notify downstream applications. - Trigger hive to analysis partition for generating statistics. ...

Nested Class Summary

Nested Classes

Modifier and Type	Interface	Description
static interface	PartitionCommitPolicy.Context	Context of policy, including table information and partition information.

Field Summary

Fields

Modifier and Type	Field	Description
static final String	CUSTOM
static final String	METASTORE
static final String	SUCCESS_FILE

Method Summary

Modifier and Type	Method	Description
void	commit(PartitionCommitPolicy.Context context)	Commit a partition.
static void	validatePolicyChain(boolean isEmptyMetastore, String policyKind)	Validate commit policy.

Field Details

METASTORE

static final String METASTORE

See Also:

• Constant Field Values

SUCCESS_FILE

static final String SUCCESS_FILE

See Also:

• Constant Field Values

CUSTOM

static final String CUSTOM

See Also:

• Constant Field Values

Method Details

commit

void commit(PartitionCommitPolicy.Context context)
     throws Exception

Commit a partition.

Throws:

Exception

validatePolicyChain

static void validatePolicyChain(boolean isEmptyMetastore,
 String policyKind)

Validate commit policy.