Package org.apache.hadoop.fs.azurebfs.commit

Class AzureManifestCommitterFactory

java.lang.Object

org.apache.hadoop.conf.Configured

org.apache.hadoop.mapreduce.lib.output.PathOutputCommitterFactory

org.apache.hadoop.mapreduce.lib.output.committer.manifest.ManifestCommitterFactory

org.apache.hadoop.fs.azurebfs.commit.AzureManifestCommitterFactory

All Implemented Interfaces:

org.apache.hadoop.conf.Configurable

@Public
@Evolving
public class AzureManifestCommitterFactory
extends org.apache.hadoop.mapreduce.lib.output.committer.manifest.ManifestCommitterFactory

A Committer for the manifest committer which performs all bindings needed to work best with abfs. This includes, at a minimum, switching to the abfs-specific manifest store operations. This classname is referenced in configurations, so MUST NOT change.

Field Summary

Fields

Modifier and Type	Field	Description
static java.lang.String	NAME	Classname, which can be declared in job configurations.

Fields inherited from class org.apache.hadoop.mapreduce.lib.output.PathOutputCommitterFactory

COMMITTER_FACTORY_CLASS, COMMITTER_FACTORY_DEFAULT, COMMITTER_FACTORY_SCHEME, COMMITTER_FACTORY_SCHEME_PATTERN, FILE_COMMITTER_FACTORY, NAMED_COMMITTER_CLASS, NAMED_COMMITTER_FACTORY

Constructor Summary

Constructors

Constructor	Description
AzureManifestCommitterFactory()

Method Summary

Modifier and Type	Method	Description
org.apache.hadoop.mapreduce.lib.output.committer.manifest.ManifestCommitter	createOutputCommitter(org.apache.hadoop.fs.Path outputPath, org.apache.hadoop.mapreduce.TaskAttemptContext context)

Methods inherited from class org.apache.hadoop.mapreduce.lib.output.PathOutputCommitterFactory

createCommitter, createFileOutputCommitter, getCommitterFactory

Methods inherited from class org.apache.hadoop.conf.Configured

getConf, setConf

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

NAME

public static final java.lang.String NAME

Classname, which can be declared in job configurations.

Constructor Detail

AzureManifestCommitterFactory

public AzureManifestCommitterFactory()

Method Detail

createOutputCommitter

public org.apache.hadoop.mapreduce.lib.output.committer.manifest.ManifestCommitter createOutputCommitter(org.apache.hadoop.fs.Path outputPath,
                                                                                                         org.apache.hadoop.mapreduce.TaskAttemptContext context)
                                                                                                  throws java.io.IOException

Overrides:

createOutputCommitter in class org.apache.hadoop.mapreduce.lib.output.committer.manifest.ManifestCommitterFactory

Throws:

java.io.IOException