| Package | Description |
|---|---|
| org.apache.hadoop.conf |
Configuration of system parameters.
|
| org.apache.hadoop.crypto | |
| org.apache.hadoop.crypto.key |
Licensed to the Apache Software Foundation (ASF) under one
or more contributor license agreements.
|
| org.apache.hadoop.crypto.key.kms | |
| org.apache.hadoop.crypto.random | |
| org.apache.hadoop.fs |
An abstract file system API.
|
| org.apache.hadoop.fs.ftp | |
| org.apache.hadoop.fs.impl |
This package contains implementation classes for use inside
filesystems.
|
| org.apache.hadoop.fs.impl.prefetch |
block caching for use in object store clients.
|
| org.apache.hadoop.fs.permission |
This package provides support for HDFS permission and ACL.
|
| org.apache.hadoop.fs.sftp |
SFTP FileSystem package.
|
| org.apache.hadoop.fs.shell |
Support for the execution of a file system command.
|
| org.apache.hadoop.fs.shell.find | |
| org.apache.hadoop.fs.store |
This package is for classes to be shared across object stores; for internal
use within the hadoop-* modules only.
|
| org.apache.hadoop.fs.viewfs |
ViewFileSystem and ViewFileSystemOverloadScheme classes.
|
| org.apache.hadoop.ha | |
| org.apache.hadoop.http |
Support for embedded HTTP services.
|
| org.apache.hadoop.http.lib |
This package provides user-selectable (via configuration) classes that add
functionality to the web UI.
|
| org.apache.hadoop.io |
Generic i/o code for use when reading and writing data to the network,
to databases, and to files.
|
| org.apache.hadoop.io.compress | |
| org.apache.hadoop.io.compress.bzip2 |
Implementation of compression/decompression for the BZip2
compression algorithm.
|
| org.apache.hadoop.io.compress.lz4 |
Implementation of compression/decompression for the LZ4
compression algorithm.
|
| org.apache.hadoop.io.compress.snappy |
Implementation of compression/decompression for the Snappy
compression algorithm.
|
| org.apache.hadoop.io.compress.zlib |
Implementation of compression/decompression based on the popular
gzip compressed file format.
|
| org.apache.hadoop.io.compress.zstd |
Implementation of compression/decompression based on the zStandard
compression algorithm.
|
| org.apache.hadoop.io.erasurecode | |
| org.apache.hadoop.io.erasurecode.codec |
Erasure codec framework.
|
| org.apache.hadoop.io.file.tfile | |
| org.apache.hadoop.io.retry |
A mechanism for selectively retrying methods that throw exceptions under
certain circumstances.
|
| org.apache.hadoop.io.serializer |
This package provides a mechanism for using different serialization frameworks
in Hadoop.
|
| org.apache.hadoop.ipc |
Tools to help define network clients and servers.
|
| org.apache.hadoop.ipc.metrics |
RPC related metrics.
|
| org.apache.hadoop.metrics2.sink |
Builtin metrics sinks
|
| org.apache.hadoop.net |
Network-related classes.
|
| org.apache.hadoop.security | |
| org.apache.hadoop.security.alias |
Provides the hadoop credential provider API.
|
| org.apache.hadoop.security.authentication.server |
Provides the server-side framework for authentication.
|
| org.apache.hadoop.security.authorize |
Support for service-level authorization.
|
| org.apache.hadoop.security.http |
Filters for HTTP service security.
|
| org.apache.hadoop.security.ssl | |
| org.apache.hadoop.security.token |
Support for delegation tokens.
|
| org.apache.hadoop.security.token.delegation |
ZooKeeper secret manager for TokenIdentifiers and DelegationKeys.
|
| org.apache.hadoop.security.token.delegation.web | |
| org.apache.hadoop.service |
Support for services.
|
| org.apache.hadoop.service.launcher |
This package contains classes, interfaces and exceptions to launch
YARN services from the command line.
|
| org.apache.hadoop.tools | |
| org.apache.hadoop.util |
Common utilities.
|
| org.apache.hadoop.util.curator |
This package provides utilities to interact with Curator ZooKeeper.
|
| org.apache.hadoop.util.functional |
Support for functional programming within the Hadoop APIs.
|
| org.apache.hadoop.util.hash |
| Modifier and Type | Class | Description |
|---|---|---|
class |
ConfigurationWithLogging |
Logs access to
Configuration. |
| Modifier and Type | Method | Description |
|---|---|---|
Configuration |
Configurable.getConf() |
Return the configuration used by this object.
|
Configuration |
Configured.getConf() |
|
protected abstract Configuration |
ReconfigurableBase.getNewConf() |
Create a new configuration.
|
| Modifier and Type | Method | Description |
|---|---|---|
void |
Configuration.addResource(Configuration conf) |
Add a configuration resource.
|
static void |
Configuration.dumpConfiguration(Configuration config,
java.io.Writer out) |
Writes out all properties and their attributes (final and resource) to
the given
Writer, the format of the output would be, |
static void |
Configuration.dumpConfiguration(Configuration config,
java.lang.String propertyName,
java.io.Writer out) |
Writes properties and their attributes (final and resource)
to the given
Writer. |
java.util.Collection<ReconfigurationUtil.PropertyChange> |
ReconfigurableBase.getChangedProperties(Configuration newConf,
Configuration oldConf) |
|
static java.util.Collection<ReconfigurationUtil.PropertyChange> |
ReconfigurationUtil.getChangedProperties(Configuration newConf,
Configuration oldConf) |
|
java.util.Collection<ReconfigurationUtil.PropertyChange> |
ReconfigurationUtil.parseChangedProperties(Configuration newConf,
Configuration oldConf) |
|
void |
Configurable.setConf(Configuration conf) |
Set the configuration to be used by this object.
|
void |
Configured.setConf(Configuration conf) |
|
void |
Configuration.writeXml(java.lang.String propertyName,
java.io.Writer out,
Configuration config) |
Write out the non-default properties in this configuration to the
given
Writer. |
| Constructor | Description |
|---|---|
ConfigRedactor(Configuration conf) |
|
Configuration(Configuration other) |
A new configuration with the same settings cloned from another.
|
ConfigurationWithLogging(Configuration conf) |
|
Configured(Configuration conf) |
Construct a Configured.
|
ReconfigurableBase(Configuration conf) |
Construct a ReconfigurableBase with the
Configuration
conf. |
| Modifier and Type | Method | Description |
|---|---|---|
Configuration |
JceCtrCryptoCodec.getConf() |
|
Configuration |
OpensslCtrCryptoCodec.getConf() |
| Modifier and Type | Method | Description |
|---|---|---|
static int |
CryptoStreamUtils.getBufferSize(Configuration conf) |
Read crypto buffer size.
|
static CryptoCodec |
CryptoCodec.getInstance(Configuration conf) |
Get crypto codec for algorithm/mode/padding in config value
hadoop.security.crypto.cipher.suite
|
static CryptoCodec |
CryptoCodec.getInstance(Configuration conf,
CipherSuite cipherSuite) |
Get crypto codec for specified algorithm/mode/padding.
|
void |
JceCtrCryptoCodec.setConf(Configuration conf) |
|
void |
OpensslCtrCryptoCodec.setConf(Configuration conf) |
|
void |
OpensslSm4CtrCryptoCodec.setConf(Configuration conf) |
| Modifier and Type | Method | Description |
|---|---|---|
Configuration |
KeyProvider.getConf() |
Return the provider configuration.
|
| Modifier and Type | Method | Description |
|---|---|---|
KeyProvider |
JavaKeyStoreProvider.Factory.createProvider(java.net.URI providerName,
Configuration conf) |
|
abstract KeyProvider |
KeyProviderFactory.createProvider(java.net.URI providerName,
Configuration conf) |
|
KeyProvider |
UserProvider.Factory.createProvider(java.net.URI providerName,
Configuration conf) |
|
static KeyProvider |
KeyProviderFactory.get(java.net.URI uri,
Configuration conf) |
Create a KeyProvider based on a provided URI.
|
static java.util.List<KeyProvider> |
KeyProviderFactory.getProviders(Configuration conf) |
|
static KeyProvider.Options |
KeyProvider.options(Configuration conf) |
A helper function to create an options object.
|
| Constructor | Description |
|---|---|
KeyProvider(Configuration conf) |
Constructor.
|
Options(Configuration conf) |
| Modifier and Type | Method | Description |
|---|---|---|
void |
KMSClientProvider.KMSTokenRenewer.cancel(Token<?> token,
Configuration conf) |
|
KeyProvider |
KMSClientProvider.Factory.createProvider(java.net.URI providerUri,
Configuration conf) |
This provider expects URIs in the following form :
kms://<PROTO>@<AUTHORITY>/<PATH>
where :
- PROTO = http or https
- AUTHORITY = <HOSTS>[:<PORT>]
- HOSTS = <HOSTNAME>[;<HOSTS>]
- HOSTNAME = string
- PORT = integer
This will always create a
LoadBalancingKMSClientProvider
if the uri is correct. |
long |
KMSClientProvider.KMSTokenRenewer.renew(Token<?> token,
Configuration conf) |
| Constructor | Description |
|---|---|
KMSClientProvider(java.net.URI uri,
Configuration conf) |
|
LoadBalancingKMSClientProvider(java.net.URI providerUri,
KMSClientProvider[] providers,
Configuration conf) |
| Modifier and Type | Method | Description |
|---|---|---|
Configuration |
OsSecureRandom.getConf() |
| Modifier and Type | Method | Description |
|---|---|---|
void |
OsSecureRandom.setConf(Configuration conf) |
| Modifier and Type | Method | Description |
|---|---|---|
Configuration |
FilterFileSystem.getConf() |
|
Configuration |
GetSpaceUsed.Builder.getConf() |
|
Configuration |
HarFileSystem.getConf() |
| Modifier and Type | Method | Description |
|---|---|---|
static PathData |
FileUtil.checkPathForSymlink(Path path,
Configuration conf) |
|
static boolean |
FileUtil.copy(java.io.File src,
FileSystem dstFS,
Path dst,
boolean deleteSource,
Configuration conf) |
Copy local files to a FileSystem.
|
static boolean |
FileUtil.copy(FileSystem srcFS,
FileStatus srcStatus,
FileSystem dstFS,
Path dst,
boolean deleteSource,
boolean overwrite,
Configuration conf) |
Copy a file/directory tree within/between filesystems.
|
static boolean |
FileUtil.copy(FileSystem srcFS,
Path[] srcs,
FileSystem dstFS,
Path dst,
boolean deleteSource,
boolean overwrite,
Configuration conf) |
|
static boolean |
FileUtil.copy(FileSystem srcFS,
Path src,
java.io.File dst,
boolean deleteSource,
Configuration conf) |
Copy FileSystem files to local files.
|
static boolean |
FileUtil.copy(FileSystem srcFS,
Path src,
FileSystem dstFS,
Path dst,
boolean deleteSource,
boolean overwrite,
Configuration conf) |
Copy files between FileSystems.
|
static boolean |
FileUtil.copy(FileSystem srcFS,
Path src,
FileSystem dstFS,
Path dst,
boolean deleteSource,
Configuration conf) |
Copy files between FileSystems.
|
static boolean |
FileUtil.copyAsMove(FileSystem srcFS,
FileStatus srcStatus,
FileSystem dstFS,
Path dst,
boolean deleteSource,
boolean overwrite,
Configuration conf) |
Copy files between FileSystems with preserved permissions, ownership, links and ACEs.
|
static boolean |
FileUtil.copyMerge(FileSystem srcFS,
Path srcDir,
FileSystem dstFS,
Path dstFile,
boolean deleteSource,
Configuration conf,
java.lang.String addString) |
Copy all files in a directory to one output file (merge).
|
static AbstractFileSystem |
AbstractFileSystem.createFileSystem(java.net.URI uri,
Configuration conf) |
Create a file system instance for the specified uri using the conf.
|
java.io.File |
LocalDirAllocator.createTmpFileForWrite(java.lang.String pathStr,
long size,
Configuration conf) |
Creates a temporary file in the local FS.
|
static AbstractFileSystem |
AbstractFileSystem.get(java.net.URI uri,
Configuration conf) |
The main factory method for creating a file system.
|
static FileSystem |
FileSystem.get(java.net.URI uri,
Configuration conf) |
Get a FileSystem for this URI's scheme and authority.
|
static FileSystem |
FileSystem.get(java.net.URI uri,
Configuration conf,
java.lang.String user) |
Get a FileSystem instance based on the uri, the passed in
configuration and the user.
|
static FileSystem |
FileSystem.get(Configuration conf) |
Returns the configured FileSystem implementation.
|
static org.apache.hadoop.tracing.Tracer |
FsTracer.get(Configuration conf) |
|
java.lang.Iterable<Path> |
LocalDirAllocator.getAllLocalPathsToRead(java.lang.String pathStr,
Configuration conf) |
Get all of the paths that currently exist in the working directories.
|
static java.lang.String |
StorageType.getConf(Configuration conf,
StorageType t,
java.lang.String name) |
Get the configured values for different StorageType.
|
static java.net.URI |
FileSystem.getDefaultUri(Configuration conf) |
Get the default FileSystem URI from a configuration.
|
static FileContext |
FileContext.getFileContext(java.net.URI defaultFsUri,
Configuration aConf) |
Create a FileContext for specified default URI using the specified config.
|
static FileContext |
FileContext.getFileContext(Configuration aConf) |
Create a FileContext using the passed config.
|
static FileContext |
FileContext.getFileContext(AbstractFileSystem defFS,
Configuration aConf) |
Create a FileContext with specified FS as default using the specified
config.
|
FileSystem |
Path.getFileSystem(Configuration conf) |
Return the FileSystem that owns this Path.
|
static java.lang.Class<? extends FileSystem> |
FileSystem.getFileSystemClass(java.lang.String scheme,
Configuration conf) |
Get the FileSystem implementation class of a filesystem.
|
protected static FileSystem |
FileSystem.getFSofPath(Path absOrFqPath,
Configuration conf) |
|
static TrashPolicy |
TrashPolicy.getInstance(Configuration conf,
FileSystem fs) |
Get an instance of the configured TrashPolicy based on the value
of the configuration parameter fs.trash.classname.
|
static TrashPolicy |
TrashPolicy.getInstance(Configuration conf,
FileSystem fs,
Path home) |
Deprecated.
Use
TrashPolicy.getInstance(Configuration, FileSystem) instead. |
java.net.InetSocketAddress[] |
FileSystem.getJobTrackerAddrs(Configuration conf) |
MapR - get jobTracker addresses given by cluster name
in mapred.job.tracker
|
static LocalFileSystem |
FileSystem.getLocal(Configuration conf) |
Get the local FileSystem.
|
static FileContext |
FileContext.getLocalFSFileContext(Configuration aConf) |
|
Path |
LocalDirAllocator.getLocalPathForWrite(java.lang.String pathStr,
long size,
Configuration conf) |
Get a path from the local FS.
|
Path |
LocalDirAllocator.getLocalPathForWrite(java.lang.String pathStr,
long size,
Configuration conf,
boolean checkWrite) |
Get a path from the local FS.
|
Path |
LocalDirAllocator.getLocalPathForWrite(java.lang.String pathStr,
Configuration conf) |
Get a path from the local FS.
|
Path |
LocalDirAllocator.getLocalPathToRead(java.lang.String pathStr,
Configuration conf) |
Get a path from the local FS for reading.
|
static FileSystem |
FileSystem.getNamed(java.lang.String name,
Configuration conf) |
Deprecated.
call
FileSystem.get(URI, Configuration) instead. |
boolean |
LocalDirAllocator.ifExists(java.lang.String pathStr,
Configuration conf) |
We search through all the configured dirs for the file's existence
and return true when we find.
|
void |
FileSystem.initialize(java.net.URI name,
Configuration conf) |
Initialize a FileSystem.
|
void |
FilterFileSystem.initialize(java.net.URI name,
Configuration conf) |
Called after a new FileSystem instance is constructed.
|
void |
HarFileSystem.initialize(java.net.URI name,
Configuration conf) |
Initialize a Har filesystem per har archive.
|
void |
LocalFileSystem.initialize(java.net.URI name,
Configuration conf) |
|
void |
RawLocalFileSystem.initialize(java.net.URI uri,
Configuration conf) |
|
void |
TrashPolicy.initialize(Configuration conf,
FileSystem fs) |
Used to setup the trash policy.
|
abstract void |
TrashPolicy.initialize(Configuration conf,
FileSystem fs,
Path home) |
Deprecated.
Use
TrashPolicy.initialize(Configuration, FileSystem) instead. |
void |
TrashPolicyDefault.initialize(Configuration conf,
FileSystem fs) |
|
void |
TrashPolicyDefault.initialize(Configuration conf,
FileSystem fs,
Path home) |
Deprecated.
|
static boolean |
Trash.moveToAppropriateTrash(FileSystem fs,
Path p,
Configuration conf) |
In case of the symlinks or mount points, one has to move the appropriate
trashbin in the actual volume of the path p being deleted.
|
static FileSystem |
FileSystem.newInstance(java.net.URI uri,
Configuration config) |
Returns the FileSystem for this URI's scheme and authority.
|
static FileSystem |
FileSystem.newInstance(java.net.URI uri,
Configuration conf,
java.lang.String user) |
Returns the FileSystem for this URI's scheme and authority and the
given user.
|
static FileSystem |
FileSystem.newInstance(Configuration conf) |
Returns a unique configured FileSystem implementation for the default
filesystem of the supplied configuration.
|
static LocalFileSystem |
FileSystem.newInstanceLocal(Configuration conf) |
Get a unique local FileSystem object.
|
void |
ChecksumFileSystem.setConf(Configuration conf) |
|
GetSpaceUsed.Builder |
GetSpaceUsed.Builder.setConf(Configuration conf) |
|
static void |
FileSystem.setDefaultUri(Configuration conf,
java.lang.String uri) |
Set the default FileSystem URI in a configuration.
|
static void |
FileSystem.setDefaultUri(Configuration conf,
java.net.URI uri) |
Set the default FileSystem URI in a configuration.
|
| Constructor | Description |
|---|---|
DelegateToFileSystem(java.net.URI theUri,
FileSystem theFsImpl,
Configuration conf,
java.lang.String supportedScheme,
boolean authorityRequired) |
|
DF(java.io.File path,
Configuration conf) |
|
FsShell(Configuration conf) |
Construct a FsShell with the given configuration.
|
FsUrlStreamHandlerFactory(Configuration conf) |
|
Trash(Configuration conf) |
Construct a trash can accessor.
|
Trash(FileSystem fs,
Configuration conf) |
Construct a trash can accessor for the FileSystem provided.
|
| Modifier and Type | Method | Description |
|---|---|---|
void |
FTPFileSystem.initialize(java.net.URI uri,
Configuration conf) |
| Modifier and Type | Method | Description |
|---|---|---|
Configuration |
AbstractFSBuilderImpl.getOptions() |
Get the mutable option configuration.
|
Configuration |
FSBuilderSupport.getOptions() |
|
Configuration |
OpenFileParameters.getOptions() |
| Modifier and Type | Method | Description |
|---|---|---|
static <E extends java.lang.Enum<E>> |
FlagSet.buildFlagSet(java.lang.Class<E> enumClass,
Configuration conf,
java.lang.String key,
boolean ignoreUnknown) |
Build a FlagSet from a comma separated list of values.
|
static void |
FutureIOSupport.propagateOptions(FSBuilder<?,?> builder,
Configuration conf,
java.lang.String prefix,
boolean mandatory) |
Deprecated.
|
static <T,U extends FSBuilder<T,U>> |
FutureIOSupport.propagateOptions(FSBuilder<T,U> builder,
Configuration conf,
java.lang.String optionalPrefix,
java.lang.String mandatoryPrefix) |
Deprecated.
|
OpenFileParameters |
OpenFileParameters.withOptions(Configuration opts) |
| Constructor | Description |
|---|---|
FSBuilderSupport(Configuration options) |
Constructor.
|
| Modifier and Type | Method | Description |
|---|---|---|
Configuration |
BlockManagerParameters.getConf() |
| Modifier and Type | Method | Description |
|---|---|---|
protected java.nio.file.Path |
SingleFilePerBlockCache.getCacheFilePath(Configuration conf,
LocalDirAllocator localDirAllocator) |
Return temporary file created based on the file path retrieved from local dir allocator.
|
static boolean |
SingleFilePerBlockCache.isCacheSpaceAvailable(long fileSize,
Configuration conf,
LocalDirAllocator localDirAllocator) |
Determine if the cache space is available on the local FS.
|
void |
BlockCache.put(int blockNumber,
java.nio.ByteBuffer buffer,
Configuration conf,
LocalDirAllocator localDirAllocator) |
Puts the given block in this cache.
|
void |
SingleFilePerBlockCache.put(int blockNumber,
java.nio.ByteBuffer buffer,
Configuration conf,
LocalDirAllocator localDirAllocator) |
Puts the given block in this cache.
|
BlockManagerParameters |
BlockManagerParameters.withConf(Configuration configuration) |
Sets the configuration object.
|
| Modifier and Type | Method | Description |
|---|---|---|
static FsPermission |
FsPermission.getUMask(Configuration conf) |
Get the user file creation mask (umask)
UMASK_LABEL config param has umask value that is either symbolic
or octal. |
static void |
FsPermission.setUMask(Configuration conf,
FsPermission umask) |
Set the user file creation mask (umask)
|
| Modifier and Type | Method | Description |
|---|---|---|
void |
SFTPFileSystem.initialize(java.net.URI uriInfo,
Configuration conf) |
| Modifier and Type | Method | Description |
|---|---|---|
static PathData[] |
PathData.expandAsGlob(java.lang.String pattern,
Configuration conf) |
Expand the given path as a glob pattern.
|
Command |
CommandFactory.getInstance(java.lang.String cmdName,
Configuration conf) |
Get an instance of the requested command
|
| Constructor | Description |
|---|---|
Command(Configuration conf) |
Constructor.
|
CommandFactory(Configuration conf) |
Factory constructor for commands
|
Count(java.lang.String[] cmd,
int pos,
Configuration conf) |
Deprecated.
invoke via
FsShell |
FsCommand(Configuration conf) |
|
PathData(java.lang.String pathString,
Configuration conf) |
Creates an object to wrap the given parameters as fields.
|
PathData(java.net.URI localPath,
Configuration conf) |
Creates an object to wrap the given parameters as fields.
|
| Modifier and Type | Method | Description |
|---|---|---|
Configuration |
BaseExpression.getConf() |
|
Configuration |
FilterExpression.getConf() |
|
Configuration |
FindOptions.getConfiguration() |
Return the
Configuration return configuration Configuration |
| Modifier and Type | Method | Description |
|---|---|---|
void |
BaseExpression.setConf(Configuration conf) |
|
void |
FilterExpression.setConf(Configuration conf) |
|
void |
FindOptions.setConfiguration(Configuration configuration) |
Set the
Configuration |
| Modifier and Type | Method | Description |
|---|---|---|
protected Configuration |
DataBlocks.BlockFactory.getConf() |
Configuration.
|
| Modifier and Type | Method | Description |
|---|---|---|
static DataBlocks.BlockFactory |
DataBlocks.createFactory(java.lang.String keyToBufferDir,
Configuration configuration,
java.lang.String name) |
Create a factory.
|
| Constructor | Description |
|---|---|
BlockFactory(java.lang.String keyToBufferDir,
Configuration conf) |
| Modifier and Type | Method | Description |
|---|---|---|
static void |
ConfigUtil.addLink(Configuration conf,
java.lang.String mountTableName,
java.lang.String src,
java.net.URI target) |
Add a link to the config for the specified mount table
|
static void |
ConfigUtil.addLink(Configuration conf,
java.lang.String src,
java.net.URI target) |
Add a link to the config for the default mount table
|
static void |
ConfigUtil.addLinkFallback(Configuration conf,
java.lang.String mountTableName,
java.net.URI target) |
Add a LinkFallback to the config for the specified mount table.
|
static void |
ConfigUtil.addLinkFallback(Configuration conf,
java.net.URI target) |
Add a LinkFallback to the config for the default mount table.
|
static void |
ConfigUtil.addLinkMerge(Configuration conf,
java.lang.String mountTableName,
java.net.URI[] targets) |
Add a LinkMerge to the config for the specified mount table.
|
static void |
ConfigUtil.addLinkMerge(Configuration conf,
java.net.URI[] targets) |
Add a LinkMerge to the config for the default mount table.
|
static void |
ConfigUtil.addLinkMergeSlash(Configuration conf,
java.lang.String mountTableName,
java.net.URI target) |
Add a LinkMergeSlash to the config for the specified mount table.
|
static void |
ConfigUtil.addLinkMergeSlash(Configuration conf,
java.net.URI target) |
Add a LinkMergeSlash to the config for the default mount table.
|
static void |
ConfigUtil.addLinkNfly(Configuration conf,
java.lang.String mountTableName,
java.lang.String src,
java.lang.String settings,
java.lang.String targets) |
Add nfly link to configuration for the given mount table.
|
static void |
ConfigUtil.addLinkNfly(Configuration conf,
java.lang.String mountTableName,
java.lang.String src,
java.lang.String settings,
java.net.URI... targets) |
Add nfly link to configuration for the given mount table.
|
static void |
ConfigUtil.addLinkNfly(Configuration conf,
java.lang.String src,
java.net.URI... targets) |
|
static void |
ConfigUtil.addLinkRegex(Configuration conf,
java.lang.String mountTableName,
java.lang.String srcRegex,
java.lang.String targetStr,
java.lang.String interceptorSettings) |
Add a LinkRegex to the config for the specified mount table.
|
FileSystem |
FsGetter.get(java.net.URI uri,
Configuration conf) |
Gets file system instance of given uri.
|
static java.lang.String |
ConfigUtil.getDefaultMountTableName(Configuration conf) |
Get the name of the default mount table to use.
|
static java.lang.String |
ConfigUtil.getHomeDirValue(Configuration conf) |
Get the value of the home dir conf value for default mount table
|
static java.lang.String |
ConfigUtil.getHomeDirValue(Configuration conf,
java.lang.String mountTableName) |
Get the value of the home dir conf value for specified mount table
|
ViewFileSystemOverloadScheme.MountPathInfo<FileSystem> |
ViewFileSystemOverloadScheme.getMountPathInfo(Path path,
Configuration conf) |
Gets the mount path info, which contains the target file system and
remaining path to pass to the target file system.
|
FileSystem |
FsGetter.getNewInstance(java.net.URI uri,
Configuration conf) |
Gets new file system instance of given uri.
|
FileSystem |
ViewFileSystemOverloadScheme.getRawFileSystem(Path path,
Configuration conf) |
This is an admin only API to give access to its child raw file system, if
the path is link.
|
void |
ViewFileSystem.initialize(java.net.URI theUri,
Configuration conf) |
Called after a new FileSystem instance is constructed.
|
void |
ViewFileSystemOverloadScheme.initialize(java.net.URI theUri,
Configuration conf) |
|
static boolean |
ConfigUtil.isNestedMountPointSupported(Configuration conf) |
Check the bool config whether nested mount point is supported.
|
void |
HCFSMountTableConfigLoader.load(java.lang.String mountTableConfigPath,
Configuration conf) |
Loads the mount-table configuration from hadoop compatible file system and
add the configuration items to given configuration.
|
void |
MountTableConfigLoader.load(java.lang.String mountTableConfigPath,
Configuration conf) |
Loads the mount-table configuration into given configuration.
|
static void |
ConfigUtil.setHomeDirConf(Configuration conf,
java.lang.String homedir) |
Add config variable for homedir for default mount table
|
static void |
ConfigUtil.setHomeDirConf(Configuration conf,
java.lang.String mountTableName,
java.lang.String homedir) |
Add config variable for homedir the specified mount table
|
static void |
ConfigUtil.setIsNestedMountPointSupported(Configuration conf,
boolean isNestedMountPointSupported) |
Set the bool value isNestedMountPointSupported in config.
|
| Constructor | Description |
|---|---|
InodeTree(Configuration config,
java.lang.String viewName,
java.net.URI theUri,
boolean initingUriAsFallbackOnNoMounts) |
Create Inode Tree from the specified mount-table specified in Config.
|
ViewFileSystem(Configuration conf) |
Convenience Constructor for apps to call directly.
|
ViewFs(Configuration conf) |
| Modifier and Type | Field | Description |
|---|---|---|
protected Configuration |
ZKFailoverController.conf |
| Modifier and Type | Method | Description |
|---|---|---|
static NodeFencer |
NodeFencer.create(Configuration conf,
java.lang.String confKey) |
|
HAServiceProtocol |
HAServiceTarget.getHealthMonitorProxy(Configuration conf,
int timeoutMs) |
Returns a proxy to connect to the target HA service for health monitoring.
|
HAServiceProtocol |
HAServiceTarget.getHealthMonitorProxy(Configuration conf,
int timeoutMs,
int retries) |
|
HAServiceProtocol |
HAServiceTarget.getProxy(Configuration conf,
int timeoutMs) |
|
ZKFCProtocol |
HAServiceTarget.getZKFCProxy(Configuration conf,
int timeoutMs) |
|
void |
HAAdmin.setConf(Configuration conf) |
| Constructor | Description |
|---|---|
FailoverController(Configuration conf,
HAServiceProtocol.RequestSource source) |
|
HAAdmin(Configuration conf) |
|
ZKFailoverController(Configuration conf,
HAServiceTarget localTarget) |
| Modifier and Type | Method | Description |
|---|---|---|
protected void |
HttpServer2.addDefaultApps(org.eclipse.jetty.server.handler.ContextHandlerCollection parent,
java.lang.String appDir,
Configuration conf) |
Add default apps.
|
protected void |
HttpServer2.addDefaultServlets(Configuration configuration) |
Add default servlets.
|
protected java.util.Map<java.lang.String,java.lang.String> |
HadoopCoreAuthenticationFilterInitializer.createFilterConfig(Configuration conf) |
|
static java.util.Properties |
HttpServer2.getFilterProperties(Configuration conf,
java.util.List<java.lang.String> prefixes) |
|
abstract void |
FilterInitializer.initFilter(FilterContainer container,
Configuration conf) |
Initialize a Filter to a FilterContainer.
|
void |
HadoopCoreAuthenticationFilterInitializer.initFilter(FilterContainer container,
Configuration conf) |
|
HttpServer2.Builder |
HttpServer2.Builder.setConf(Configuration conf) |
|
HttpServer2.Builder |
HttpServer2.Builder.setSSLConf(Configuration sslCnf) |
Specify the SSL configuration to load.
|
| Modifier and Type | Method | Description |
|---|---|---|
void |
StaticUserWebFilter.initFilter(FilterContainer container,
Configuration conf) |
| Modifier and Type | Method | Description |
|---|---|---|
Configuration |
AbstractMapWritable.getConf() |
|
Configuration |
EnumSetWritable.getConf() |
|
Configuration |
GenericWritable.getConf() |
|
Configuration |
ObjectWritable.getConf() |
|
Configuration |
WritableComparator.getConf() |
| Modifier and Type | Method | Description |
|---|---|---|
static <T extends Writable> |
WritableUtils.clone(T orig,
Configuration conf) |
Make a copy of a writable object using serialization to a buffer.
|
static void |
IOUtils.copyBytes(java.io.InputStream in,
java.io.OutputStream out,
Configuration conf) |
Copies from one stream to another.
|
static void |
IOUtils.copyBytes(java.io.InputStream in,
java.io.OutputStream out,
Configuration conf,
boolean close) |
Copies from one stream to another.
|
protected SequenceFile.Reader |
MapFile.Reader.createDataFileReader(Path dataFile,
Configuration conf,
SequenceFile.Reader.Option... options) |
Override this method to specialize the type of
SequenceFile.Reader returned. |
static SequenceFile.Writer |
SequenceFile.createWriter(Configuration conf,
FSDataOutputStream out,
java.lang.Class keyClass,
java.lang.Class valClass,
SequenceFile.CompressionType compressionType,
CompressionCodec codec) |
Deprecated.
|
static SequenceFile.Writer |
SequenceFile.createWriter(Configuration conf,
FSDataOutputStream out,
java.lang.Class keyClass,
java.lang.Class valClass,
SequenceFile.CompressionType compressionType,
CompressionCodec codec,
SequenceFile.Metadata metadata) |
Deprecated.
|
static SequenceFile.Writer |
SequenceFile.createWriter(Configuration conf,
SequenceFile.Writer.Option... opts) |
Create a new Writer with the given options.
|
static SequenceFile.Writer |
SequenceFile.createWriter(FileContext fc,
Configuration conf,
Path name,
java.lang.Class keyClass,
java.lang.Class valClass,
SequenceFile.CompressionType compressionType,
CompressionCodec codec,
SequenceFile.Metadata metadata,
java.util.EnumSet<CreateFlag> createFlag,
Options.CreateOpts... opts) |
Construct the preferred type of SequenceFile Writer.
|
static SequenceFile.Writer |
SequenceFile.createWriter(FileSystem fs,
Configuration conf,
Path name,
java.lang.Class keyClass,
java.lang.Class valClass) |
Deprecated.
|
static SequenceFile.Writer |
SequenceFile.createWriter(FileSystem fs,
Configuration conf,
Path name,
java.lang.Class keyClass,
java.lang.Class valClass,
int bufferSize,
short replication,
long blockSize,
boolean createParent,
SequenceFile.CompressionType compressionType,
CompressionCodec codec,
SequenceFile.Metadata metadata) |
Deprecated.
|
static SequenceFile.Writer |
SequenceFile.createWriter(FileSystem fs,
Configuration conf,
Path name,
java.lang.Class keyClass,
java.lang.Class valClass,
int bufferSize,
short replication,
long blockSize,
SequenceFile.CompressionType compressionType,
CompressionCodec codec,
Progressable progress,
SequenceFile.Metadata metadata) |
Deprecated.
|
static SequenceFile.Writer |
SequenceFile.createWriter(FileSystem fs,
Configuration conf,
Path name,
java.lang.Class keyClass,
java.lang.Class valClass,
SequenceFile.CompressionType compressionType) |
Deprecated.
|
static SequenceFile.Writer |
SequenceFile.createWriter(FileSystem fs,
Configuration conf,
Path name,
java.lang.Class keyClass,
java.lang.Class valClass,
SequenceFile.CompressionType compressionType,
CompressionCodec codec) |
Deprecated.
|
static SequenceFile.Writer |
SequenceFile.createWriter(FileSystem fs,
Configuration conf,
Path name,
java.lang.Class keyClass,
java.lang.Class valClass,
SequenceFile.CompressionType compressionType,
CompressionCodec codec,
Progressable progress) |
Deprecated.
|
static SequenceFile.Writer |
SequenceFile.createWriter(FileSystem fs,
Configuration conf,
Path name,
java.lang.Class keyClass,
java.lang.Class valClass,
SequenceFile.CompressionType compressionType,
CompressionCodec codec,
Progressable progress,
SequenceFile.Metadata metadata) |
Deprecated.
|
static SequenceFile.Writer |
SequenceFile.createWriter(FileSystem fs,
Configuration conf,
Path name,
java.lang.Class keyClass,
java.lang.Class valClass,
SequenceFile.CompressionType compressionType,
Progressable progress) |
Deprecated.
|
static long |
MapFile.fix(FileSystem fs,
Path dir,
java.lang.Class<? extends Writable> keyClass,
java.lang.Class<? extends Writable> valueClass,
boolean dryrun,
Configuration conf) |
This method attempts to fix a corrupt MapFile by re-creating its index.
|
static WritableComparator |
WritableComparator.get(java.lang.Class<? extends WritableComparable> c,
Configuration conf) |
Get a comparator for a
WritableComparable implementation. |
static java.lang.Class<?> |
WritableName.getClass(java.lang.String name,
Configuration conf) |
Return the class for a name.
|
static SequenceFile.CompressionType |
SequenceFile.getDefaultCompressionType(Configuration job) |
Get the compression type for the reduce outputs
|
static <K> K |
DefaultStringifier.load(Configuration conf,
java.lang.String keyName,
java.lang.Class<K> itemClass) |
Restores the object from the configuration.
|
static <K> K[] |
DefaultStringifier.loadArray(Configuration conf,
java.lang.String keyName,
java.lang.Class<K> itemClass) |
Restores the array of objects from the configuration.
|
static java.lang.Class<?> |
ObjectWritable.loadClass(Configuration conf,
java.lang.String className) |
Find and load the class with given name className by first finding
it in the specified conf.
|
static Writable |
WritableFactories.newInstance(java.lang.Class<? extends Writable> c,
Configuration conf) |
Create a new instance of a class with a defined factory.
|
protected void |
MapFile.Reader.open(Path dir,
WritableComparator comparator,
Configuration conf,
SequenceFile.Reader.Option... options) |
|
static java.lang.Object |
ObjectWritable.readObject(java.io.DataInput in,
Configuration conf) |
Read a
Writable, String, primitive type, or an array of
the preceding. |
static java.lang.Object |
ObjectWritable.readObject(java.io.DataInput in,
ObjectWritable objectWritable,
Configuration conf) |
Read a
Writable, String, primitive type, or an array of
the preceding. |
void |
AbstractMapWritable.setConf(Configuration conf) |
|
void |
EnumSetWritable.setConf(Configuration conf) |
|
void |
GenericWritable.setConf(Configuration conf) |
|
void |
ObjectWritable.setConf(Configuration conf) |
|
void |
WritableComparator.setConf(Configuration conf) |
|
static void |
SequenceFile.setDefaultCompressionType(Configuration job,
SequenceFile.CompressionType val) |
Set the default compression type for sequence files.
|
static void |
MapFile.Writer.setIndexInterval(Configuration conf,
int interval) |
Sets the index interval and stores it in conf.
|
static <K> void |
DefaultStringifier.store(Configuration conf,
K item,
java.lang.String keyName) |
Stores the item in the configuration with the given keyName.
|
static <K> void |
DefaultStringifier.storeArray(Configuration conf,
K[] items,
java.lang.String keyName) |
Stores the array of items in the configuration with the given keyName.
|
static void |
ObjectWritable.writeObject(java.io.DataOutput out,
java.lang.Object instance,
java.lang.Class declaredClass,
Configuration conf) |
Write a
Writable, String, primitive type, or an array of
the preceding. |
static void |
ObjectWritable.writeObject(java.io.DataOutput out,
java.lang.Object instance,
java.lang.Class declaredClass,
Configuration conf,
boolean allowCompactArrays) |
Write a
Writable, String, primitive type, or an array of
the preceding. |
| Constructor | Description |
|---|---|
DefaultStringifier(Configuration conf,
java.lang.Class<T> c) |
|
Merger(Configuration conf) |
|
Reader(FileSystem fs,
java.lang.String file,
Configuration conf) |
Construct an array reader for the named file.
|
Reader(FileSystem fs,
java.lang.String dirName,
Configuration conf) |
Deprecated.
|
Reader(FileSystem fs,
java.lang.String dirName,
WritableComparator comparator,
Configuration conf) |
Deprecated.
|
Reader(FileSystem fs,
java.lang.String dirName,
WritableComparator comparator,
Configuration conf,
boolean open) |
Deprecated.
|
Reader(Path dir,
Configuration conf,
SequenceFile.Reader.Option... options) |
|
Reader(FileSystem fs,
java.lang.String dirName,
Configuration conf) |
Deprecated.
|
Reader(FileSystem fs,
java.lang.String dirName,
WritableComparator comparator,
Configuration conf) |
Deprecated.
|
Reader(Path dir,
Configuration conf,
SequenceFile.Reader.Option... opts) |
|
Reader(Configuration conf,
SequenceFile.Reader.Option... opts) |
|
Reader(FileSystem fs,
Path file,
Configuration conf) |
Deprecated.
Use Reader(Configuration, Option...) instead.
|
Reader(FSDataInputStream in,
int buffersize,
long start,
long length,
Configuration conf) |
Deprecated.
Use Reader(Configuration, Reader.Option...) instead.
|
Reader(FileSystem fs,
java.lang.String dirName,
Configuration conf) |
Construct a set reader for the named set.
|
Reader(FileSystem fs,
java.lang.String dirName,
WritableComparator comparator,
Configuration conf) |
Construct a set reader for the named set using the named comparator.
|
Sorter(FileSystem fs,
java.lang.Class<? extends WritableComparable> keyClass,
java.lang.Class valClass,
Configuration conf) |
Sort and merge files containing the named classes.
|
Sorter(FileSystem fs,
RawComparator comparator,
java.lang.Class keyClass,
java.lang.Class valClass,
Configuration conf) |
Sort and merge using an arbitrary
RawComparator. |
Sorter(FileSystem fs,
RawComparator comparator,
java.lang.Class keyClass,
java.lang.Class valClass,
Configuration conf,
SequenceFile.Metadata metadata) |
Sort and merge using an arbitrary
RawComparator. |
WritableComparator(java.lang.Class<? extends WritableComparable> keyClass,
Configuration conf,
boolean createInstances) |
|
Writer(Configuration conf,
FileSystem fs,
java.lang.String file,
java.lang.Class<? extends Writable> valClass) |
Create the named file for values of the named class.
|
Writer(Configuration conf,
FileSystem fs,
java.lang.String file,
java.lang.Class<? extends Writable> valClass,
SequenceFile.CompressionType compress,
Progressable progress) |
Create the named file for values of the named class.
|
Writer(Configuration conf,
FileSystem fs,
java.lang.String dirName,
java.lang.Class<? extends WritableComparable> keyClass,
java.lang.Class valClass) |
Deprecated.
|
Writer(Configuration conf,
FileSystem fs,
java.lang.String dirName,
java.lang.Class<? extends WritableComparable> keyClass,
java.lang.Class<? extends Writable> valClass,
SequenceFile.CompressionType compress,
CompressionCodec codec,
Progressable progress) |
Deprecated.
|
Writer(Configuration conf,
FileSystem fs,
java.lang.String dirName,
java.lang.Class<? extends WritableComparable> keyClass,
java.lang.Class valClass,
SequenceFile.CompressionType compress) |
Deprecated.
|
Writer(Configuration conf,
FileSystem fs,
java.lang.String dirName,
java.lang.Class<? extends WritableComparable> keyClass,
java.lang.Class valClass,
SequenceFile.CompressionType compress,
Progressable progress) |
Deprecated.
|
Writer(Configuration conf,
FileSystem fs,
java.lang.String dirName,
WritableComparator comparator,
java.lang.Class valClass) |
Deprecated.
|
Writer(Configuration conf,
FileSystem fs,
java.lang.String dirName,
WritableComparator comparator,
java.lang.Class valClass,
SequenceFile.CompressionType compress) |
Deprecated.
|
Writer(Configuration conf,
FileSystem fs,
java.lang.String dirName,
WritableComparator comparator,
java.lang.Class valClass,
SequenceFile.CompressionType compress,
CompressionCodec codec,
Progressable progress) |
Deprecated.
|
Writer(Configuration conf,
FileSystem fs,
java.lang.String dirName,
WritableComparator comparator,
java.lang.Class valClass,
SequenceFile.CompressionType compress,
Progressable progress) |
Deprecated.
|
Writer(Configuration conf,
Path dir,
SequenceFile.Writer.Option... options) |
|
Writer(Configuration conf,
FileSystem fs,
java.lang.String dirName,
java.lang.Class<? extends WritableComparable> keyClass,
java.lang.Class valClass) |
Deprecated.
Use Writer(Configuration, Path, Option...) instead.
|
Writer(Configuration conf,
FileSystem fs,
java.lang.String dirName,
java.lang.Class<? extends WritableComparable> keyClass,
java.lang.Class valClass,
SequenceFile.CompressionType compress) |
Deprecated.
Use Writer(Configuration, Path, Option...) instead.
|
Writer(Configuration conf,
FileSystem fs,
java.lang.String dirName,
java.lang.Class<? extends WritableComparable> keyClass,
java.lang.Class valClass,
SequenceFile.CompressionType compress,
CompressionCodec codec,
Progressable progress) |
Deprecated.
Use Writer(Configuration, Path, Option...) instead.
|
Writer(Configuration conf,
FileSystem fs,
java.lang.String dirName,
java.lang.Class<? extends WritableComparable> keyClass,
java.lang.Class valClass,
SequenceFile.CompressionType compress,
Progressable progress) |
Deprecated.
Use Writer(Configuration, Path, Option...) instead.
|
Writer(Configuration conf,
FileSystem fs,
java.lang.String dirName,
WritableComparator comparator,
java.lang.Class valClass) |
Deprecated.
Use Writer(Configuration, Path, Option...) instead.
|
Writer(Configuration conf,
FileSystem fs,
java.lang.String dirName,
WritableComparator comparator,
java.lang.Class valClass,
SequenceFile.CompressionType compress) |
Deprecated.
Use Writer(Configuration, Path, Option...) instead.
|
Writer(Configuration conf,
FileSystem fs,
java.lang.String dirName,
WritableComparator comparator,
java.lang.Class valClass,
SequenceFile.CompressionType compress,
CompressionCodec codec,
Progressable progress) |
Deprecated.
Use Writer(Configuration, Path, Option...) instead.
|
Writer(Configuration conf,
FileSystem fs,
java.lang.String dirName,
WritableComparator comparator,
java.lang.Class valClass,
SequenceFile.CompressionType compress,
Progressable progress) |
Deprecated.
Use Writer(Configuration, Path, Option...)} instead.
|
Writer(Configuration conf,
Path dirName,
SequenceFile.Writer.Option... opts) |
|
Writer(FileSystem fs,
Configuration conf,
Path name,
java.lang.Class keyClass,
java.lang.Class valClass) |
Deprecated.
|
Writer(FileSystem fs,
Configuration conf,
Path name,
java.lang.Class keyClass,
java.lang.Class valClass,
int bufferSize,
short replication,
long blockSize,
Progressable progress,
SequenceFile.Metadata metadata) |
Deprecated.
|
Writer(FileSystem fs,
Configuration conf,
Path name,
java.lang.Class keyClass,
java.lang.Class valClass,
Progressable progress,
SequenceFile.Metadata metadata) |
Deprecated.
|
Writer(Configuration conf,
FileSystem fs,
java.lang.String dirName,
java.lang.Class<? extends WritableComparable> keyClass,
SequenceFile.CompressionType compress) |
Create a set naming the element class and compression type.
|
Writer(Configuration conf,
FileSystem fs,
java.lang.String dirName,
WritableComparator comparator,
SequenceFile.CompressionType compress) |
Create a set naming the element comparator and compression type.
|
| Modifier and Type | Method | Description |
|---|---|---|
Configuration |
BZip2Codec.getConf() |
Return the configuration used by this object.
|
Configuration |
DefaultCodec.getConf() |
|
Configuration |
Lz4Codec.getConf() |
Return the configuration used by this object.
|
Configuration |
PassthroughCodec.getConf() |
|
Configuration |
SnappyCodec.getConf() |
Return the configuration used by this object.
|
Configuration |
ZStandardCodec.getConf() |
Return the configuration used by this object.
|
| Modifier and Type | Method | Description |
|---|---|---|
static java.util.List<java.lang.Class<? extends CompressionCodec>> |
CompressionCodecFactory.getCodecClasses(Configuration conf) |
Get the list of codecs discovered via a Java ServiceLoader, or
listed in the configuration.
|
static int |
ZStandardCodec.getCompressionBufferSize(Configuration conf) |
|
static int |
ZStandardCodec.getCompressionLevel(Configuration conf) |
|
static Compressor |
CodecPool.getCompressor(CompressionCodec codec,
Configuration conf) |
Get a
Compressor for the given CompressionCodec from the
pool or a new one. |
static int |
ZStandardCodec.getDecompressionBufferSize(Configuration conf) |
|
void |
Compressor.reinit(Configuration conf) |
Prepare the compressor to be used in a new stream with settings defined in
the given Configuration
|
static void |
CompressionCodecFactory.setCodecClasses(Configuration conf,
java.util.List<java.lang.Class> classes) |
Sets a list of codec classes in the configuration.
|
void |
BZip2Codec.setConf(Configuration conf) |
Set the configuration to be used by this object.
|
void |
DefaultCodec.setConf(Configuration conf) |
|
void |
Lz4Codec.setConf(Configuration conf) |
Set the configuration to be used by this object.
|
void |
PassthroughCodec.setConf(Configuration conf) |
|
void |
SnappyCodec.setConf(Configuration conf) |
Set the configuration to be used by this object.
|
void |
ZStandardCodec.setConf(Configuration conf) |
Set the configuration to be used by this object.
|
| Constructor | Description |
|---|---|
CompressionCodecFactory(Configuration conf) |
Find the codecs specified in the config value io.compression.codecs
and register them.
|
| Modifier and Type | Method | Description |
|---|---|---|
static int |
Bzip2Factory.getBlockSize(Configuration conf) |
|
static Compressor |
Bzip2Factory.getBzip2Compressor(Configuration conf) |
Return the appropriate implementation of the bzip2 compressor.
|
static java.lang.Class<? extends Compressor> |
Bzip2Factory.getBzip2CompressorType(Configuration conf) |
Return the appropriate type of the bzip2 compressor.
|
static Decompressor |
Bzip2Factory.getBzip2Decompressor(Configuration conf) |
Return the appropriate implementation of the bzip2 decompressor.
|
static java.lang.Class<? extends Decompressor> |
Bzip2Factory.getBzip2DecompressorType(Configuration conf) |
Return the appropriate type of the bzip2 decompressor.
|
static java.lang.String |
Bzip2Factory.getLibraryName(Configuration conf) |
|
static int |
Bzip2Factory.getWorkFactor(Configuration conf) |
|
static boolean |
Bzip2Factory.isNativeBzip2Loaded(Configuration conf) |
Check if native-bzip2 code is loaded & initialized correctly and
can be loaded for this job.
|
void |
Bzip2Compressor.reinit(Configuration conf) |
Prepare the compressor to be used in a new stream with settings defined in
the given Configuration.
|
void |
BZip2DummyCompressor.reinit(Configuration conf) |
|
static void |
Bzip2Factory.setBlockSize(Configuration conf,
int blockSize) |
|
static void |
Bzip2Factory.setWorkFactor(Configuration conf,
int workFactor) |
| Constructor | Description |
|---|---|
Bzip2Compressor(Configuration conf) |
Creates a new compressor, taking settings from the configuration.
|
| Modifier and Type | Method | Description |
|---|---|---|
void |
Lz4Compressor.reinit(Configuration conf) |
Prepare the compressor to be used in a new stream with settings defined in
the given Configuration
|
| Modifier and Type | Method | Description |
|---|---|---|
void |
SnappyCompressor.reinit(Configuration conf) |
Prepare the compressor to be used in a new stream with settings defined in
the given Configuration
|
| Modifier and Type | Method | Description |
|---|---|---|
static ZlibCompressor.CompressionLevel |
ZlibFactory.getCompressionLevel(Configuration conf) |
|
static ZlibCompressor.CompressionStrategy |
ZlibFactory.getCompressionStrategy(Configuration conf) |
|
static Compressor |
ZlibFactory.getZlibCompressor(Configuration conf) |
Return the appropriate implementation of the zlib compressor.
|
static java.lang.Class<? extends Compressor> |
ZlibFactory.getZlibCompressorType(Configuration conf) |
Return the appropriate type of the zlib compressor.
|
static Decompressor |
ZlibFactory.getZlibDecompressor(Configuration conf) |
Return the appropriate implementation of the zlib decompressor.
|
static java.lang.Class<? extends Decompressor> |
ZlibFactory.getZlibDecompressorType(Configuration conf) |
Return the appropriate type of the zlib decompressor.
|
static DirectDecompressor |
ZlibFactory.getZlibDirectDecompressor(Configuration conf) |
Return the appropriate implementation of the zlib direct decompressor.
|
static boolean |
ZlibFactory.isNativeZlibLoaded(Configuration conf) |
Check if native-zlib code is loaded & initialized correctly and
can be loaded for this job.
|
void |
BuiltInGzipCompressor.reinit(Configuration conf) |
|
void |
BuiltInZlibDeflater.reinit(Configuration conf) |
reinit the compressor with the given configuration.
|
void |
ZlibCompressor.reinit(Configuration conf) |
Prepare the compressor to be used in a new stream with settings defined in
the given Configuration.
|
static void |
ZlibFactory.setCompressionLevel(Configuration conf,
ZlibCompressor.CompressionLevel level) |
|
static void |
ZlibFactory.setCompressionStrategy(Configuration conf,
ZlibCompressor.CompressionStrategy strategy) |
| Constructor | Description |
|---|---|
BuiltInGzipCompressor(Configuration conf) |
|
ZlibCompressor(Configuration conf) |
Creates a new compressor, taking settings from the configuration.
|
| Modifier and Type | Method | Description |
|---|---|---|
void |
ZStandardCompressor.reinit(Configuration conf) |
Prepare the compressor to be used in a new stream with settings defined in
the given Configuration.
|
| Modifier and Type | Method | Description |
|---|---|---|
static ErasureDecoder |
CodecUtil.createDecoder(Configuration conf,
ErasureCodecOptions options) |
Create decoder corresponding to given codec.
|
static ErasureEncoder |
CodecUtil.createEncoder(Configuration conf,
ErasureCodecOptions options) |
Create encoder corresponding to given codec.
|
static RawErasureDecoder |
CodecUtil.createRawDecoder(Configuration conf,
java.lang.String codec,
ErasureCoderOptions coderOptions) |
Create RS raw decoder according to configuration.
|
static RawErasureEncoder |
CodecUtil.createRawEncoder(Configuration conf,
java.lang.String codec,
ErasureCoderOptions coderOptions) |
Create RS raw encoder according to configuration.
|
| Constructor | Description |
|---|---|
DummyErasureCodec(Configuration conf,
ErasureCodecOptions options) |
|
ErasureCodec(Configuration conf,
ErasureCodecOptions options) |
|
HHXORErasureCodec(Configuration conf,
ErasureCodecOptions options) |
|
RSErasureCodec(Configuration conf,
ErasureCodecOptions options) |
|
XORErasureCodec(Configuration conf,
ErasureCodecOptions options) |
| Modifier and Type | Field | Description |
|---|---|---|
protected static Configuration |
Compression.Algorithm.conf |
| Constructor | Description |
|---|---|
Reader(FSDataInputStream fsdis,
long fileLength,
Configuration conf) |
Constructor
|
Writer(FSDataOutputStream fsdos,
int minBlockSize,
java.lang.String compressName,
java.lang.String comparator,
Configuration conf) |
Constructor
|
| Modifier and Type | Method | Description |
|---|---|---|
static RetryPolicy |
RetryUtils.getDefaultRetryPolicy(Configuration conf,
java.lang.String retryPolicyEnabledKey,
boolean defaultRetryPolicyEnabled,
java.lang.String retryPolicySpecKey,
java.lang.String defaultRetryPolicySpec,
java.lang.String remoteExceptionToRetry) |
Return the default retry policy set in conf.
|
static RetryPolicy |
RetryUtils.getMultipleLinearRandomRetry(Configuration conf,
java.lang.String retryPolicyEnabledKey,
boolean defaultRetryPolicyEnabled,
java.lang.String retryPolicySpecKey,
java.lang.String defaultRetryPolicySpec) |
Return the MultipleLinearRandomRetry policy specified in the conf,
or null if the feature is disabled.
|
| Constructor | Description |
|---|---|
SerializationFactory(Configuration conf) |
Serializations are found by reading the
io.serializations
property from conf, which is a comma-delimited list of
classnames. |
| Modifier and Type | Method | Description |
|---|---|---|
static void |
Server.bind(java.net.ServerSocket socket,
java.net.InetSocketAddress address,
int backlog,
Configuration conf,
java.lang.String rangeConf) |
|
Client |
ClientCache.getClient(Configuration conf) |
Construct & cache an IPC client with the default SocketFactory
and default valueClass if no cached client exists.
|
Client |
ClientCache.getClient(Configuration conf,
javax.net.SocketFactory factory) |
Construct & cache an IPC client with the user-provided SocketFactory
if no cached client exists.
|
Client |
ClientCache.getClient(Configuration conf,
javax.net.SocketFactory factory,
java.lang.Class<? extends Writable> valueClass) |
Construct & cache an IPC client with the user-provided SocketFactory
if no cached client exists.
|
static int |
Client.getPingInterval(Configuration conf) |
Get the ping interval from configuration;
If not set in the configuration, return the default value.
|
ProtocolProxy<ProtocolMetaInfoPB> |
ProtobufRpcEngine.getProtocolMetaInfoProxy(Client.ConnectionId connId,
Configuration conf,
javax.net.SocketFactory factory) |
Deprecated.
|
ProtocolProxy<ProtocolMetaInfoPB> |
ProtobufRpcEngine2.getProtocolMetaInfoProxy(Client.ConnectionId connId,
Configuration conf,
javax.net.SocketFactory factory) |
|
ProtocolProxy<ProtocolMetaInfoPB> |
RpcEngine.getProtocolMetaInfoProxy(Client.ConnectionId connId,
Configuration conf,
javax.net.SocketFactory factory) |
Returns a proxy for ProtocolMetaInfoPB, which uses the given connection
id.
|
ProtocolProxy<ProtocolMetaInfoPB> |
WritableRpcEngine.getProtocolMetaInfoProxy(Client.ConnectionId connId,
Configuration conf,
javax.net.SocketFactory factory) |
Deprecated.
|
static <T> ProtocolProxy<T> |
RPC.getProtocolProxy(java.lang.Class<T> protocol,
long clientVersion,
java.net.InetSocketAddress addr,
Configuration conf) |
Get a protocol proxy that contains a proxy connection to a remote server
and a set of methods that are supported by the server
|
static <T> ProtocolProxy<T> |
RPC.getProtocolProxy(java.lang.Class<T> protocol,
long clientVersion,
java.net.InetSocketAddress addr,
Configuration conf,
javax.net.SocketFactory factory) |
Get a protocol proxy that contains a proxy connection to a remote server
and a set of methods that are supported by the server.
|
static <T> ProtocolProxy<T> |
RPC.getProtocolProxy(java.lang.Class<T> protocol,
long clientVersion,
java.net.InetSocketAddress addr,
UserGroupInformation ticket,
Configuration conf,
javax.net.SocketFactory factory) |
Get a protocol proxy that contains a proxy connection to a remote server
and a set of methods that are supported by the server
|
static <T> ProtocolProxy<T> |
RPC.getProtocolProxy(java.lang.Class<T> protocol,
long clientVersion,
java.net.InetSocketAddress addr,
UserGroupInformation ticket,
Configuration conf,
javax.net.SocketFactory factory,
int rpcTimeout,
RetryPolicy connectionRetryPolicy) |
Get a protocol proxy that contains a proxy connection to a remote server
and a set of methods that are supported by the server.
|
static <T> ProtocolProxy<T> |
RPC.getProtocolProxy(java.lang.Class<T> protocol,
long clientVersion,
java.net.InetSocketAddress addr,
UserGroupInformation ticket,
Configuration conf,
javax.net.SocketFactory factory,
int rpcTimeout,
RetryPolicy connectionRetryPolicy,
java.util.concurrent.atomic.AtomicBoolean fallbackToSimpleAuth) |
Get a protocol proxy that contains a proxy connection to a remote server
and a set of methods that are supported by the server.
|
static <T> ProtocolProxy<T> |
RPC.getProtocolProxy(java.lang.Class<T> protocol,
long clientVersion,
java.net.InetSocketAddress addr,
UserGroupInformation ticket,
Configuration conf,
javax.net.SocketFactory factory,
int rpcTimeout,
RetryPolicy connectionRetryPolicy,
java.util.concurrent.atomic.AtomicBoolean fallbackToSimpleAuth,
AlignmentContext alignmentContext) |
Get a protocol proxy that contains a proxy connection to a remote server
and a set of methods that are supported by the server.
|
static <T> ProtocolProxy<T> |
RPC.getProtocolProxy(java.lang.Class<T> protocol,
long clientVersion,
Client.ConnectionId connId,
Configuration conf,
javax.net.SocketFactory factory) |
Get a protocol proxy that contains a proxy connection to a remote server
and a set of methods that are supported by the server.
|
static <T> ProtocolProxy<T> |
RPC.getProtocolProxy(java.lang.Class<T> protocol,
long clientVersion,
Client.ConnectionId connId,
Configuration conf,
javax.net.SocketFactory factory,
AlignmentContext alignmentContext) |
Get a protocol proxy that contains a proxy connection to a remote server
and a set of methods that are supported by the server.
|
<T> ProtocolProxy<T> |
ProtobufRpcEngine.getProxy(java.lang.Class<T> protocol,
long clientVersion,
java.net.InetSocketAddress addr,
UserGroupInformation ticket,
Configuration conf,
javax.net.SocketFactory factory,
int rpcTimeout) |
Deprecated.
|
<T> ProtocolProxy<T> |
ProtobufRpcEngine.getProxy(java.lang.Class<T> protocol,
long clientVersion,
java.net.InetSocketAddress addr,
UserGroupInformation ticket,
Configuration conf,
javax.net.SocketFactory factory,
int rpcTimeout,
RetryPolicy connectionRetryPolicy) |
Deprecated.
|
<T> ProtocolProxy<T> |
ProtobufRpcEngine.getProxy(java.lang.Class<T> protocol,
long clientVersion,
java.net.InetSocketAddress addr,
UserGroupInformation ticket,
Configuration conf,
javax.net.SocketFactory factory,
int rpcTimeout,
RetryPolicy connectionRetryPolicy,
java.util.concurrent.atomic.AtomicBoolean fallbackToSimpleAuth,
AlignmentContext alignmentContext) |
Deprecated.
|
<T> ProtocolProxy<T> |
ProtobufRpcEngine.getProxy(java.lang.Class<T> protocol,
long clientVersion,
Client.ConnectionId connId,
Configuration conf,
javax.net.SocketFactory factory,
AlignmentContext alignmentContext) |
Deprecated.
|
<T> ProtocolProxy<T> |
ProtobufRpcEngine2.getProxy(java.lang.Class<T> protocol,
long clientVersion,
java.net.InetSocketAddress addr,
UserGroupInformation ticket,
Configuration conf,
javax.net.SocketFactory factory,
int rpcTimeout) |
|
<T> ProtocolProxy<T> |
ProtobufRpcEngine2.getProxy(java.lang.Class<T> protocol,
long clientVersion,
java.net.InetSocketAddress addr,
UserGroupInformation ticket,
Configuration conf,
javax.net.SocketFactory factory,
int rpcTimeout,
RetryPolicy connectionRetryPolicy) |
|
<T> ProtocolProxy<T> |
ProtobufRpcEngine2.getProxy(java.lang.Class<T> protocol,
long clientVersion,
java.net.InetSocketAddress addr,
UserGroupInformation ticket,
Configuration conf,
javax.net.SocketFactory factory,
int rpcTimeout,
RetryPolicy connectionRetryPolicy,
java.util.concurrent.atomic.AtomicBoolean fallbackToSimpleAuth,
AlignmentContext alignmentContext) |
|
<T> ProtocolProxy<T> |
ProtobufRpcEngine2.getProxy(java.lang.Class<T> protocol,
long clientVersion,
Client.ConnectionId connId,
Configuration conf,
javax.net.SocketFactory factory,
AlignmentContext alignmentContext) |
|
static <T> T |
RPC.getProxy(java.lang.Class<T> protocol,
long clientVersion,
java.net.InetSocketAddress addr,
Configuration conf) |
Construct a client-side proxy object with the default SocketFactory.
|
static <T> T |
RPC.getProxy(java.lang.Class<T> protocol,
long clientVersion,
java.net.InetSocketAddress addr,
Configuration conf,
javax.net.SocketFactory factory) |
Construct a client-side proxy object that implements the named protocol,
talking to a server at the named address.
|
static <T> T |
RPC.getProxy(java.lang.Class<T> protocol,
long clientVersion,
java.net.InetSocketAddress addr,
UserGroupInformation ticket,
Configuration conf,
javax.net.SocketFactory factory) |
Construct a client-side proxy object that implements the named protocol,
talking to a server at the named address.
|
static <T> T |
RPC.getProxy(java.lang.Class<T> protocol,
long clientVersion,
java.net.InetSocketAddress addr,
UserGroupInformation ticket,
Configuration conf,
javax.net.SocketFactory factory,
int rpcTimeout) |
Construct a client-side proxy that implements the named protocol,
talking to a server at the named address.
|
<T> ProtocolProxy<T> |
RpcEngine.getProxy(java.lang.Class<T> protocol,
long clientVersion,
java.net.InetSocketAddress addr,
UserGroupInformation ticket,
Configuration conf,
javax.net.SocketFactory factory,
int rpcTimeout,
RetryPolicy connectionRetryPolicy) |
Construct a client-side proxy object.
|
<T> ProtocolProxy<T> |
RpcEngine.getProxy(java.lang.Class<T> protocol,
long clientVersion,
java.net.InetSocketAddress addr,
UserGroupInformation ticket,
Configuration conf,
javax.net.SocketFactory factory,
int rpcTimeout,
RetryPolicy connectionRetryPolicy,
java.util.concurrent.atomic.AtomicBoolean fallbackToSimpleAuth,
AlignmentContext alignmentContext) |
Construct a client-side proxy object.
|
<T> ProtocolProxy<T> |
RpcEngine.getProxy(java.lang.Class<T> protocol,
long clientVersion,
Client.ConnectionId connId,
Configuration conf,
javax.net.SocketFactory factory,
AlignmentContext alignmentContext) |
Construct a client-side proxy object with a ConnectionId.
|
<T> ProtocolProxy<T> |
WritableRpcEngine.getProxy(java.lang.Class<T> protocol,
long clientVersion,
java.net.InetSocketAddress addr,
UserGroupInformation ticket,
Configuration conf,
javax.net.SocketFactory factory,
int rpcTimeout,
RetryPolicy connectionRetryPolicy) |
Deprecated.
Construct a client-side proxy object that implements the named protocol,
talking to a server at the named address.
|
<T> ProtocolProxy<T> |
WritableRpcEngine.getProxy(java.lang.Class<T> protocol,
long clientVersion,
java.net.InetSocketAddress addr,
UserGroupInformation ticket,
Configuration conf,
javax.net.SocketFactory factory,
int rpcTimeout,
RetryPolicy connectionRetryPolicy,
java.util.concurrent.atomic.AtomicBoolean fallbackToSimpleAuth,
AlignmentContext alignmentContext) |
Deprecated.
Construct a client-side proxy object that implements the named protocol,
talking to a server at the named address.
|
<T> ProtocolProxy<T> |
WritableRpcEngine.getProxy(java.lang.Class<T> protocol,
long clientVersion,
Client.ConnectionId connId,
Configuration conf,
javax.net.SocketFactory factory,
AlignmentContext alignmentContext) |
Deprecated.
Construct a client-side proxy object with a ConnectionId.
|
static int |
Client.getRpcTimeout(Configuration conf) |
The time after which a RPC will timeout.
|
static int |
RPC.getRpcTimeout(Configuration conf) |
Get the RPC time from configuration;
If not set in the configuration, return the default value.
|
RPC.Server |
ProtobufRpcEngine.getServer(java.lang.Class<?> protocol,
java.lang.Object protocolImpl,
java.lang.String bindAddress,
int port,
int numHandlers,
int numReaders,
int queueSizePerHandler,
boolean verbose,
Configuration conf,
SecretManager<? extends TokenIdentifier> secretManager,
java.lang.String portRangeConfig,
AlignmentContext alignmentContext) |
Deprecated.
|
RPC.Server |
ProtobufRpcEngine2.getServer(java.lang.Class<?> protocol,
java.lang.Object protocolImpl,
java.lang.String bindAddress,
int port,
int numHandlers,
int numReaders,
int queueSizePerHandler,
boolean verbose,
Configuration conf,
SecretManager<? extends TokenIdentifier> secretManager,
java.lang.String portRangeConfig,
AlignmentContext alignmentContext) |
|
RPC.Server |
RpcEngine.getServer(java.lang.Class<?> protocol,
java.lang.Object instance,
java.lang.String bindAddress,
int port,
int numHandlers,
int numReaders,
int queueSizePerHandler,
boolean verbose,
Configuration conf,
SecretManager<? extends TokenIdentifier> secretManager,
java.lang.String portRangeConfig,
AlignmentContext alignmentContext) |
Construct a server for a protocol implementation instance.
|
RPC.Server |
WritableRpcEngine.getServer(java.lang.Class<?> protocolClass,
java.lang.Object protocolImpl,
java.lang.String bindAddress,
int port,
int numHandlers,
int numReaders,
int queueSizePerHandler,
boolean verbose,
Configuration conf,
SecretManager<? extends TokenIdentifier> secretManager,
java.lang.String portRangeConfig,
AlignmentContext alignmentContext) |
Deprecated.
|
static int |
Client.getTimeout(Configuration conf) |
Deprecated.
use
Client.getRpcTimeout(Configuration) instead |
void |
CostProvider.init(java.lang.String namespace,
Configuration conf) |
Initialize this provider using the given configuration, examining only
ones which fall within the provided namespace.
|
void |
DefaultCostProvider.init(java.lang.String namespace,
Configuration conf) |
|
void |
WeightedTimeCostProvider.init(java.lang.String namespace,
Configuration conf) |
|
<T> T |
RpcWritable.Buffer.newInstance(java.lang.Class<T> valueClass,
Configuration conf) |
|
void |
Server.refreshCallQueue(Configuration conf) |
|
void |
Server.refreshServiceAcl(Configuration conf,
PolicyProvider provider) |
Refresh the service authorization ACL for the service handled by this server.
|
void |
Server.refreshServiceAclWithLoadedConfiguration(Configuration conf,
PolicyProvider provider) |
Refresh the service authorization ACL for the service handled by this server
using the specified Configuration.
|
static void |
Client.setConnectTimeout(Configuration conf,
int timeout) |
set the connection timeout value in configuration
|
static void |
Client.setPingInterval(Configuration conf,
int pingInterval) |
set the ping interval value in configuration
|
static void |
RPC.setProtocolEngine(Configuration conf,
java.lang.Class<?> protocol,
java.lang.Class<?> engine) |
Set a protocol to use a non-default RpcEngine if one
is not specified in the configuration.
|
void |
CallQueueManager.swapQueue(java.lang.Class<? extends RpcScheduler> schedulerClass,
java.lang.Class<? extends java.util.concurrent.BlockingQueue<E>> queueClassToUse,
int maxSize,
java.lang.String ns,
Configuration conf) |
Replaces active queue with the newly requested one and transfers
all calls to the newQ before returning.
|
static <T> ProtocolProxy<T> |
RPC.waitForProtocolProxy(java.lang.Class<T> protocol,
long clientVersion,
java.net.InetSocketAddress addr,
Configuration conf) |
Get a protocol proxy that contains a proxy connection to a remote server
and a set of methods that are supported by the server.
|
static <T> ProtocolProxy<T> |
RPC.waitForProtocolProxy(java.lang.Class<T> protocol,
long clientVersion,
java.net.InetSocketAddress addr,
Configuration conf,
int rpcTimeout,
RetryPolicy connectionRetryPolicy,
long timeout) |
Get a protocol proxy that contains a proxy connection to a remote server
and a set of methods that are supported by the server.
|
static <T> ProtocolProxy<T> |
RPC.waitForProtocolProxy(java.lang.Class<T> protocol,
long clientVersion,
java.net.InetSocketAddress addr,
Configuration conf,
long connTimeout) |
Get a protocol proxy that contains a proxy connection to a remote server
and a set of methods that are supported by the server
|
static <T> T |
RPC.waitForProxy(java.lang.Class<T> protocol,
long clientVersion,
java.net.InetSocketAddress addr,
Configuration conf) |
Get a proxy connection to a remote server.
|
static <T> T |
RPC.waitForProxy(java.lang.Class<T> protocol,
long clientVersion,
java.net.InetSocketAddress addr,
Configuration conf,
int rpcTimeout,
long timeout) |
Get a proxy connection to a remote server.
|
static <T> T |
RPC.waitForProxy(java.lang.Class<T> protocol,
long clientVersion,
java.net.InetSocketAddress addr,
Configuration conf,
long connTimeout) |
Get a proxy connection to a remote server.
|
| Constructor | Description |
|---|---|
Builder(java.lang.String context,
Configuration conf) |
|
Builder(Configuration conf) |
|
CallQueueManager(java.lang.Class<? extends java.util.concurrent.BlockingQueue<E>> backingClass,
java.lang.Class<? extends RpcScheduler> schedulerClass,
boolean clientBackOffEnabled,
int maxQueueSize,
java.lang.String namespace,
Configuration conf) |
|
Client(java.lang.Class<? extends Writable> valueClass,
Configuration conf) |
Construct an IPC client with the default SocketFactory.
|
Client(java.lang.Class<? extends Writable> valueClass,
Configuration conf,
javax.net.SocketFactory factory) |
Construct an IPC client whose values are of the given
Writable
class. |
ConnectionId(java.net.InetSocketAddress address,
java.lang.Class<?> protocol,
UserGroupInformation ticket,
int rpcTimeout,
RetryPolicy connectionRetryPolicy,
Configuration conf) |
|
DecayRpcScheduler(int numLevels,
java.lang.String ns,
Configuration conf) |
Create a decay scheduler.
|
DefaultRpcScheduler(int priorityLevels,
java.lang.String namespace,
Configuration conf) |
|
FairCallQueue(int priorityLevels,
int capacity,
java.lang.String ns,
boolean serverFailOverEnabled,
Configuration conf) |
|
FairCallQueue(int priorityLevels,
int capacity,
java.lang.String ns,
int[] capacityWeights,
boolean serverFailOverEnabled,
Configuration conf) |
Create a FairCallQueue.
|
FairCallQueue(int priorityLevels,
int capacity,
java.lang.String ns,
Configuration conf) |
|
Invoker(java.lang.Class<?> protocol,
java.net.InetSocketAddress addr,
UserGroupInformation ticket,
Configuration conf,
javax.net.SocketFactory factory,
int rpcTimeout,
RetryPolicy connectionRetryPolicy,
java.util.concurrent.atomic.AtomicBoolean fallbackToSimpleAuth,
AlignmentContext alignmentContext) |
|
Invoker(java.lang.Class<?> protocol,
Client.ConnectionId connId,
Configuration conf,
javax.net.SocketFactory factory,
AlignmentContext alignmentContext) |
This constructor takes a connectionId, instead of creating a new one.
|
Invoker(java.lang.Class<?> protocol,
java.net.InetSocketAddress addr,
UserGroupInformation ticket,
Configuration conf,
javax.net.SocketFactory factory,
int rpcTimeout,
RetryPolicy connectionRetryPolicy,
java.util.concurrent.atomic.AtomicBoolean fallbackToSimpleAuth,
AlignmentContext alignmentContext) |
|
Invoker(java.lang.Class<?> protocol,
Client.ConnectionId connId,
Configuration conf,
javax.net.SocketFactory factory,
AlignmentContext alignmentContext) |
This constructor takes a connectionId, instead of creating a new one.
|
Server(java.lang.Class<?> protocolClass,
java.lang.Object protocolImpl,
Configuration conf,
java.lang.String bindAddress,
int port,
int numHandlers,
int numReaders,
int queueSizePerHandler,
boolean verbose,
SecretManager<? extends TokenIdentifier> secretManager,
java.lang.String portRangeConfig,
AlignmentContext alignmentContext) |
Construct an RPC server.
|
Server(java.lang.Class<?> protocolClass,
java.lang.Object protocolImpl,
Configuration conf,
java.lang.String bindAddress,
int port,
int numHandlers,
int numReaders,
int queueSizePerHandler,
boolean verbose,
SecretManager<? extends TokenIdentifier> secretManager,
java.lang.String portRangeConfig,
AlignmentContext alignmentContext) |
Construct an RPC server.
|
Server(java.lang.String bindAddress,
int port,
java.lang.Class<? extends Writable> paramClass,
int handlerCount,
int numReaders,
int queueSizePerHandler,
Configuration conf,
java.lang.String serverName,
SecretManager<? extends TokenIdentifier> secretManager,
java.lang.String portRangeConfig) |
|
Server(java.lang.String bindAddress,
int port,
java.lang.Class<? extends Writable> rpcRequestClass,
int handlerCount,
int numReaders,
int queueSizePerHandler,
Configuration conf,
java.lang.String serverName,
SecretManager<? extends TokenIdentifier> secretManager) |
|
Server(java.lang.String bindAddress,
int port,
java.lang.Class<? extends Writable> rpcRequestClass,
int handlerCount,
int numReaders,
int queueSizePerHandler,
Configuration conf,
java.lang.String serverName,
SecretManager<? extends TokenIdentifier> secretManager,
java.lang.String portRangeConfig) |
Constructs a server listening on the named port and address.
|
Server(java.lang.String bindAddress,
int port,
java.lang.Class<? extends Writable> paramClass,
int handlerCount,
Configuration conf) |
|
Server(java.lang.Class<?> protocolClass,
java.lang.Object protocolImpl,
Configuration conf,
java.lang.String bindAddress,
int port) |
Deprecated.
Construct an RPC server.
|
Server(java.lang.Class<?> protocolClass,
java.lang.Object protocolImpl,
Configuration conf,
java.lang.String bindAddress,
int port,
int numHandlers,
int numReaders,
int queueSizePerHandler,
boolean verbose,
SecretManager<? extends TokenIdentifier> secretManager,
java.lang.String portRangeConfig) |
Deprecated.
use Server#Server(Class, Object,
Configuration, String, int, int, int, int, boolean, SecretManager)
|
Server(java.lang.Class<?> protocolClass,
java.lang.Object protocolImpl,
Configuration conf,
java.lang.String bindAddress,
int port,
int numHandlers,
int numReaders,
int queueSizePerHandler,
boolean verbose,
SecretManager<? extends TokenIdentifier> secretManager,
java.lang.String portRangeConfig,
AlignmentContext alignmentContext) |
Deprecated.
Construct an RPC server.
|
Server(java.lang.Object instance,
Configuration conf,
java.lang.String bindAddress,
int port) |
Deprecated.
Use #Server(Class, Object, Configuration, String, int)
|
Server(java.lang.Object protocolImpl,
Configuration conf,
java.lang.String bindAddress,
int port,
int numHandlers,
int numReaders,
int queueSizePerHandler,
boolean verbose,
SecretManager<? extends TokenIdentifier> secretManager) |
Deprecated.
use Server#Server(Class, Object,
Configuration, String, int, int, int, int, boolean, SecretManager)
|
WeightedRoundRobinMultiplexer(int aNumQueues,
java.lang.String ns,
Configuration conf) |
| Modifier and Type | Method | Description |
|---|---|---|
static RpcMetrics |
RpcMetrics.create(Server server,
Configuration conf) |
|
static java.util.concurrent.TimeUnit |
RpcMetrics.getMetricsTimeUnit(Configuration conf) |
| Modifier and Type | Field | Description |
|---|---|---|
protected static Configuration |
RollingFileSystemSink.suppliedConf |
| Modifier and Type | Method | Description |
|---|---|---|
Configuration |
AbstractDNSToSwitchMapping.getConf() |
|
Configuration |
ScriptBasedMapping.getConf() |
|
Configuration |
SocksSocketFactory.getConf() |
|
Configuration |
TableMapping.getConf() |
| Modifier and Type | Method | Description |
|---|---|---|
static javax.net.SocketFactory |
NetUtils.getDefaultSocketFactory(Configuration conf) |
Get the default socket factory as specified by the configuration
parameter hadoop.rpc.socket.factory.default
|
static NetworkTopology |
NetworkTopology.getInstance(Configuration conf) |
Get an instance of NetworkTopology based on the value of the configuration
parameter net.topology.impl.
|
static NetworkTopology |
NetworkTopology.getInstance(Configuration conf,
InnerNode.Factory factory) |
|
static javax.net.SocketFactory |
NetUtils.getSocketFactory(Configuration conf,
java.lang.Class<?> clazz) |
Get the socket factory for the given class according to its
configuration parameter
hadoop.rpc.socket.factory.class.<ClassName>.
|
static javax.net.SocketFactory |
NetUtils.getSocketFactoryFromProperty(Configuration conf,
java.lang.String propValue) |
Get the socket factory corresponding to the given proxy URI.
|
static DomainNameResolver |
DomainNameResolverFactory.newInstance(Configuration conf,
java.lang.String configKey) |
This function gets the instance based on the config.
|
static DomainNameResolver |
DomainNameResolverFactory.newInstance(Configuration conf,
java.lang.String host,
java.lang.String configKey) |
|
static DomainNameResolver |
DomainNameResolverFactory.newInstance(Configuration conf,
java.net.URI uri,
java.lang.String configKey) |
Create a domain name resolver to convert the domain name in the config to
the actual IP addresses of the Namenode/Router/RM.
|
void |
AbstractDNSToSwitchMapping.setConf(Configuration conf) |
|
void |
ScriptBasedMapping.RawScriptBasedMapping.setConf(Configuration conf) |
Set the configuration and extract the configuration parameters of interest
|
void |
ScriptBasedMapping.setConf(Configuration conf) |
Set the configuration to be used by this object.
|
void |
ScriptBasedMappingWithDependency.setConf(Configuration conf) |
Set the configuration to be used by this object.
|
void |
SocksSocketFactory.setConf(Configuration conf) |
|
void |
TableMapping.setConf(Configuration conf) |
| Constructor | Description |
|---|---|
AbstractDNSToSwitchMapping(Configuration conf) |
Create an instance, caching the configuration file.
|
ScriptBasedMapping(Configuration conf) |
Create an instance from the given configuration
|
| Modifier and Type | Method | Description |
|---|---|---|
static Configuration |
ProviderUtils.excludeIncompatibleCredentialProviders(Configuration config,
java.lang.Class<? extends FileSystem> fileSystemClass) |
There are certain integrations of the credential provider API in
which a recursive dependency between the provider and the hadoop
filesystem abstraction causes a problem.
|
Configuration |
CompositeGroupsMapping.getConf() |
|
Configuration |
LdapGroupsMapping.getConf() |
|
Configuration |
SaslPropertiesResolver.getConf() |
| Modifier and Type | Method | Description |
|---|---|---|
static Configuration |
ProviderUtils.excludeIncompatibleCredentialProviders(Configuration config,
java.lang.Class<? extends FileSystem> fileSystemClass) |
There are certain integrations of the credential provider API in
which a recursive dependency between the provider and the hadoop
filesystem abstraction causes a problem.
|
static int |
KDiag.exec(Configuration conf,
java.lang.String... argv) |
Inner entry point, with no logging or system exits.
|
static UserGroupInformation.AuthenticationMethod |
SecurityUtil.getAuthenticationMethod(Configuration conf) |
|
static java.lang.String |
SecurityUtil.getClientPrincipal(java.lang.Class<?> protocol,
Configuration conf) |
Look up the client principal for a given protocol.
|
static java.lang.Class<? extends java.security.Principal> |
SecurityUtil.getCustomAuthPrincipal(Configuration conf) |
|
static java.lang.Class<? extends RpcAuthMethod> |
SecurityUtil.getCustomRpcAuthMethod(Configuration conf) |
|
static java.util.Map<java.lang.String,java.lang.String> |
AuthenticationFilterInitializer.getFilterConfigMap(Configuration conf,
java.lang.String prefix) |
|
protected static java.util.Map<java.lang.String,java.lang.String> |
HttpCrossOriginFilterInitializer.getFilterParameters(Configuration conf,
java.lang.String prefix) |
|
static SaslPropertiesResolver |
SaslPropertiesResolver.getInstance(Configuration conf) |
Returns an instance of SaslPropertiesResolver.
|
KerberosInfo |
AnnotatedSecurityInfo.getKerberosInfo(java.lang.Class<?> protocol,
Configuration conf) |
|
abstract KerberosInfo |
SecurityInfo.getKerberosInfo(java.lang.Class<?> protocol,
Configuration conf) |
Get the KerberosInfo for a given protocol.
|
static KerberosInfo |
SecurityUtil.getKerberosInfo(java.lang.Class<?> protocol,
Configuration conf) |
Look up the KerberosInfo for a given protocol.
|
TokenInfo |
AnnotatedSecurityInfo.getTokenInfo(java.lang.Class<?> protocol,
Configuration conf) |
|
abstract TokenInfo |
SecurityInfo.getTokenInfo(java.lang.Class<?> protocol,
Configuration conf) |
Get the TokenInfo for a given protocol.
|
static TokenInfo |
SecurityUtil.getTokenInfo(java.lang.Class<?> protocol,
Configuration conf) |
Look up the TokenInfo for a given protocol.
|
static Groups |
Groups.getUserToGroupsMappingService(Configuration conf) |
Get the groups being used to map user-to-groups.
|
static Groups |
Groups.getUserToGroupsMappingServiceWithLoadedConfiguration(Configuration conf) |
Create new groups used to map user-to-groups with loaded configuration.
|
static java.util.List<ZKUtil.ZKAuthInfo> |
SecurityUtil.getZKAuthInfos(Configuration conf,
java.lang.String configKey) |
Utility method to fetch ZK auth info from the configuration.
|
static void |
SaslRpcServer.init(Configuration conf) |
|
void |
AuthenticationFilterInitializer.initFilter(FilterContainer container,
Configuration conf) |
Initializes hadoop-auth AuthenticationFilter.
|
void |
HttpCrossOriginFilterInitializer.initFilter(FilterContainer container,
Configuration conf) |
|
protected boolean |
KDiag.isSimpleAuthentication(Configuration conf) |
Is the authentication method of this configuration "simple"?
|
static void |
SecurityUtil.login(Configuration conf,
java.lang.String keytabFileKey,
java.lang.String userNameKey) |
Login as a principal specified in config.
|
static void |
SecurityUtil.login(Configuration conf,
java.lang.String keytabFileKey,
java.lang.String userNameKey,
java.lang.String hostname) |
Login as a principal specified in config.
|
static Credentials |
Credentials.readTokenStorageFile(java.io.File filename,
Configuration conf) |
Convenience method for reading a token storage file and loading its Tokens.
|
static Credentials |
Credentials.readTokenStorageFile(Path filename,
Configuration conf) |
Convenience method for reading a token storage file and loading its Tokens.
|
static void |
SecurityUtil.setAuthenticationMethod(UserGroupInformation.AuthenticationMethod authenticationMethod,
Configuration conf) |
|
void |
CompositeGroupsMapping.setConf(Configuration conf) |
|
void |
IngressPortBasedResolver.setConf(Configuration conf) |
|
void |
LdapGroupsMapping.setConf(Configuration conf) |
|
void |
RuleBasedLdapGroupsMapping.setConf(Configuration conf) |
|
void |
SaslPropertiesResolver.setConf(Configuration conf) |
|
void |
ShellBasedUnixGroupsMapping.setConf(Configuration conf) |
|
void |
WhitelistBasedResolver.setConf(Configuration conf) |
|
static void |
HadoopKerberosName.setConfiguration(Configuration conf) |
Set the static configuration to get and evaluate the rules.
|
static void |
SecurityUtil.setConfiguration(Configuration conf) |
|
static void |
UserGroupInformation.setConfiguration(Configuration conf) |
Set the static configuration for UGI.
|
void |
Credentials.writeTokenStorageFile(Path filename,
Configuration conf) |
|
void |
Credentials.writeTokenStorageFile(Path filename,
Configuration conf,
Credentials.SerializedFormat format) |
| Constructor | Description |
|---|---|
Groups(Configuration conf) |
|
Groups(Configuration conf,
Timer timer) |
|
KDiag(Configuration conf,
java.io.PrintWriter out,
java.io.File keytab,
java.lang.String principal,
long minKeyLength,
boolean securityRequired) |
|
SaslRpcClient(UserGroupInformation ugi,
java.lang.Class<?> protocol,
java.net.InetSocketAddress serverAddr,
Configuration conf) |
Create a SaslRpcClient that can be used by a RPC client to negotiate
SASL authentication with a RPC server
|
ShellBasedIdMapping(Configuration conf) |
|
ShellBasedIdMapping(Configuration conf,
boolean constructFullMapAtInit) |
|
TruststoreKeystore(Configuration conf) |
Configuration for the ZooKeeper connection when SSL/TLS is enabled.
|
| Modifier and Type | Method | Description |
|---|---|---|
protected Configuration |
AbstractJavaKeyStoreProvider.getConf() |
| Modifier and Type | Method | Description |
|---|---|---|
CredentialProvider |
BouncyCastleFipsKeyStoreProvider.Factory.createProvider(java.net.URI providerName,
Configuration conf) |
|
abstract CredentialProvider |
CredentialProviderFactory.createProvider(java.net.URI providerName,
Configuration conf) |
|
CredentialProvider |
JavaKeyStoreProvider.Factory.createProvider(java.net.URI providerName,
Configuration conf) |
|
CredentialProvider |
LocalBouncyCastleFipsKeyStoreProvider.Factory.createProvider(java.net.URI providerName,
Configuration conf) |
|
CredentialProvider |
LocalJavaKeyStoreProvider.Factory.createProvider(java.net.URI providerName,
Configuration conf) |
|
CredentialProvider |
UserProvider.Factory.createProvider(java.net.URI providerName,
Configuration conf) |
|
static java.util.List<CredentialProvider> |
CredentialProviderFactory.getProviders(Configuration conf) |
| Constructor | Description |
|---|---|
AbstractJavaKeyStoreProvider(java.net.URI uri,
Configuration conf) |
|
KeyStoreProvider(java.net.URI uri,
Configuration conf) |
|
LocalKeyStoreProvider(java.net.URI uri,
Configuration conf) |
| Modifier and Type | Method | Description |
|---|---|---|
protected Configuration |
ProxyUserAuthenticationFilter.getProxyuserConfiguration(javax.servlet.FilterConfig filterConfig) |
| Modifier and Type | Method | Description |
|---|---|---|
protected java.util.Map<java.lang.String,java.lang.String> |
ProxyUserAuthenticationFilterInitializer.createFilterConfig(Configuration conf) |
|
void |
ProxyUserAuthenticationFilterInitializer.initFilter(FilterContainer container,
Configuration conf) |
| Modifier and Type | Method | Description |
|---|---|---|
Configuration |
DefaultImpersonationProvider.getConf() |
| Modifier and Type | Method | Description |
|---|---|---|
static void |
ProxyUsers.authorize(UserGroupInformation user,
java.lang.String remoteAddress,
Configuration conf) |
Deprecated.
use
ProxyUsers.authorize(UserGroupInformation, String) instead. |
void |
ServiceAuthorizationManager.authorize(UserGroupInformation user,
java.lang.Class<?> protocol,
Configuration conf,
java.net.InetAddress addr) |
Authorize the user to access the protocol being used.
|
static void |
ProxyServers.refresh(Configuration conf) |
|
void |
ServiceAuthorizationManager.refresh(Configuration conf,
PolicyProvider provider) |
|
static void |
ProxyUsers.refreshSuperUserGroupsConfiguration(Configuration conf) |
Refreshes configuration using the default Proxy user prefix for properties.
|
static void |
ProxyUsers.refreshSuperUserGroupsConfiguration(Configuration conf,
java.lang.String proxyUserPrefix) |
Refreshes configuration using the specified Proxy user prefix for
properties.
|
void |
ServiceAuthorizationManager.refreshWithLoadedConfiguration(Configuration conf,
PolicyProvider provider) |
|
void |
DefaultImpersonationProvider.setConf(Configuration conf) |
| Constructor | Description |
|---|---|
UsersACLsManager(Configuration conf) |
| Modifier and Type | Method | Description |
|---|---|---|
static java.util.Map<java.lang.String,java.lang.String> |
RestCsrfPreventionFilter.getFilterParams(Configuration conf,
java.lang.String confPrefix) |
Constructs a mapping of configuration properties to be used for filter
initialization.
|
static java.util.Map<java.lang.String,java.lang.String> |
XFrameOptionsFilter.getFilterParams(Configuration conf,
java.lang.String confPrefix) |
Constructs a mapping of configuration properties to be used for filter
initialization.
|
| Modifier and Type | Method | Description |
|---|---|---|
Configuration |
FileBasedKeyStoresFactory.getConf() |
Returns the configuration of the factory.
|
static Configuration |
SSLFactory.readSSLConfiguration(Configuration conf,
SSLFactory.Mode mode) |
| Modifier and Type | Method | Description |
|---|---|---|
static Configuration |
SSLFactory.readSSLConfiguration(Configuration conf,
SSLFactory.Mode mode) |
|
void |
FileBasedKeyStoresFactory.setConf(Configuration conf) |
Sets the configuration for the factory.
|
| Constructor | Description |
|---|---|
SSLFactory(SSLFactory.Mode mode,
Configuration conf) |
Creates an SSLFactory.
|
| Modifier and Type | Method | Description |
|---|---|---|
Token<?> |
DtFetcher.addDelegationTokens(Configuration conf,
Credentials creds,
java.lang.String renewer,
java.lang.String url) |
Add any number of delegation tokens to Credentials object and return
a token instance that is appropriate for aliasing, or null if none.
|
static void |
DtFileOperations.aliasTokenFile(java.io.File tokenFile,
java.lang.String fileFormat,
Text alias,
Text service,
Configuration conf) |
Alias a token from a file and save back to file in the local filesystem.
|
static void |
DtFileOperations.appendTokenFiles(java.util.ArrayList<java.io.File> tokenFiles,
java.lang.String fileFormat,
Configuration conf) |
Append tokens from list of files in local filesystem, saving to last file.
|
void |
Token.cancel(Configuration conf) |
Cancel this delegation token.
|
void |
Token.TrivialRenewer.cancel(Token<?> token,
Configuration conf) |
|
abstract void |
TokenRenewer.cancel(Token<?> token,
Configuration conf) |
Cancel the given token.
|
static void |
DtFileOperations.doFormattedWrite(java.io.File f,
java.lang.String format,
Credentials creds,
Configuration conf) |
Write out a Credentials object as a local file.
|
static void |
DtFileOperations.getTokenFile(java.io.File tokenFile,
java.lang.String fileFormat,
Text alias,
Text service,
java.lang.String url,
java.lang.String renewer,
Configuration conf) |
Fetch a token from a service and save to file in the local filesystem.
|
static void |
DtFileOperations.importTokenFile(java.io.File tokenFile,
java.lang.String fileFormat,
Text alias,
java.lang.String base64,
Configuration conf) |
Import a token from a base64 encoding into the local filesystem.
|
static void |
DtFileOperations.printTokenFile(java.io.File tokenFile,
Text alias,
Configuration conf,
java.io.PrintStream out) |
Print out a Credentials file from the local filesystem.
|
static void |
DtFileOperations.removeTokenFromFile(boolean cancel,
java.io.File tokenFile,
java.lang.String fileFormat,
Text alias,
Configuration conf) |
Remove a token from a file in the local filesystem, matching alias.
|
long |
Token.renew(Configuration conf) |
Renew this delegation token.
|
long |
Token.TrivialRenewer.renew(Token<?> token,
Configuration conf) |
|
abstract long |
TokenRenewer.renew(Token<?> token,
Configuration conf) |
Renew the given token.
|
static void |
DtFileOperations.renewTokenFile(java.io.File tokenFile,
java.lang.String fileFormat,
Text alias,
Configuration conf) |
Renew a token from a file in the local filesystem, matching alias.
|
static void |
SecretManager.update(Configuration conf) |
Updates the selected cryptographic algorithm and key length using the provided
Hadoop
Configuration. |
| Constructor | Description |
|---|---|
SQLDelegationTokenSecretManager(Configuration conf) |
|
ZKDelegationTokenSecretManager(Configuration conf) |
| Modifier and Type | Method | Description |
|---|---|---|
protected Configuration |
DelegationTokenAuthenticationFilter.getProxyuserConfiguration(javax.servlet.FilterConfig filterConfig) |
Returns the proxyuser configuration.
|
| Constructor | Description |
|---|---|
DelegationTokenManager(Configuration conf,
Text tokenKind) |
| Modifier and Type | Method | Description |
|---|---|---|
Configuration |
AbstractService.getConfig() |
|
Configuration |
Service.getConfig() |
Get the configuration of this service.
|
| Modifier and Type | Method | Description |
|---|---|---|
void |
AbstractService.init(Configuration conf) |
Initialize the service.
|
void |
Service.init(Configuration config) |
Initialize the service.
|
protected void |
AbstractService.serviceInit(Configuration conf) |
All initialization code needed by a service.
|
protected void |
CompositeService.serviceInit(Configuration conf) |
|
protected void |
AbstractService.setConfig(Configuration conf) |
Set the configuration for this service.
|
| Modifier and Type | Method | Description |
|---|---|---|
Configuration |
AbstractLaunchableService.bindArgs(Configuration config,
java.util.List<java.lang.String> args) |
Propagate the command line arguments.
|
Configuration |
LaunchableService.bindArgs(Configuration config,
java.util.List<java.lang.String> args) |
Propagate the command line arguments.
|
protected Configuration |
ServiceLauncher.createConfiguration() |
Override point: create the base configuration for the service.
|
Configuration |
ServiceLauncher.getConfiguration() |
Get the configuration constructed from the command line arguments.
|
| Modifier and Type | Method | Description |
|---|---|---|
Configuration |
AbstractLaunchableService.bindArgs(Configuration config,
java.util.List<java.lang.String> args) |
Propagate the command line arguments.
|
Configuration |
LaunchableService.bindArgs(Configuration config,
java.util.List<java.lang.String> args) |
Propagate the command line arguments.
|
protected int |
ServiceLauncher.coreServiceLaunch(Configuration conf,
S instance,
java.util.List<java.lang.String> processedArgs,
boolean addShutdownHook,
boolean execute) |
Launch the service.
|
protected GenericOptionsParser |
ServiceLauncher.createGenericOptionsParser(Configuration conf,
java.lang.String[] argArray) |
Override point: create a generic options parser or subclass thereof.
|
java.util.List<java.lang.String> |
ServiceLauncher.extractCommandOptions(Configuration conf,
java.util.List<java.lang.String> args) |
Extract the command options and apply them to the configuration,
building an array of processed arguments to hand down to the service.
|
Service |
ServiceLauncher.instantiateService(Configuration conf) |
|
ExitUtil.ExitException |
ServiceLauncher.launchService(Configuration conf,
java.util.List<java.lang.String> processedArgs,
boolean addShutdownHook,
boolean execute) |
Launch a service catching all exceptions and downgrading them to exit codes
after logging.
|
ExitUtil.ExitException |
ServiceLauncher.launchService(Configuration conf,
S instance,
java.util.List<java.lang.String> processedArgs,
boolean addShutdownHook,
boolean execute) |
Launch a service catching all exceptions and downgrading them to exit codes
after logging.
|
protected java.util.List<java.lang.String> |
ServiceLauncher.parseCommandArgs(Configuration conf,
java.util.List<java.lang.String> args) |
Parse the command arguments, extracting the service class as the last
element of the list (after extracting all the rest).
|
| Constructor | Description |
|---|---|
MinimalGenericOptionsParser(Configuration conf,
org.apache.commons.cli.Options options,
java.lang.String[] args) |
| Modifier and Type | Method | Description |
|---|---|---|
protected abstract java.net.InetSocketAddress |
GetGroupsBase.getProtocolAddress(Configuration conf) |
Must be overridden by subclasses to get the address where the
GetUserMappingsProtocol implementation is running. |
| Constructor | Description |
|---|---|
GetGroupsBase(Configuration conf) |
Create an instance of this tool using the given configuration.
|
GetGroupsBase(Configuration conf,
java.io.PrintStream out) |
Used exclusively for testing.
|
| Modifier and Type | Method | Description |
|---|---|---|
Configuration |
GenericOptionsParser.getConfiguration() |
Get the modified configuration
|
| Modifier and Type | Method | Description |
|---|---|---|
static <T> T |
ReflectionUtils.copy(Configuration conf,
T src,
T dst) |
Make a copy of the writable object using serialization to a buffer.
|
static KeyProvider |
KMSUtil.createKeyProvider(Configuration conf,
java.lang.String configKeyName) |
Creates a new KeyProvider from the given Configuration
and configuration key name.
|
static KeyProvider |
KMSUtil.createKeyProviderFromUri(Configuration conf,
java.net.URI providerUri) |
|
static java.net.URI |
KMSUtil.getKeyProviderUri(Configuration conf) |
|
static java.net.URI |
KMSUtil.getKeyProviderUri(Configuration conf,
java.lang.String configKeyName) |
|
static java.net.URL[] |
GenericOptionsParser.getLibJars(Configuration conf) |
If libjars are set in the conf, parse the libjars.
|
static <T> T |
ReflectionUtils.newInstance(java.lang.Class<T> theClass,
Configuration conf) |
Create an object for the given class and initialize it from conf
|
static <T> T |
ReflectionUtils.newInstance(java.lang.Class<T> theClass,
Configuration conf,
java.lang.Class<?>[] argTypes,
java.lang.Object... values) |
Create an object for the given class and initialize it from conf
|
static int |
ToolRunner.run(Configuration conf,
Tool tool,
java.lang.String[] args) |
Runs the given
Tool by Tool.run(String[]), after
parsing with the given generic arguments. |
protected void |
JvmPauseMonitor.serviceInit(Configuration conf) |
|
static void |
ReflectionUtils.setConf(java.lang.Object theObject,
Configuration conf) |
Check and set 'configuration' if necessary.
|
| Constructor | Description |
|---|---|
FindClass(Configuration conf) |
Create a class with a specified configuration
|
GenericOptionsParser(Configuration conf,
java.lang.String[] args) |
Create a
GenericOptionsParser to parse only the generic
Hadoop arguments. |
GenericOptionsParser(Configuration conf,
org.apache.commons.cli.Options options,
java.lang.String[] args) |
Create a
GenericOptionsParser to parse given options as well
as generic Hadoop options. |
LineReader(java.io.InputStream in,
Configuration conf) |
Create a line reader that reads from the given stream using the
io.file.buffer.size specified in the given
Configuration. |
LineReader(java.io.InputStream in,
Configuration conf,
byte[] recordDelimiterBytes) |
Create a line reader that reads from the given stream using the
io.file.buffer.size specified in the given
Configuration, and using a custom delimiter of array of
bytes. |
| Modifier and Type | Method | Description |
|---|---|---|
static java.util.List<org.apache.zookeeper.data.ACL> |
ZKCuratorManager.getZKAcls(Configuration conf) |
Utility method to fetch the ZK ACLs from the configuration.
|
static java.util.List<ZKUtil.ZKAuthInfo> |
ZKCuratorManager.getZKAuths(Configuration conf) |
Utility method to fetch ZK auth info from the configuration.
|
| Constructor | Description |
|---|---|
ZKCuratorManager(Configuration config) |
| Modifier and Type | Method | Description |
|---|---|---|
static void |
FutureIO.propagateOptions(FSBuilder<?,?> builder,
Configuration conf,
java.lang.String prefix,
boolean mandatory) |
Propagate options to any builder, converting everything with the
prefix to an option where, if there were 2+ dot-separated elements,
it is converted to a schema.
|
static <T,U extends FSBuilder<T,U>> |
FutureIO.propagateOptions(FSBuilder<T,U> builder,
Configuration conf,
java.lang.String optionalPrefix,
java.lang.String mandatoryPrefix) |
Propagate options to any builder, converting everything with the
prefix to an option where, if there were 2+ dot-separated elements,
it is converted to a schema.
|
| Modifier and Type | Method | Description |
|---|---|---|
static int |
Hash.getHashType(Configuration conf) |
This utility method converts the name of the configured
hash type to a symbolic constant.
|
static Hash |
Hash.getInstance(Configuration conf) |
Get a singleton instance of hash function of a type
defined in the configuration.
|
Copyright © 2008–2025 Apache Software Foundation. All rights reserved.