All Classes

Interface for the result of aborts; allows subclasses to extend (IOStatistics etc) or for future enhancements if ever needed.

Look through tokens to find the first delegation token that matches the service and return it.

This class provides an interface for implementors of a Hadoop file system (analogous to the VFS of Unix).

This the base class for Ganglia sink classes using metrics2.

ganglia slope values which equal the ordinal

Abstract class for implementing credential providers that are based on Java Keystores as the underlying credential store.

An abstract base class which represents top-level API for MapR-FS implementation of Hadoop FileSystem.

The immutable metric

Base class for pattern based filters

An exception class for access control related issues.

Defines a single entry in an ACL.

Specifies the scope or intended usage of an ACL entry.

An AclStatus contains the ACL information of a specific file.

AclUtil contains utility methods for manipulating ACLs.

Exception thrown when there is no active leader

Interface to get the active thread span.

This interface intends to align the state between client and server via RPC communication.

Constructs SecurityInfo from Annotations provided in protocol interface.

A dense file-based mapping from integers to values.

Write a new array file.

A Writable for arrays containing instances of a class.

Signals that an AsyncCallLimitExceededException has occurred.

This interface defines an asynchronous AsyncGet.get(long, TimeUnit) method.

A Future implemented using an AsyncGet object.

Constants related to auditing.

Static methods to assist in working with Audit Spans.

A source of audit spans.

Initializes hadoop-auth AuthenticationFilter which provides support for Kerberos HTTP SPNEGO authentication.

This is a wrap class of a ReentrantLock.

Tag interface for Avro 'reflect' serializable classes.

Base class for providing serialization to Avro types.

Holds reference to an object to be attached to a stream or store to avoid the reference being lost to GC.

Abstract expression for use in the Find command.

BasicDiskValidator is a wrapper around DiskChecker.

Interface filesystems MAY implement to offer a batched list.

Byte array backed upload handle.

Interface supported by WritableComparable types supporting ordering/permutation by a representative set of bytes.

Provides functionality necessary for caching blocks of data read from FileSystem.

Holds information about blocks of data in a file.

As part of a codec, to handle how to form a block group for encoding and provide instructions on how to recover erased blocks from a block group

Represents the network location of a block, information about the hosts that contain block replicas, and other block metadata (E.g.

This class is used to provide parameters to BlockManager.

This class extends MapFile and provides very much the same functionality.

A Comparator optimized for BooleanWritable.

The factory to create JksProviders, which is used by the ServiceLoader.

A byte array backed output stream with a limit.

Manages a fixed pool of resources.

An extension of BufferedInputStream which implements IOStatisticsSource and forwards requests for the IOStatistics to the wrapped stream.

Manages a fixed pool of ByteBuffer instances.

A Decompressor based on the popular gzip compressed file format.

A wrapper around java.util.zip.Deflater to make it conform to org.apache.hadoop.io.compress.Compressor interface.

API for bulk deletion of objects/files, but not directories.

Utility class for bulk delete operations.

Provide an input stream from a byte buffer; supporting ByteBufferInputStream.mark(int).

Implementers of this interface provide a positioned read API that writes to a ByteBuffer rather than a byte[].

A Comparator optimized for BytesWritable.

A Comparator optimized for ByteWritable.

A Compressor based on the popular bzip2 compression algorithm.

A Decompressor based on the popular bzip2 compression algorithm.

This is a dummy decompressor for BZip2.

CacheableIPList loads a list of subnets from a file.

Provides read access to the underlying file one block at a time.

A KeyProviderExtension implementation providing a short lived cache for KeyVersions and Metadatato avoid burst of requests to hit the underlying KeyProvider.

A class defining the caller context for auditing coarse granularity operations.

Abstracts queue operations for different blocking queues.

An input stream that decompresses from the BZip2 format (without the file header chars) to be read as any other stream.

An output stream that compresses into the BZip2 format (without the file header chars) into another stream.

Abstract Checksumed FileSystem.

Parse a permission mode passed in from a chmod command and apply that mode against an existing file.

Used between client and server to negotiate the cipher suite, key and iv.

Command-line utility for getting the full classpath needed to launch a Hadoop client application.

sun.misc.Cleaner has moved in OpenJDK 9 and sun.misc.Unsafe#invokeCleaner(ByteBuffer) is the replacement.

A client for an IPC service.

Manages the input and output streams for an IPC connection.

A class defining a set of static helper methods to provide conversion between bytes and string for UUID-based client Id.

A closeable object that maintains a reference count.

Exception to denote if the underlying stream, cache or other closable resource is closed.

Codec related constants.

This class registers all coder implementations.

Helpful utilities for implementing some raw erasure coders.

Util class to stores ips/hosts/subnets.

An abstract class for the execution of a file system command

Parse the args of a command and check the format of args.

Used when the arguments exceed their bounds

Used when too many arguments are supplied to a command

This program is a CLI utility base class utilizing hadoop Tool class.

A bridge from Callable to Supplier; catching exceptions raised by the callable and wrapping them as appropriate.

This class contains constants for configuration keys used in the common code.

Generic implementation of version comparison.

An implementation of GroupMappingServiceProvider which composites other group mapping providers for determining group membership.

JVM Shutdown hook for CompositeService which will stop the give CompositeService gracefully in case of JVM shutdown.

Compression related stuff.

This class encapsulates a streaming compression/decompression pair.

A factory that will find the correct codec for a given filename.

A compression output stream.

Tool for redacting sensitive information when displaying config parameters.

Provides access to configuration parameters.

A class that represents a set of positive integer ranges.

Logs access to Configuration.

Utilities for config variables of the viewFs See ViewFs

Thrown by NetUtils.connect(java.net.Socket, java.net.SocketAddress, int) if it times out while connecting to the remote host.

Version of java.util.function.Consumer which raises exceptions.

We don't use generics.

Abstract command to enable sub copy commands run with multi-thread.

Used by DecayRpcScheduler to get the cost of users' operations.

Implements a counting Bloom filter, as defined by Fan et al.

Encapsulates logic for composing multiple CRCs into one or more combined CRCs corresponding to concatenated underlying data ranges.

CreateFlag specifies the file create semantic.

The combination of both the alias and the actual credential value.

A class that provides the facilities of reading and writing secret keys and Tokens.

This program is the CLI utility for the CredentialProvider facilities in Hadoop.

CryptoInputStream decrypts data.

Versions of the client/server protocol used for HDFS encryption.

A thread that has called Thread.setDaemon(boolean) with true.

A class to provide disk, byteBuffer and byteArray option for Filesystem OutputStreams.

The output information for an upload.

The checksum types

OutputStream implementation that wraps a DataOutput.

This TimerTask will call decayCurrentCosts until the scheduler has been garbage collected.

This class is for maintaining queue (priority) level related statistics when FairCallQueue is used and publishing them through the metrics interface.

A utility class to validate decoding.

Default implementation of the BulkDelete interface.

Ignores process details and returns a constant value for each call.

The default metrics system singleton.

DefaultStringifier is the default implementation of the Stringifier interface which stringifies the objects using base64 encoding of the serialized version of the objects.

Implementation of AbstractFileSystem based on the existing implementation of FileSystem.

Default indicates Ordered, preferred OpenSSL, if failed to load then fall back to Default_JSSE.

The DelegationTokenAuthenticatedURL is a AuthenticatedURL sub-class with built-in Hadoop Delegation Token functionality.

The DelegationTokenAuthenticationFilter filter is a AuthenticationFilter with Hadoop Delegation Token support.

Authenticator wrapper that enhances an Authenticator with Delegation Token support.

Concrete delegation token identifier used by DelegationTokenManager, KerberosDelegationTokenAuthenticationHandler and DelegationTokenAuthenticationFilter.

Cache for delegation tokens that can handle high volume of tokens.

A daemon thread that waits for the next file system to renew.

An action that will renew and replace the file system's delegation tokens automatically.

A RawComparator that uses a Deserializer to deserialize the objects to be compared so that the standard Comparator can be used to compare them.

Fast but inaccurate class to tell how much space HDFS is using.

CallbackHandler for SASL DIGEST-MD5 mechanism

This class encapsulates a codec which can decompress direct bytebuffers.

Thrown when the startAfter can't be found when listing a directory.

A interface for disk validators.

A class that provides direct and reverse lookup functionalities, allowing the querying of specific network interfaces or nameservers.

An interface that must be implemented to allow pluggable DNS-name/IP-address to RackID resolvers.

This interface provides methods for the failover proxy to get IP addresses of the associated servers (NameNodes, RBF routers etc).

The implementation of UNIX domain sockets in Java.

Writable for Double values.

DtFetcher is an interface which permits the abstraction and separation of delegation token fetch implementaions across different packages and compilation units.

DtUtilShell is a set of command line token file management operations.

Dummy erasure decoder does no real computation.

A dummy raw decoder that does no real computation.

A raw erasure coder factory for dummy raw coders.

A duration with logging of final state at info or debug in the close() call.

Interface to be implemented by objects which can track duration.

Implements a dynamic Bloom filter, as defined in the INFOCOM 2006 paper.

The wrapped IOStatistics methods in WrappedStatistics, dynamically loaded.

Dynamic method invocation.

Convenience wrapper class around Method.

A group of blocks or ECBlock incurred in an erasure coding task.

Erasure coding schema to housekeeper relevant information.

Abstract Erasure Codec is defines the interface of each actual erasure codec classes.

Erasure codec options.

An erasure coder to perform encoding or decoding given a group.

Erasure coding step that's involved in encoding/decoding of a block group.

Erasure decoding step, a wrapper of all the necessary information to perform a decoding step involved in the whole process of decoding a block group.

Erasure encoding step, a wrapper of all the necessary information to perform an encoding step involved in the whole process of encoding a block group.

An etag as a checksum.

Helper functions for Executors.

Get the exit code of an exception.

An exception raised when a call to ExitUtil.terminate(int) was called and system exits were blocked.

Interface describing an expression to be used in the Find command.

The FailOverController is responsible for electing an active service on startup or when the current active is changing (eg due to failure), monitoring the health of a service, and performing a fail-over when a new active service is either manually selected by a user or elected.

An implementer of this interface is capable of providing proxy objects for use in IPC communication, and potentially modifying these objects or creating entirely new ones in the event of certain types of failures.

A queue with multiple levels for each priority.

Fast thread-safe version of NumberFormat

Class for dealing with caching SASL server factories.

A fencing method is a method by which one node can forcibly prevent another node from making continued progress.

Used when target file already exists for any operation and is not configured to be overwritten.

KeyStoresFactory implementation that reads the certificates from keystore files.

The FileContext class provides an interface for users of the Hadoop file system.

Implements basic logic to track when a file changes on disk and call the action passed to the constructor when it does.

A byte range of a file.

A metrics sink that writes to a file

Flags for entity attributes.

Represents a batch of directory entries when iteratively listing a directory.

Statistics data.

A MultipartUploader that uses the basic FileSystem commands.

Common statistic names for Filesystem-level statistics, including internals.

A collection of file-processing util methods

Defines the general behavior of a filter.

Provides an abstract composition filter for the Expression interface.

A FilterFs contains some other file system, which it uses as its basic file system, possibly transforming the data along the way or providing additional functionality.

Options to be used by the Find command and its Expressions.

A WritableComparable for floats.

This may seem odd having an IOStatisticsStore which does nothing but forward to a wrapped store, but it's designed to assist in subclassing of selective methods, such as those to increment counters, get durations etc.

The base interface which various FileSystem FileContext Builder interfaces can extend, and which underlying implementations will then implement.

Base class for all "hadoop fs" commands.

A class that stores both masked and unmasked create modes and is a drop-in replacement for masked permission.

Type of file advise to be passed on to the underlying file system.

Builder for FSDataOutputStream and its subclasses.

Standard strings to use in exception messages in filesystems HDFS is used as the reference source of the strings

This is a generic input stream for verifying checksums for data before it is read by a user.

Class to allow Lambda expressions to be used in FileContext link resolution.

Used primarily by FileContext to operate on and resolve symlinks in a path.

A class for file/directory permissions.

Provide command line access to a FileSystem.

Used to change group of files

Used to change owner and/or group of files

Holds the HTrace Tracer used for FileSystem operations.

This class contains constants for configuration keys used in the ftp file system.

A FileSystem backed by an FTP client provided by Apache Commons Net.

Functional utilities for IO operations.

Builder for input streams and subclasses whose return value is actually a completable future: this allows for better asynchronous operation.

Future IO Helper methods.

Implementation of Galois field arithmetic with 2^p elements.

This code supports Ganglia 3.1

The user can provide an instance of a class implementing this interface when initializing a GcTimeMonitor to receive alerts when GC time percentage exceeds the specified threshold.

Protocol which is used to refresh arbitrary things at runtime.

A wrapper for Writable instances.

Protocol implemented by the Name Node and Job Tracker which maps users to groups.

Stores global storage statistics objects.

Implementation of FileSystem.globStatus(Path, PathFilter).

A glob pattern filter for metrics.

A metrics sink that writes to a Graphite server.

An interface for the implementation of a user-to-groups mapping service used by Groups.

A GSet is set, which supports the GSet.get(Object) operation.

This class creates gzip compressors/decompressors.

UsageInfo class holds args and help details.

Indicates that a method has been passed illegal or invalid argument.

A login module that looks at the Kerberos, Unix, or Windows principal and adds the corresponding UserName.

An extension of ThreadPoolExecutor that provides additional functionality.

Class for creating hardlinks.

This is an implementation of the Hadoop Archive Filesystem.

FSDataInputStreams implement this interface to provide enhanced byte buffer access.

An HA service may be in active or standby state.

Information describing the source for a request to change state.

Having a FileDescriptor

Implements a hash object that returns a certain number of hashed values.

An implementation for Apache Hadoop compatible file system based mount-table file loading.

This class is a daemon which runs in a loop, periodically heartbeating with an HA service.

An implementation of the core algorithm of HeapSort.

Some utilities for Hitchhiker coding.

Hitchhiker is a new erasure coding algorithm developed as a research project at UC Berkeley by Rashmi Vinayak.

Hitchhiker is a new erasure coding algorithm developed as a research project at UC Berkeley by Rashmi Vinayak.

This class is responsible for quoting HTML characters.

HTTP utility class to help propagate server side exception to the client over HTTP as a JSON payload.

Contains all the logic for generating an HTTP "Referer" entry; includes escaping query params.

RequestLog object for use with Http

Class to construct instances of HTTP server with specific options.

The X-FRAME-OPTIONS header in HTTP response to mitigate clickjacking attack.

A Filesystem that reads from HTTPS endpoint.

Used to mark certain methods of an interface as being idempotent, and therefore warrant being retried on failover.

Generic ID generator used for generating various types of number sequences.

An interface for the implementation of <userId, userName> mapping and <groupId, groupName> mapping.

Interface for collections capable of being sorted by IndexedSorter algorithms.

An implementation of SaslPropertiesResolver.

An internal class to represent a mount link.

Resolve returns ResolveResult.

This is a debugging class that can be used by callers to track whether a specific lock is being held for too long and periodically log a warning and stack trace, if so.

This is a wrap class of a ReadLock.

This is a wrap class of a WriteLock.

Helpers to create interned metrics info.

Forced shutdown runnable.

An element contained in this list.

A Comparator optimized for IntWritable.

Thrown for invalid decoding.

Thrown when the constraints enoded in a PathHandle do not hold.

This is a lambda-expression which may raises an IOException.

Interface exported by classes which support aggregation of IOStatistics.

An interface defined to capture thread-level IOStatistics by using per thread context.

A Utility class for IOStatisticsContext, which helps in creating and getting the current active context.

Setter for IOStatistics entries.

A source of IO statistics.

Builder of the IOStatisticsStore implementation.

An utility class for I/O related functionality.

IPC exception is thrown by IPC layer when the IPC connection cannot be established.

Handler of interrupts that relays them to a registered implementation of IrqHandler.Interrupted.

Callback issues on an interrupt.

KeyProvider based on Java's KeyStore file format.

The factory to create JksProviders, which is used by the ServiceLoader.

An adapter between a KeyStore Key and our Metadata.

A RawComparator that uses a JavaSerialization Deserializer to deserialize objects that are then compared via their Comparable interfaces.

Implement the SM4-CTR crypto codec using JCE provider.

Contains utility methods and constants relating to Jetty.

For example in case of MutableGauge we are using numbers, but not implementing Number interface, so we skip class check here because we can not be sure NaN values are wrapped with classes which implements the Number interface

JVM and logging related metrics.

Class which sets up a simple thread which runs in a loop sleeping for a short interval of time.

Kerberos diagnostics This operation expands some of the diagnostic output of the security code, but not all.

Thrown when UserGroupInformation failed with an unrecoverable error, such as failure in kerberos login/logout, invalid subject etc.

CallbackHandler for SASL GSSAPI Kerberos mechanism

The KerberosDelegationTokenAuthenticator provides support for Kerberos SPNEGO authentication mechanism and support for Hadoop Delegation Token operations.

The general behavior of a key that must be stored in a filter.

The combination of both the key version name and the key material.

Options when creating key objects.

CryptoExtension is a type of Extension that exposes methods to generate EncryptedKeys and to decrypt the same.

A KeyProvider extension with the ability to add a renewer's Delegation Tokens to the provided Credentials.

This is a utility class used to extend the functionality of KeyProvider, that takes a KeyProvider and an Extension.

A factory to create a list of KeyProvider based on the path given in a Configuration.

This program is the CLI utility for the KeyProvider facilities in Hadoop.

Interface that gives access to KeyManager and TrustManager implementations.

The factory to create KMSClientProvider, which is used by the ServiceLoader.

The KMS implementation of TokenRenewer.

DelegationTokenIdentifier used for the KMS.

Utils for KMS.

An interface which services can implement to have their execution managed by the ServiceLauncher.

Common Exit codes.

A subclass of LazyAtomicReference which holds an AutoCloseable reference and calls close() when it itself is closed.

An private internal socket factory used to create SSL sockets with custom configuration.

A serializable lifecycle event: the time a state transition occurred, and what state was entered.

Entries of LightWeightCache.

Elements of LightWeightGSet.

Copied from guava source code v15 (LimitedInputStream) Guava deprecated LimitInputStream in v14 and removed it in v15.

Static utility methods pertaining to List instances.

CredentialProvider based on bouncy castle FIPS KeyStore file format.

This class contains constants for configuration keys used in the local file system, raw local fs and checksum fs.

Implement the FileSystem API for the checksumed local filesystem.

Opaque handle to an entity in a FileSystem.

CredentialProvider based on Java's KeyStore file format.

CredentialProvider based on Java's KeyStore file format.

Log exactly once, even across threads.

Change log level in runtime.

This is a class to help easily throttle log statements, so that they will not be emitted more frequently than a certain rate.

A WritableComparable for longs.

A decreasing Comparator optimized for LongWritable.

This class creates lz4 compressors/decompressors.

A Decompressor based on the lz4 compression algorithm.

InetAddressFactory is used to obtain InetAddress from host.

Class to merge multiple MapFiles of same Key and Value types to one MapFile

A base class for running a maprcli unix command.

This util class provides a method to register an MBean using our standard naming convention as described in the doc for {link MBeans.register(String, String, Object).

A WritableComparator optimized for MD5Hash keys.

MD5 of MD5 of CRC32.

A mean statistic represented as the sum and the sample count; the mean is calculated on demand.

Exception - Meta Block with the same name already exists.

Annotation interface for a single metric used to annotate a field or a method in the class.

Annotation interface for a group of metrics

A pair of a name and its corresponding value.

Metrics annotation helpers.

Cached record

The metrics filter interface.

Build a JSON dump of the metrics.

An immutable snapshot of metrics with a timestamp

The metrics sink interface.

Helper class to build MetricsSource object from annotations.

Convenient abstract class for implementing callback interface

A base class for metrics system singletons

Immutable tag for metrics (for grouping on host/queue/username etc.)

A visitor interface for metrics

An interface for loading mount-table configuration.

Holder class that clients can use to return multiple exceptions.

Builder interface for Multipart readers.

Encapsulate a list of IOException into an IOException

A CompositeAuthenticationHandler that supports multiple HTTP authentication schemes along with Delegation Token functionality.

The mutable counter (monotonically increasing) metric interface

A mutable long counter

A mutable float gauge.

A mutable long gauge

The mutable metric interface

Watches a stream of long values, maintaining online estimates of specific quantiles with provably low error bounds.

Helper class to manage a group of mutable rate metrics This class synchronizes all accesses to the metrics it contains, so it should not be used in situations where there is high contention on the metrics.

This class maintains a group of rolling average metrics.

A helper to load the native hadoop code i.e.

A CacheManipulator used for testing which does not actually call mlock.

Denote memory region for a file mapped.

Keeps the support state of PMDK.

Supported list of Windows access right flags

A Reed-Solomon raw encoder using Intel ISA-L library.

A XOR raw decoder using Intel ISA-L library.

A raw coder factory for xor coder in native using Intel ISA-L library.

A base class that implements interface Node

NotInMountpointException extends the UnsupportedOperationException.

Singleton Writable with no data.

A polymorphic Writable that writes an instance with it's class name.

All the parameters from the openFile builder for the openFileWithOptions commands.

OpenSSL cipher using JNI.

Implement the SM4-CTR crypto codec using JNI into OpenSSL.

This class contains options related to file system operations.

This is used in FileSystem and FileContext to specify checksum options.

Class to support the varargs for create() options.

Option storing standard constraints on data.

The standard openFile() options.

A reusable OutputStream implementation that writes to an in-memory buffer.

Opaque, serializable reference to a part id for multipart uploads.

This is a special codec which does not transform the output.

The decompressor is a no-op.

EACCES

Exception corresponding to File Exists - EEXISTS

Opaque, serializable reference to an entity in the FileSystem.

Exceptions based on standard posix/linux style exceptions for path related errors.

ENOTDIR

Exception corresponding to path not found: ENOENT/ENOFILE

Exception corresponding to Operation Not Permitted - EPERM

Signals that expected user doesn't match real user

Stream that permits positional reading.

This class replaces guava.Preconditions which provides helpers to validate the following conditions: An invalid null obj causes a NullPointerException. An invalid argument causes an IllegalArgumentException. An invalid state causes an IllegalStateException. An invalid index causes an IndexOutOfBoundsException.

A PriorityQueue maintains a partial ordering of its elements such that the least element can always be found in constant time.

The different stages to track the time of.

Servlet to serve files generated by ProfileServlet.

Servlet that runs async-profiler as web-endpoint.

Utility to assist with generation of progress reports.

Metrics sink for prometheus exporter.

RPC Engine for for protobuf based RPCs.

The protocol name that is used when a client and server connect.

This class serves the requests for protocol versions and signatures by looking them up in the server registry.

a class wraps around a server's proxy, containing a list of its supported methods.

An interface implemented by client-side protocol translators to get the underlying proxy object the translator is operating on.

Utility methods for both key and credential provider APIs.

Filter initializer to initialize ProxyUserAuthenticationFilter which adds support to perform operations using end user instead of proxy user.

An AuthenticationHandler that implements Kerberos SPNEGO mechanism for HTTP and supports Delegation Token functionality.

A pure-java implementation of the CRC32 checksum that uses the same polynomial as the built-in native CRC32.

Specifies a quantile (with error bounds) to be watched by a SampleQuantiles object.

An implementation of the core algorithm of QuickSort.

Builder class for QuotaUsage.

Factory for Rate Limiting.

A Comparator that operates directly on byte representations of objects.

An abstract raw erasure decoder that's to be inherited by new decoders.

Implement the FileSystem API for the raw local filesystem.

Generic format of FileStatus objects.

An outstanding readahead request that has been submitted to the pool.

ReadWriteDiskValidator is the class to check a directory by to create a file, write some bytes into it, read back, and verify if they are identical.

Something whose Configuration can be changed at run time.

Exception indicating that configuration property cannot be changed at run time.

Protocol which is used to refresh the authorization policy in use currently.

Used to registry custom methods to refresh at runtime.

Return a response in the handler method for the user to see.

A regex pattern filter for metrics

An implementation of X509KeyManager that exposes a method, ReloadingX509KeystoreManager.loadFrom(Path) to reload its configuration.

A set of remote iterators supporting transformation and filtering, with IOStatisticsSource passthrough, and of conversions of the iterators to lists/arrays and of performing actions on the values.

Defines the different remove scheme for retouched Bloom filters.

Defines the minimal API requirements for the filter to execute its filtering logic.

Implements a retouched Bloom filter, as defined in the CoNEXT 2006 paper.

Maintains a cache of non-idempotent requests that have been successfully processed by the RPC server implementation, to handle the retries.

CacheEntry with payload that tracks the previous response or parts of previous response to be used for generating response for retried requests.

Provides retry related functionality.

A collection of useful implementations of RetryPolicy.

Pairs of numRetries and sleepSeconds

Returned by RetryPolicy.shouldRetry(Exception, int, int, boolean).

A factory for creating retry proxies.

This class is a metrics sink that uses FileSystem to write the metrics logs.

Class to construct instances of RPC server with specific options.

An RPC Server.

Indicates an exception in the RPC client

An RPC implementation.

This interface must be implemented by all InvocationHandler implementations.

Implement this interface to make a pluggable multiplexer in the FairCallQueue.

No such protocol (i.e.

Indicates an exception on the RPC server

adapter to allow decoding of writables and protobufs from a byte buffer.

Reed-Solomon erasure decoder that decodes a block group.

A raw erasure decoder in RS code scheme in pure Java in case native one isn't available in some environment.

A raw coder factory for the legacy raw Reed-Solomon coder in Java.

A raw erasure encoder in RS code scheme in pure Java in case native one isn't available in some environment.

Utilities for implementing Reed-Solomon code, used by RS coder.

Run a Hadoop job jar.

An identical copy from org.apache.hadoop.hdfs.protocol.HdfsConstants.SafeModeAction, that helps the other file system implementation to define SafeMode.

Helper to compute running sample stats

A SaslInputStream is composed of an InputStream and a SaslServer (or SaslClient) so that read() methods return data that are read in from the underlying InputStream but have been additionally processed by the SaslServer (or SaslClient) object.

A utility class that encapsulates SASL logic for RPC client

Authentication method

CallbackHandler for SASL DIGEST-MD5 mechanism

Interface which allows extracting information necessary to create schedulable identity strings.

Scram message salt and hash functions defined in RFC 5802.

SCRAM request/response message creation and parsing based on RFC 5802

Format: gs2-header [reserved-mext ","] username "," nonce ["," extensions] Limitations: Only gs2-header "n" is supported.

Format: [reserved-mext ","] nonce "," salt "," iteration-count ["," extensions] Limitations: Extensions are ignored.

SaslServer implementation for SASL/SCRAM.

This class implements the DNSToSwitchMapping interface using a script configured via the CommonConfigurationKeysPublic.NET_TOPOLOGY_SCRIPT_FILE_NAME_KEY option.

This class extends ScriptBasedMapping class and implements the DNSToSwitchMappingWithDependency interface using a script configured via the CommonConfigurationKeysPublic.NET_DEPENDENCY_SCRIPT_FILE_NAME_KEY option.

The token was invalid and the message explains why.

Signals that an attempt to create a file at a given pathname has failed because another file already existed at that path.

Security Utils.

Helper class to contain the Truststore/Keystore paths for the ZK client connection over SSL/TLS.

This ExecutorService blocks the submission of new tasks when its queue is already full by using a semaphore.

The compression type used to compress key/value pairs in the SequenceFile.

Reads key/value pairs from a sequence-format file.

Sorts key/value pairs in a sequence-format file.

The interface to 'raw' values of SequenceFiles.

Encapsulates a Serializer/Deserializer pair.

Provides a facility for serializing objects of type <T> to an OutputStream.

Helpers to handle server addresses

Service LifeCycle.

An authorization manager which handles service-level authorization for incoming service requests.

A class to launch any YARN service by name.

A service launch exception that includes an exit code.

Class to manage a list of ServiceStateChangeListener instances, including a notification loop that is robust against changes to the list during the notification process.

JVM Shutdown hook for Service which will stop the Service gracefully in case of JVM shutdown.

Exception that can be raised on state change operations, whose exit code can be explicitly set, determined from that of any nested cause, or a default value of LauncherExitCodes.EXIT_SERVICE_LIFECYCLE_EXCEPTION.

Provide access to an existing set file.

Static utility methods pertaining to Set instances.

Helper methods for protobuf related RPC implementation using the hadoop org.apache.hadoop.thirdparty.protobuf shaded version.

A factory for creating shared file descriptors inside a given directory.

A simple shell-based implementation of IdMappingServiceProvider Map id to user name or group name.

A simple shell-based implementation of GroupMappingServiceProvider that exec's the groups shell command to fetch the group memberships of a given user.

A WritableComparable for shorts.

The ShutdownHookManager enables running shutdownHook in a deterministic order, higher priority first.

This class logs a message whenever we're about to exit on a UNIX signal.

A simplified BufferedOutputStream with borrowed buffer, and allow users to see how much data have been buffered.

This class creates snappy compressors/decompressors.

A Decompressor based on the snappy compression algorithm.

This implements an input stream that can have a timeout while reading.

This implements an output stream that can have a timeout while writing.

A Writable SortedMap.

An InputStream covering a range of compressed data.

During decompression, data can be read off from the decompressor in two modes, namely continuous and blocked.

This fencing implementation sshes to the target node and uses fuser to kill the process listening on the service's TCP port.

Specialized SocketFactory to create sockets with a SOCKS proxy

Wrapper for the Unix stat(1) command.

Track the duration of an object.

Class that sends UDP packets to StatsD daemon.

A class that contains the numeric value and the unit of measure.

These are common statistic names.

Returns all the counters of an IOStatistics instance as StorageStatistics.

Class that maintains different forms of Storage Units.

Common statistic names for object store operations..

These are common statistic names.

Provides string interning utility methods.

The traditional binary prefixes, kilo, mega, ..., exa, which can be represented by a 64-bit integer.

This is a stub factory which always returns no-op duration trackers.

Plugin to calculate resource information on the system.

Plugin to calculate resource information on Windows systems.

Simple DNSToSwitchMapping implementation that reads a 2 column text file.

Builder for task execution.

Interface to whatever lets us submit tasks.

This class stores text using standard UTF8 encoding.

A TFile is a container of key-value pairs.

The TFile Scanner.

Utility methods for getting the time and computing intervals.

A trivial renewer for token kinds that aren't managed.

An identifier that identifies a token, may contain public information about a token, including its kind (or type).

This is the interface for plugins that handle tokens.

A tool interface that supports handling of generic command-line options.

Unix touch like commands

(Re)create zero-length file at the specified path.

This interface is used for implementing different Trash policies.

Truncates a file to a new size

A Writable for 2D arrays containing a matrix of instances of a class.

A StorageStatistics instance which combines the outputs of several other StorageStatistics instances.

Thrown when a symbolic link is encountered in a path.

File system for a given file system name/scheme is not supported

Opaque, serializable reference to an uploadId for multipart uploads.

User and group information for Hadoop.

The UserIdentityProvider creates uses the username as the identity.

A CredentialProvider for UGIs.

A WritableComparator optimized for UTF8 keys.

Supporting Utility classes used by TFile, and shared by users of TFile.

A superset of Validate class in Apache commons lang3.

QueueRefiller interface a client must implement to use this class

Utility class which implements helper methods used in vectored IO implementation.

A base class for Writables that provides version checking.

Thrown by VersionedWritable.readFields(DataInput) when the version of an object being read does not match the current implementation version as returned by VersionedWritable.getVersion().

ViewFileSystem (extends the FileSystem interface) implements a client-side mount table.

This class is extended from the ViewFileSystem for the overloaded scheme file system.

Utility APIs for ViewFileSystem.

A WritableComparable for longs in a variable-length format.

Buffer pool implementation which uses weak references to store buffers in the pool, such that they are garbage collected when there are no references to the buffer during a gc run.

A WeakReferenceMap for threads.

Hadoop DefaultServlet for serving static web content.

A CostProvider that calculates the cost for an operation as a weighted sum of its processing time values (see ProcessingDetails).

Class to tell the size of a path on windows.

Reflection-friendly access to IOStatistics APIs.

A Writable which is also Comparable.

Factories for non-public writables.

Utility to permit renaming of Writable implementation classes without invalidiating files that contain their class name.

General xml utilities.

Xor erasure decoder that decodes a block group.

A raw decoder in XOR code scheme in pure Java, adapted from HDFS-RAID.

A raw coder factory for raw XOR coder.

Helper class that provides utility methods specific to ZK operations.

An implementation of AbstractDelegationTokenSecretManager that persists TokenIdentifiers and DelegationKeys in Zookeeper.

Protocol exposed by the ZKFailoverController, allowing for graceful failover.

Utilities for working with ZooKeeper.

A Compressor based on the popular zlib compression algorithm.

The compression level for zlib library.

A Decompressor based on the popular zlib compression algorithm.

This class creates zstd compressors/decompressors.

A Decompressor based on the zStandard compression algorithm.