| Class | Description |
|---|---|
| Abfs |
Azure Blob File System implementation of AbstractFileSystem.
|
| AbfsAclHelper |
AbfsAclHelper provides convenience methods to implement modifyAclEntries / removeAclEntries / removeAcl / removeDefaultAcl
from setAcl and getAcl.
|
| AbfsAHCHttpOperation |
Implementation of
AbfsHttpOperation for orchestrating server calls using
Apache Http Client. |
| AbfsApacheHttpExpect100Exception |
Exception that marks expect100 handshake error.
|
| AbfsClient |
AbfsClient.
|
| AbfsClientContext |
Class to hold extra configurations for AbfsClient and further classes
inside AbfsClient.
|
| AbfsClientContextBuilder |
A builder for AbfsClientContext class with different options to select and
build from.
|
| AbfsClientRenameResult |
A class to store the Result of an AbfsClient rename operation, signifying the
AbfsRestOperation result and the rename recovery.
|
| AbfsClientThrottlingIntercept |
Throttles Azure Blob File System read and write operations to achieve maximum
throughput by minimizing errors.
|
| AbfsConfiguration |
Configuration for Azure Blob FileSystem.
|
| AbfsCounters |
An interface for Abfs counters.
|
| AbfsCountersImpl |
Instrumentation of Abfs counters.
|
| AbfsDelegationTokenIdentifier |
Delegation token Identifier for ABFS delegation tokens.
|
| AbfsDelegationTokenManager |
Class for delegation token Manager.
|
| AbfsDriverException |
Exception to be thrown if any Runtime Exception occurs.
|
| AbfsDtFetcher |
A DT fetcher for Abfs.
|
| AbfsErrors |
ABFS error constants.
|
| AbfsHttpClientConnectionFactory |
Custom implementation of
ManagedHttpClientConnectionFactory and overrides
ManagedHttpClientConnectionFactory.create(HttpRoute, ConnectionConfig) to return
AbfsManagedApacheHttpConnection. |
| AbfsHttpConstants |
Responsible to keep all constant keys used in abfs rest client here.
|
| AbfsHttpConstants.ApiVersion |
Specifies the version of the REST protocol used for processing the request.
|
| AbfsHttpHeader |
The Http Request / Response Headers for Rest AbfsClient.
|
| AbfsHttpOperation |
Base Http operation class for orchestrating server IO calls.
|
| AbfsHttpOperation.AbfsHttpOperationWithFixedResult | |
| AbfsInputStream |
The AbfsInputStream for AbfsClient.
|
| AbfsInputStreamContext |
Class to hold extra input stream configs.
|
| AbfsInputStreamStatistics |
Interface for statistics for the AbfsInputStream.
|
| AbfsInputStreamStatisticsImpl |
Stats for the AbfsInputStream.
|
| AbfsInvalidChecksumException |
Exception to wrap invalid checksum verification on client side.
|
| AbfsIoUtils |
Utility classes to work with the remote store.
|
| AbfsJdkHttpOperation |
Implementation of
AbfsHttpOperation for orchestrating calls using JDK's HttpURLConnection. |
| ABFSKey |
Implementation of SecretKey that would be used by EncryptionAdapter object,
implementations of encryptionContextProvider to maintain the byteArrays of
encryptionContext and encryptionKey.
|
| AbfsLease |
AbfsLease manages an Azure blob lease.
|
| AbfsLease.LeaseException | |
| AbfsListResult |
Class to store listStatus results for AbfsListStatusRemoteIterator.
|
| AbfsListStatusRemoteIterator | |
| AbfsLocatedFileStatus |
LocatedFileStatus extended to also carry an ETag. |
| AbfsManagedHttpClientContext |
Registers the latency of different phases of a network call.
|
| AbfsManagedHttpRequestExecutor |
This class extends
HttpRequestExecutor to intercept the connection
activity and register the latency of different phases of a network call. |
| AbfsManifestStoreOperations |
Extension of StoreOperationsThroughFileSystem with ABFS awareness.
|
| AbfsOutputStream |
The BlobFsOutputStream for Rest AbfsClient.
|
| AbfsOutputStreamContext |
Class to hold extra output stream configs.
|
| AbfsOutputStreamStatistics |
Interface for
AbfsOutputStream statistics. |
| AbfsOutputStreamStatisticsImpl |
OutputStream statistics implementation for Abfs.
|
| AbfsPerfInfo |
AbfsPerfInfo holds information on ADLS Gen 2 API performance observed by AbfsClient. |
| AbfsPerfLoggable |
The AbfsPerfLoggable contract.
|
| AbfsPerfTracker |
AbfsPerfTracker keeps track of service latencies observed by AbfsClient. |
| AbfsPermission |
The AbfsPermission for AbfsClient.
|
| AbfsRestOperation |
The AbfsRestOperation for Rest AbfsClient.
|
| AbfsRestOperationException |
Exception to wrap Azure service error responses.
|
| AbfsRestOperationType |
The REST operation type (Read, Append, Other ).
|
| AbfsRetryPolicy |
Abstract Class for Retry policy to be used by
AbfsClient
Implementation to be used is based on retry cause. |
| Abfss |
Azure Blob File System implementation of AbstractFileSystem.
|
| AbfssDtFetcher |
The DT Fetcher for abfss.
|
| AbfsStatistic |
Statistic which are collected in Abfs.
|
| AbfsStreamContext |
Base stream configuration class which is going
to store common configs among input and output streams.
|
| AbfsThrottlingIntercept |
An interface for Abfs Throttling Interface.
|
| AbfsTokenRenewer |
Token Renewer for renewing ABFS delegation tokens with remote service.
|
| AbfsUriQueryBuilder |
The UrlQueryBuilder for Rest AbfsClient.
|
| AccessTokenProvider |
Returns an Azure Active Directory token when requested.
|
| AppendRequestParameters |
Saves the different request parameters for append
|
| AppendRequestParameters.Mode | |
| AuthConfigurations |
Responsible to keep all the Azure Blob File System auth related
configurations.
|
| AuthType |
Auth Type Enum.
|
| AzureADAuthenticator |
This class provides convenience methods to obtain AAD tokens.
|
| AzureADAuthenticator.HttpException |
This exception class contains the http error code,
requestId and error message, it is thrown when AzureADAuthenticator
failed to get the Azure Active Directory token.
|
| AzureADAuthenticator.UnexpectedResponseException |
An unexpected HTTP response was raised, such as text coming back
from what should be an OAuth endpoint.
|
| AzureADToken |
Object representing the AAD access token to use when making HTTP requests to Azure Data Lake Storage.
|
| AzureBlobFileSystem |
A
FileSystem for reading and writing files stored on Windows Azure |
| AzureBlobFileSystemException |
Base exception for any Azure Blob File System driver exceptions.
|
| AzureBlobFileSystemStore |
Provides the bridging logic between Hadoop's abstract filesystem and Azure Storage.
|
| AzureBlobFileSystemStore.AzureBlobFileSystemStoreBuilder |
A builder class for AzureBlobFileSystemStore.
|
| AzureBlobFileSystemStore.Permissions |
Permissions class contain provided permission and umask in octalNotation.
|
| AzureException |
Thrown if there is a problem communicating with Azure Storage service.
|
| AzureFileSystemInstrumentation |
A metrics source for the WASB file system to track all the metrics we care
about for getting a clear picture of the performance/reliability/interaction
of the Hadoop cluster with Azure Storage.
|
| AzureFileSystemMetricsSystem |
AzureFileSystemMetricsSystem
|
| AzureFileSystemThreadTask |
Interface for executing the file operation by a thread.
|
| AzureLinkedStack<E> |
A simple generic stack implementation using linked lists.
|
| AzureManifestCommitterFactory |
A Committer for the manifest committer which performs all bindings needed
to work best with abfs.
|
| AzureNativeFileSystemStore |
Core implementation of Windows Azure Filesystem for Hadoop.
|
| AzureServiceErrorCode |
Azure service error codes.
|
| BandwidthGaugeUpdater |
Internal implementation class to help calculate the current bytes
uploaded/downloaded and the maximum bandwidth gauges.
|
| Base64 |
Base64
|
| Base64StringConfigurationBasicValidator |
String Base64 configuration value Validator.
|
| BlockBlobAppendStream |
Stream object that implements append for Block Blobs in WASB.
|
| BooleanConfigurationBasicValidator |
Boolean configuration value validator.
|
| BoundDTExtension |
An optional extension for custom extensions, so as to support
tighter integration.
|
| CachedSASToken |
CachedSASToken provides simple utility for managing renewal
of SAS tokens used by Input/OutputStream.
|
| CachingAuthorizer<K,V> |
Class that provides caching for Authorize and getSasUri calls
|
| ClientCredsTokenProvider |
Provides tokens based on client credentials.
|
| ClientErrorRetryReason |
Category that can capture server-response errors for 4XX status-code.
|
| ConcurrentWriteOperationDetectedException |
Thrown when a concurrent write operation is detected.
|
| ConfigurationKeys |
Responsible to keep all the Azure Blob File System configurations keys in Hadoop configuration file.
|
| ConfigurationPropertyNotFoundException |
Thrown when a searched for element is not found
|
| ConfigurationValidationAnnotations |
Definitions of Annotations for all types of the validators.
|
| ConfigurationValidationAnnotations.Base64StringConfigurationValidatorAnnotation |
Describes the requirements when validating the annotated String field.
|
| ConfigurationValidationAnnotations.BooleanConfigurationValidatorAnnotation |
Describes the requirements when validating the annotated boolean field.
|
| ConfigurationValidationAnnotations.IntegerConfigurationValidatorAnnotation |
Describes the requirements when validating the annotated int field.
|
| ConfigurationValidationAnnotations.IntegerWithOutlierConfigurationValidatorAnnotation | |
| ConfigurationValidationAnnotations.LongConfigurationValidatorAnnotation |
Describes the requirements when validating the annotated long field.
|
| ConfigurationValidationAnnotations.StringConfigurationValidatorAnnotation |
Describes the requirements when validating the annotated String field.
|
| ConfigurationValidator<T> |
ConfigurationValidator to validate the value of a configuration key
|
| ConnectionResetRetryReason |
Category that can capture server-response errors for connection-reset exception.
|
| ConnectionTimeoutRetryReason |
Category that can capture server-response errors for connection-timeout.
|
| Constants |
Constants for used with WASB security implementation.
|
| ContextEncryptionAdapter |
Provides APIs to get encryptionKey from encryptionContext for a given path.
|
| ContextProviderEncryptionAdapter |
Class manages the encryptionContext and encryptionKey that needs to be added
to the headers to server request if Customer-Encryption-Context is enabled in
the configuration.
|
| CRC64 |
CRC64 implementation for AzureBlobFileSystem.
|
| CustomDelegationTokenManager |
Interface for Managing the Delegation tokens.
|
| CustomTokenProviderAdaptee |
This interface provides an extensibility model for customizing the acquisition
of Azure Active Directory Access Tokens.
|
| CustomTokenProviderAdapter |
Provides tokens based on custom implementation, following the Adapter Design
Pattern.
|
| DateTimeUtils | |
| EncodingHelper |
Utility class for managing encryption of bytes or base64String conversion of
bytes.
|
| EncryptionContextProvider |
This interface has two roles:
To create new encryptionContext from a given path: To be used in case of create file as there is no encryptionContext in remote server to refer to for encryptionKey creation. |
| EncryptionType |
Enum EncryptionType to represent the level of encryption applied.
|
| ErrorMetricUpdater |
An event listener to the ResponseReceived event from Azure Storage that will
update error metrics appropriately when it gets that event.
|
| ExponentialRetryPolicy |
Retry policy used by AbfsClient.
|
| ExtensionHelper |
Classes to help with use of extensions, expecially those
implementing @
BoundDTExtension. |
| FileSystemConfigurations |
Responsible to keep all the Azure Blob File System related configurations.
|
| FileSystemOperationUnhandledException |
Thrown when an unhandled exception is occurred during a file system operation.
|
| FileSystemUriSchemes |
Responsible to keep all Azure Blob File System valid URI schemes.
|
| FixedSASTokenProvider |
In house implementation of
SASTokenProvider to use a fixed SAS token with ABFS. |
| FSOperationType | |
| HttpHeaderConfigurations |
Responsible to keep all abfs http headers here.
|
| HttpOperationType | |
| HttpQueryParams |
Responsible to keep all Http Query params here.
|
| HttpResponseException |
Encapsulates an exception thrown from ApacheHttpClient response parsing.
|
| IdentityHandler |
IdentityHandler defines the set of methods to support various
identity lookup services. |
| IdentityTransformer |
Perform transformation for Azure Active Directory identities used in owner, group and acls.
|
| IdentityTransformerInterface |
IdentityTransformerInterface defines the set of translation
operations that any identity transformer implementation must provide. |
| IntegerConfigurationBasicValidator |
Integer configuration value Validator.
|
| InternalConstants |
Constants which are used internally and which don't fit into the other
classes.
|
| InvalidAbfsRestOperationException |
Exception to wrap invalid Azure service error responses and exceptions
raised on network IO.
|
| InvalidAclOperationException |
Thrown when there is an attempt to perform an invalid operation on an ACL.
|
| InvalidConfigurationValueException |
Thrown when a configuration value is invalid
|
| InvalidFileSystemPropertyException |
Thrown when a file system property is invalid.
|
| InvalidUriAuthorityException |
Thrown when URI authority is invalid.
|
| InvalidUriException |
Thrown when URI is invalid.
|
| JsonUtils |
Utility class to parse JSON.
|
| KeyProvider |
The interface that every Azure file system key provider must implement.
|
| KeyProvider |
The interface that every Azure file system key provider must implement.
|
| KeyProviderException |
Thrown if there is a problem instantiating a KeyProvider or retrieving a key
using a KeyProvider object.
|
| KeyProviderException |
Thrown if there is a problem instantiating a KeyProvider or retrieving a key
using a KeyProvider object.
|
| Listener |
Interface for testing identifiers tracked via TracingContext
Implemented in TracingHeaderValidator
|
| ListingSupport | |
| ListResultEntrySchema |
The ListResultEntrySchema model.
|
| ListResultSchema |
The ListResultSchema model.
|
| LocalIdentityTransformer |
A subclass of
IdentityTransformer that translates the AAD to Local
identity using IdentityHandler. |
| LocalSASKeyGeneratorImpl |
Local SAS Key Generation implementation.
|
| LongConfigurationBasicValidator |
Long configuration value Validator.
|
| MsiTokenProvider |
Provides tokens based on Azure VM's Managed Service Identity.
|
| NativeAzureFileSystem |
A
FileSystem for reading and writing files stored on Windows Azure. |
| NativeAzureFileSystem.FolderRenamePending |
A description of a folder rename operation, including the source and
destination keys, and descriptions of the files in the source folder.
|
| NativeAzureFileSystem.Secure |
A
FileSystem for reading and writing files stored on Windows Azure. |
| NoContextEncryptionAdapter | |
| QueryParams |
Utilities class http query parameters.
|
| ReadBufferStatus |
The ReadBufferStatus for Rest AbfsClient
|
| ReadTimeoutRetryReason |
Category that can capture server-response errors for read-timeout.
|
| RefreshTokenBasedTokenProvider |
Provides tokens based on refresh token.
|
| RemoteSASKeyGeneratorImpl |
Class implementing a RemoteSASKeyGenerator.
|
| RemoteWasbAuthorizerImpl |
Class implementing WasbAuthorizerInterface using a remote
service that implements the authorization operation.
|
| RemoteWasbDelegationTokenManager |
Class to manage delegation token operations by making rest call to remote service.
|
| ResilientCommitByRename |
API exclusively for committing files.
|
| ResponseReceivedMetricUpdater |
An event listener to the ResponseReceived event from Azure Storage that will
update metrics appropriately when it gets that event.
|
| RetryPolicyConstants | |
| RetryReasonCategory |
Provides methods to define if given exception can be categorised to certain category.
|
| RetryReasonConstants | |
| SASKeyGenerationException |
Exception that gets thrown during generation of SAS Key.
|
| SASKeyGeneratorImpl |
Abstract base class for the SAS Key Generator implementation
|
| SASKeyGeneratorInterface |
Iterface used by AzureNativeFileSysteStore to retrieve SAS Keys for the
respective azure storage entity.
|
| SASTokenProvider |
Interface to support SAS authorization.
|
| SASTokenProviderException |
Thrown if there is an error instantiating the SASTokenProvider or getting
a SAS token.
|
| SecureAzureBlobFileSystem |
A secure
FileSystem for reading and writing files stored on Windows Azure |
| SecureModeException |
Exception that is thrown when any error is encountered
is SAS Mode operation of WASB.
|
| SecureStorageInterfaceImpl |
An implementation of the StorageInterface for SAS Key mode.
|
| SecureWasbRemoteCallHelper |
Helper class the has constants and helper methods
used in WASB when integrating with a remote http cred
service which uses Kerberos and delegation tokens.
|
| SelfRenewingLease |
An Azure blob lease that automatically renews itself indefinitely
using a background thread.
|
| SelfThrottlingIntercept |
Introduces delays in our Azure traffic to prevent overrunning the server-side throttling limits.
|
| SendRequestIntercept |
Manages the lifetime of binding on the operation contexts to intercept send
request events to Azure storage and allow concurrent OOB I/Os.
|
| ServerErrorRetryReason |
Category that can capture server-response errors for 5XX status-code.
|
| SharedKeyCredentials |
Represents the shared key credentials used to access an Azure Storage
account.
|
| ShellDecryptionKeyProvider |
Shell decryption key provider which invokes an external script that will
perform the key decryption.
|
| ShellDecryptionKeyProvider |
Shell decryption key provider which invokes an external script that will
perform the key decryption.
|
| SimpleKeyProvider |
Key provider that simply returns the storage account key from the
configuration as plaintext.
|
| SimpleKeyProvider |
Key provider that simply returns the storage account key from the
configuration as plaintext.
|
| SpnegoToken |
Class to represent SPNEGO token.
|
| StaticRetryPolicy |
Retry policy used by AbfsClient for Network Errors.
|
| StringConfigurationBasicValidator |
String configuration value Validator.
|
| SyncableDataOutputStream |
Support the Syncable interface on top of a DataOutputStream.
|
| TextFileBasedIdentityHandler |
TextFileBasedIdentityHandler is a IdentityHandler implements
translation operation which returns identity mapped to AAD identity by
loading the mapping file from the configured location. |
| TimeoutException |
Thrown when a timeout happens.
|
| TimerFunctionality | |
| TokenAccessProviderException |
Thrown if there is a problem instantiating a TokenAccessProvider or retrieving a configuration
using a TokenAccessProvider object.
|
| TokenUtils |
Utility methods common for token management
|
| TracingContext |
The TracingContext class to correlate Store requests using unique
identifiers and resources common to requests (e.g.
|
| TracingHeaderFormat | |
| Trilean |
Enum to represent 3 values, TRUE, FALSE and UNKNOWN.
|
| TrileanConversionException |
Thrown when tried to convert Trilean.UNKNOWN to boolean.
|
| UnknownHostRetryReason |
Category that can capture server-response errors for
UnknownHostException. |
| UnknownIOExceptionRetryReason |
Category that can capture server-response errors for
IOException. |
| UnknownSocketExceptionRetryReason |
Category that can capture server-response errors for
SocketException. |
| UriUtils |
Utility class to help with Abfs url transformation to blob urls.
|
| UserPasswordTokenProvider |
Provides tokens based on username and password.
|
| Wasb |
WASB implementation of AbstractFileSystem.
|
| WasbAuthorizationException |
Exception that gets thrown during the authorization failures
in WASB.
|
| WasbAuthorizationOperations |
Different authorization operations supported
in WASB.
|
| WasbAuthorizerInterface |
Interface to implement authorization support in WASB.
|
| WasbDelegationTokenIdentifier |
Delegation token Identifier for WASB delegation tokens.
|
| WasbDelegationTokenManager |
Interface for Managing the Delegation tokens.
|
| WasbFsck |
An fsck tool implementation for WASB that does various admin/cleanup/recovery
tasks on the WASB file system.
|
| WasbRemoteCallException |
Exception that gets thrown when a remote call
made from WASB to external cred service fails.
|
| WasbRemoteCallHelper |
Helper class the has constants and helper methods
used in WASB when integrating with a remote http cred
service.
|
| Wasbs |
WASB implementation of AbstractFileSystem for wasbs scheme.
|
| WasbTokenRenewer |
Token Renewer for renewing WASB delegation tokens with remote service.
|
| WorkloadIdentityTokenProvider |
Provides tokens based on Azure AD Workload Identity.
|
Copyright © 2008–2025 Apache Software Foundation. All rights reserved.