A B C D E F G I K L M N O P R S T U W
All Classes All Packages

A

AbstractCOSCredentialsProvider - Class in org.apache.hadoop.fs.cosn.auth

The base class for COS credential providers which take a URI or configuration in their constructor.

AbstractCOSCredentialsProvider(URI, Configuration) - Constructor for class org.apache.hadoop.fs.cosn.auth.AbstractCOSCredentialsProvider

add(COSCredentialsProvider) - Method in class org.apache.hadoop.fs.cosn.auth.COSCredentialsProviderList

append(Path, int, Progressable) - Method in class org.apache.hadoop.fs.cosn.CosNFileSystem

This optional operation is not yet supported.

available() - Method in class org.apache.hadoop.fs.cosn.ByteBufferInputStream

available() - Method in class org.apache.hadoop.fs.cosn.CosNInputStream

await(int) - Method in class org.apache.hadoop.fs.cosn.CosNInputStream.ReadBuffer

awaitAllFinish(int) - Method in class org.apache.hadoop.fs.cosn.CosNCopyFileContext

B

BLOCK_TMP_FILE_PREFIX - Static variable in class org.apache.hadoop.fs.cosn.Constants

BLOCK_TMP_FILE_SUFFIX - Static variable in class org.apache.hadoop.fs.cosn.Constants

BufferPool - Class in org.apache.hadoop.fs.cosn

BufferPool class is used to manage the buffers during program execution.

ByteBufferInputStream - Class in org.apache.hadoop.fs.cosn

The input stream class is used for buffered files.

ByteBufferInputStream(ByteBuffer) - Constructor for class org.apache.hadoop.fs.cosn.ByteBufferInputStream

ByteBufferOutputStream - Class in org.apache.hadoop.fs.cosn

The input stream class is used for buffered files.

ByteBufferOutputStream(ByteBuffer) - Constructor for class org.apache.hadoop.fs.cosn.ByteBufferOutputStream

ByteBufferWrapper - Class in org.apache.hadoop.fs.cosn

The wrapper for memory buffers and disk buffers.

C

checkNotEmpty() - Method in class org.apache.hadoop.fs.cosn.auth.COSCredentialsProviderList

close() - Method in class org.apache.hadoop.fs.cosn.auth.COSCredentialsProviderList

close() - Method in class org.apache.hadoop.fs.cosn.ByteBufferInputStream

close() - Method in class org.apache.hadoop.fs.cosn.ByteBufferOutputStream

close() - Method in class org.apache.hadoop.fs.cosn.CosNFileSystem

close() - Method in class org.apache.hadoop.fs.cosn.CosNInputStream

close() - Method in class org.apache.hadoop.fs.cosn.CosNOutputStream

closed() - Method in class org.apache.hadoop.fs.cosn.auth.COSCredentialsProviderList

Constants - Class in org.apache.hadoop.fs.cosn

constant definition.

COPY_THREAD_POOL_SIZE_KEY - Static variable in class org.apache.hadoop.fs.cosn.CosNConfigKeys

COS_MAX_LISTING_LENGTH - Static variable in class org.apache.hadoop.fs.cosn.Constants

COSCredentialsProviderList - Class in org.apache.hadoop.fs.cosn.auth

a list of cos credentials provider.

COSCredentialsProviderList() - Constructor for class org.apache.hadoop.fs.cosn.auth.COSCredentialsProviderList

COSCredentialsProviderList(Collection<COSCredentialsProvider>) - Constructor for class org.apache.hadoop.fs.cosn.auth.COSCredentialsProviderList

CosN - Class in org.apache.hadoop.fs.cosn

CosN implementation for the Hadoop's AbstractFileSystem.

CosN(URI, Configuration) - Constructor for class org.apache.hadoop.fs.cosn.CosN

COSN_BLOCK_SIZE_KEY - Static variable in class org.apache.hadoop.fs.cosn.CosNConfigKeys

COSN_BUFFER_DIR_KEY - Static variable in class org.apache.hadoop.fs.cosn.CosNConfigKeys

COSN_CREDENTIALS_PROVIDER - Static variable in class org.apache.hadoop.fs.cosn.CosNConfigKeys

COSN_ENDPOINT_SUFFIX_KEY - Static variable in class org.apache.hadoop.fs.cosn.CosNConfigKeys

COSN_MAX_RETRIES_KEY - Static variable in class org.apache.hadoop.fs.cosn.CosNConfigKeys

COSN_REGION_KEY - Static variable in class org.apache.hadoop.fs.cosn.CosNConfigKeys

COSN_RETRY_INTERVAL_KEY - Static variable in class org.apache.hadoop.fs.cosn.CosNConfigKeys

COSN_SECRET_ID_ENV - Static variable in class org.apache.hadoop.fs.cosn.Constants

COSN_SECRET_ID_KEY - Static variable in class org.apache.hadoop.fs.cosn.CosNConfigKeys

COSN_SECRET_KEY_ENV - Static variable in class org.apache.hadoop.fs.cosn.Constants

COSN_SECRET_KEY_KEY - Static variable in class org.apache.hadoop.fs.cosn.CosNConfigKeys

COSN_UPLOAD_BUFFER_SIZE_KEY - Static variable in class org.apache.hadoop.fs.cosn.CosNConfigKeys

COSN_USE_HTTPS_KEY - Static variable in class org.apache.hadoop.fs.cosn.CosNConfigKeys

CosNConfigKeys - Class in org.apache.hadoop.fs.cosn

This class contains constants for configuration keys used in COS.

CosNConfigKeys() - Constructor for class org.apache.hadoop.fs.cosn.CosNConfigKeys

CosNCopyFileContext - Class in org.apache.hadoop.fs.cosn

The context of the copy task, including concurrency control, asynchronous acquisition of copy results and etc.

CosNCopyFileContext() - Constructor for class org.apache.hadoop.fs.cosn.CosNCopyFileContext

CosNCopyFileTask - Class in org.apache.hadoop.fs.cosn

Used by CosNFileSystem as an task that submitted to the thread pool to accelerate the copy progress.

CosNCopyFileTask(NativeFileSystemStore, String, String, CosNCopyFileContext) - Constructor for class org.apache.hadoop.fs.cosn.CosNCopyFileTask

CosNFileReadTask - Class in org.apache.hadoop.fs.cosn

Used by CosNInputStream as an asynchronous task submitted to the thread pool.

CosNFileReadTask(Configuration, String, NativeFileSystemStore, CosNInputStream.ReadBuffer) - Constructor for class org.apache.hadoop.fs.cosn.CosNFileReadTask

CosNFileSystem - Class in org.apache.hadoop.fs.cosn

The core CosN Filesystem implementation.

CosNFileSystem() - Constructor for class org.apache.hadoop.fs.cosn.CosNFileSystem

CosNFileSystem(NativeFileSystemStore) - Constructor for class org.apache.hadoop.fs.cosn.CosNFileSystem

CosNInputStream - Class in org.apache.hadoop.fs.cosn

The input stream for the COS blob store.

CosNInputStream(Configuration, NativeFileSystemStore, FileSystem.Statistics, String, long, ExecutorService) - Constructor for class org.apache.hadoop.fs.cosn.CosNInputStream

CosNInputStream.ReadBuffer - Class in org.apache.hadoop.fs.cosn

This class is used by CosNInputStream and CosNFileReadTask to buffer data that read from COS blob store.

CosNOutputStream - Class in org.apache.hadoop.fs.cosn

The output stream for the COS blob store.

CosNOutputStream(Configuration, NativeFileSystemStore, String, long, ExecutorService) - Constructor for class org.apache.hadoop.fs.cosn.CosNOutputStream

CosNUtils - Class in org.apache.hadoop.fs.cosn

Utility methods for CosN code.

create(Path, FsPermission, boolean, int, short, long, Progressable) - Method in class org.apache.hadoop.fs.cosn.CosNFileSystem

createCOSCredentialProvider(URI, Configuration, Class<?>) - Static method in class org.apache.hadoop.fs.cosn.CosNUtils

createCosCredentialsProviderSet(URI, Configuration) - Static method in class org.apache.hadoop.fs.cosn.CosNUtils

createNonRecursive(Path, FsPermission, EnumSet<CreateFlag>, int, short, long, Progressable) - Method in class org.apache.hadoop.fs.cosn.CosNFileSystem

D

DEFAULT_BLOCK_SIZE - Static variable in class org.apache.hadoop.fs.cosn.CosNConfigKeys

DEFAULT_BUFFER_DIR - Static variable in class org.apache.hadoop.fs.cosn.CosNConfigKeys

DEFAULT_COPY_THREAD_POOL_SIZE - Static variable in class org.apache.hadoop.fs.cosn.CosNConfigKeys

DEFAULT_MAX_CONNECTION_NUM - Static variable in class org.apache.hadoop.fs.cosn.CosNConfigKeys

DEFAULT_MAX_RETRIES - Static variable in class org.apache.hadoop.fs.cosn.CosNConfigKeys

DEFAULT_READ_AHEAD_BLOCK_SIZE - Static variable in class org.apache.hadoop.fs.cosn.CosNConfigKeys

DEFAULT_READ_AHEAD_QUEUE_SIZE - Static variable in class org.apache.hadoop.fs.cosn.CosNConfigKeys

DEFAULT_RETRY_INTERVAL - Static variable in class org.apache.hadoop.fs.cosn.CosNConfigKeys

DEFAULT_THREAD_KEEP_ALIVE_TIME - Static variable in class org.apache.hadoop.fs.cosn.CosNConfigKeys

DEFAULT_UPLOAD_BUFFER_SIZE - Static variable in class org.apache.hadoop.fs.cosn.CosNConfigKeys

DEFAULT_UPLOAD_THREAD_POOL_SIZE - Static variable in class org.apache.hadoop.fs.cosn.CosNConfigKeys

DEFAULT_USE_HTTPS - Static variable in class org.apache.hadoop.fs.cosn.CosNConfigKeys

DEFAULT_USER_AGENT - Static variable in class org.apache.hadoop.fs.cosn.CosNConfigKeys

delete(Path, boolean) - Method in class org.apache.hadoop.fs.cosn.CosNFileSystem

E

EnvironmentVariableCredentialsProvider - Class in org.apache.hadoop.fs.cosn.auth

The provider obtaining the cos credentials from the environment variables.

EnvironmentVariableCredentialsProvider(URI, Configuration) - Constructor for class org.apache.hadoop.fs.cosn.auth.EnvironmentVariableCredentialsProvider

ERROR - Static variable in class org.apache.hadoop.fs.cosn.CosNInputStream.ReadBuffer

F

flush() - Method in class org.apache.hadoop.fs.cosn.ByteBufferOutputStream

flush() - Method in class org.apache.hadoop.fs.cosn.CosNOutputStream

G

GB - Static variable in class org.apache.hadoop.fs.cosn.Unit

getBuffer() - Method in class org.apache.hadoop.fs.cosn.CosNInputStream.ReadBuffer

getBuffer(int) - Method in class org.apache.hadoop.fs.cosn.BufferPool

Obtain a buffer from this buffer pool through the method.

getByteBuffer() - Method in class org.apache.hadoop.fs.cosn.ByteBufferWrapper

getCanonicalServiceName() - Method in class org.apache.hadoop.fs.cosn.CosNFileSystem

getConf() - Method in class org.apache.hadoop.fs.cosn.auth.AbstractCOSCredentialsProvider

getCredentials() - Method in class org.apache.hadoop.fs.cosn.auth.COSCredentialsProviderList

getCredentials() - Method in class org.apache.hadoop.fs.cosn.auth.EnvironmentVariableCredentialsProvider

getCredentials() - Method in class org.apache.hadoop.fs.cosn.auth.SimpleCredentialsProvider

getDefaultBlockSize() - Method in class org.apache.hadoop.fs.cosn.CosNFileSystem

getEnd() - Method in class org.apache.hadoop.fs.cosn.CosNInputStream.ReadBuffer

getFileStatus(Path) - Method in class org.apache.hadoop.fs.cosn.CosNFileSystem

getInstance() - Static method in class org.apache.hadoop.fs.cosn.BufferPool

Use this method to get the instance of BufferPool.

getPos() - Method in class org.apache.hadoop.fs.cosn.CosNInputStream

getRefCount() - Method in class org.apache.hadoop.fs.cosn.auth.COSCredentialsProviderList

getScheme() - Method in class org.apache.hadoop.fs.cosn.CosNFileSystem

Return the protocol scheme for the FileSystem.

getStart() - Method in class org.apache.hadoop.fs.cosn.CosNInputStream.ReadBuffer

getStatus() - Method in class org.apache.hadoop.fs.cosn.CosNInputStream.ReadBuffer

getUri() - Method in class org.apache.hadoop.fs.cosn.auth.AbstractCOSCredentialsProvider

getUri() - Method in class org.apache.hadoop.fs.cosn.CosNFileSystem

getUriDefaultPort() - Method in class org.apache.hadoop.fs.cosn.CosN

getWorkingDirectory() - Method in class org.apache.hadoop.fs.cosn.CosNFileSystem

I

incCopiesFinish() - Method in class org.apache.hadoop.fs.cosn.CosNCopyFileContext

INIT - Static variable in class org.apache.hadoop.fs.cosn.CosNInputStream.ReadBuffer

initialize(URI, Configuration) - Method in class org.apache.hadoop.fs.cosn.CosNFileSystem

initialize(Configuration) - Method in class org.apache.hadoop.fs.cosn.BufferPool

Create buffers correctly by reading the buffer file directory, buffer pool size,and file block size in the configuration.

isCopySuccess() - Method in class org.apache.hadoop.fs.cosn.CosNCopyFileContext

K

KB - Static variable in class org.apache.hadoop.fs.cosn.Unit

L

listStatus(Path) - Method in class org.apache.hadoop.fs.cosn.CosNFileSystem

If f is a file, this method will make a single call to COS.

loadCosProviderClasses(Configuration, String, Class<?>...) - Static method in class org.apache.hadoop.fs.cosn.CosNUtils

lock() - Method in class org.apache.hadoop.fs.cosn.CosNCopyFileContext

lock() - Method in class org.apache.hadoop.fs.cosn.CosNInputStream.ReadBuffer

M

mark(int) - Method in class org.apache.hadoop.fs.cosn.ByteBufferInputStream

markSupported() - Method in class org.apache.hadoop.fs.cosn.ByteBufferInputStream

MAX_CONNECTION_NUM - Static variable in class org.apache.hadoop.fs.cosn.CosNConfigKeys

MAX_PART_NUM - Static variable in class org.apache.hadoop.fs.cosn.Constants

MAX_PART_SIZE - Static variable in class org.apache.hadoop.fs.cosn.Constants

MB - Static variable in class org.apache.hadoop.fs.cosn.Unit

MIN_PART_SIZE - Static variable in class org.apache.hadoop.fs.cosn.Constants

mkDirRecursively(Path, FsPermission) - Method in class org.apache.hadoop.fs.cosn.CosNFileSystem

Recursively create a directory.

mkdirs(Path, FsPermission) - Method in class org.apache.hadoop.fs.cosn.CosNFileSystem

N

NoAuthWithCOSException - Exception in org.apache.hadoop.fs.cosn.auth

Exception thrown when no credentials can be obtained.

NoAuthWithCOSException(String) - Constructor for exception org.apache.hadoop.fs.cosn.auth.NoAuthWithCOSException

NoAuthWithCOSException(String, Throwable) - Constructor for exception org.apache.hadoop.fs.cosn.auth.NoAuthWithCOSException

NoAuthWithCOSException(Throwable) - Constructor for exception org.apache.hadoop.fs.cosn.auth.NoAuthWithCOSException

O

open(Path, int) - Method in class org.apache.hadoop.fs.cosn.CosNFileSystem

org.apache.hadoop.fs.cosn - package org.apache.hadoop.fs.cosn

Licensed to the Apache Software Foundation (ASF) under one or more contributor license agreements.

org.apache.hadoop.fs.cosn.auth - package org.apache.hadoop.fs.cosn.auth

Licensed to the Apache Software Foundation (ASF) under one or more contributor license agreements.

P

PATH_DELIMITER - Static variable in class org.apache.hadoop.fs.cosn.CosNFileSystem

PB - Static variable in class org.apache.hadoop.fs.cosn.Unit

R

read() - Method in class org.apache.hadoop.fs.cosn.ByteBufferInputStream

read() - Method in class org.apache.hadoop.fs.cosn.CosNInputStream

read(byte[], int, int) - Method in class org.apache.hadoop.fs.cosn.CosNInputStream

READ_AHEAD_BLOCK_SIZE_KEY - Static variable in class org.apache.hadoop.fs.cosn.CosNConfigKeys

READ_AHEAD_QUEUE_SIZE - Static variable in class org.apache.hadoop.fs.cosn.CosNConfigKeys

ReadBuffer(long, long) - Constructor for class org.apache.hadoop.fs.cosn.CosNInputStream.ReadBuffer

refresh() - Method in class org.apache.hadoop.fs.cosn.auth.COSCredentialsProviderList

refresh() - Method in class org.apache.hadoop.fs.cosn.auth.EnvironmentVariableCredentialsProvider

refresh() - Method in class org.apache.hadoop.fs.cosn.auth.SimpleCredentialsProvider

rename(Path, Path) - Method in class org.apache.hadoop.fs.cosn.CosNFileSystem

reset() - Method in class org.apache.hadoop.fs.cosn.ByteBufferInputStream

returnBuffer(ByteBufferWrapper) - Method in class org.apache.hadoop.fs.cosn.BufferPool

return the byte buffer wrapper to the buffer pool.

run() - Method in class org.apache.hadoop.fs.cosn.CosNCopyFileTask

run() - Method in class org.apache.hadoop.fs.cosn.CosNFileReadTask

S

SCHEME - Static variable in class org.apache.hadoop.fs.cosn.CosNFileSystem

seek(long) - Method in class org.apache.hadoop.fs.cosn.CosNInputStream

seekToNewSource(long) - Method in class org.apache.hadoop.fs.cosn.CosNInputStream

setCopySuccess(boolean) - Method in class org.apache.hadoop.fs.cosn.CosNCopyFileContext

setStatus(int) - Method in class org.apache.hadoop.fs.cosn.CosNInputStream.ReadBuffer

setWorkingDirectory(Path) - Method in class org.apache.hadoop.fs.cosn.CosNFileSystem

Set the working directory to the given directory.

share() - Method in class org.apache.hadoop.fs.cosn.auth.COSCredentialsProviderList

signalAll() - Method in class org.apache.hadoop.fs.cosn.CosNCopyFileContext

signalAll() - Method in class org.apache.hadoop.fs.cosn.CosNInputStream.ReadBuffer

SimpleCredentialsProvider - Class in org.apache.hadoop.fs.cosn.auth

Get the credentials from the hadoop configuration.

SimpleCredentialsProvider(URI, Configuration) - Constructor for class org.apache.hadoop.fs.cosn.auth.SimpleCredentialsProvider

SUCCESS - Static variable in class org.apache.hadoop.fs.cosn.CosNInputStream.ReadBuffer

T

TB - Static variable in class org.apache.hadoop.fs.cosn.Unit

THREAD_KEEP_ALIVE_TIME_KEY - Static variable in class org.apache.hadoop.fs.cosn.CosNConfigKeys

This is the maximum time that excess idle threads will wait for new tasks before terminating.

toString() - Method in class org.apache.hadoop.fs.cosn.auth.EnvironmentVariableCredentialsProvider

U

Unit - Class in org.apache.hadoop.fs.cosn

Constant definition of storage unit.

unlock() - Method in class org.apache.hadoop.fs.cosn.CosNCopyFileContext

unLock() - Method in class org.apache.hadoop.fs.cosn.CosNInputStream.ReadBuffer

UPLOAD_THREAD_POOL_SIZE_KEY - Static variable in class org.apache.hadoop.fs.cosn.CosNConfigKeys

USER_AGENT - Static variable in class org.apache.hadoop.fs.cosn.CosNConfigKeys

W

write(byte[]) - Method in class org.apache.hadoop.fs.cosn.CosNOutputStream

write(byte[], int, int) - Method in class org.apache.hadoop.fs.cosn.CosNOutputStream

write(int) - Method in class org.apache.hadoop.fs.cosn.ByteBufferOutputStream

write(int) - Method in class org.apache.hadoop.fs.cosn.CosNOutputStream

A B C D E F G I K L M N O P R S T U W
All Classes All Packages