| Package | Description |
|---|---|
| org.apache.hadoop.fs |
An abstract file system API.
|
| org.apache.hadoop.fs.ftp | |
| org.apache.hadoop.fs.http |
Filesystem implementations that allow Hadoop to read directly from
HTTP / HTTPS endpoints.
|
| org.apache.hadoop.fs.impl |
This package contains implementation classes for use inside
filesystems.
|
| org.apache.hadoop.fs.sftp |
SFTP FileSystem package.
|
| org.apache.hadoop.fs.shell |
Support for the execution of a file system command.
|
| org.apache.hadoop.fs.shell.find | |
| org.apache.hadoop.fs.viewfs |
ViewFileSystem and ViewFileSystemOverloadScheme classes.
|
| org.apache.hadoop.io |
Generic i/o code for use when reading and writing data to the network,
to databases, and to files.
|
| org.apache.hadoop.io.wrappedio |
Support for dynamic access to filesystem operations which are not available
in older hadoop releases.
|
| org.apache.hadoop.io.wrappedio.impl |
Implementation/testing support for wrapped IO.
|
| org.apache.hadoop.maprfs | |
| org.apache.hadoop.metrics2.sink |
Builtin metrics sinks
|
| org.apache.hadoop.security | |
| org.apache.hadoop.util |
Common utilities.
|
| Modifier and Type | Class | Description |
|---|---|---|
static class |
DelegationTokenRenewer.RenewAction<T extends FileSystem & DelegationTokenRenewer.Renewable> |
An action that will renew and replace the file system's delegation
tokens automatically.
|
| Modifier and Type | Class | Description |
|---|---|---|
class |
ChecksumFileSystem |
Abstract Checksumed FileSystem.
|
class |
FilterFileSystem |
A
FilterFileSystem contains
some other file system, which it uses as
its basic file system, possibly transforming
the data along the way or providing additional
functionality. |
class |
HarFileSystem |
This is an implementation of the Hadoop Archive
Filesystem.
|
class |
LocalFileSystem |
Implement the FileSystem API for the checksumed local filesystem.
|
class |
RawLocalFileSystem |
Implement the FileSystem API for the raw local filesystem.
|
| Modifier and Type | Field | Description |
|---|---|---|
protected FileSystem |
FilterFileSystem.fs |
|
protected FileSystem |
TrashPolicy.fs |
|
protected FileSystem |
DelegateToFileSystem.fsImpl |
| Modifier and Type | Method | Description |
|---|---|---|
<T extends FileSystem & DelegationTokenRenewer.Renewable> |
DelegationTokenRenewer.addRenewAction(T fs) |
Add a renew action to the queue.
|
<T extends FileSystem & DelegationTokenRenewer.Renewable> |
DelegationTokenRenewer.removeRenewAction(T fs) |
Remove the associated renew action from the queue
|
| Modifier and Type | Method | Description |
|---|---|---|
static FileSystem |
FileSystem.get(java.net.URI uri,
Configuration conf) |
Get a FileSystem for this URI's scheme and authority.
|
static FileSystem |
FileSystem.get(java.net.URI uri,
Configuration conf,
java.lang.String user) |
Get a FileSystem instance based on the uri, the passed in
configuration and the user.
|
static FileSystem |
FileSystem.get(Configuration conf) |
Returns the configured FileSystem implementation.
|
FileSystem[] |
FileSystem.getChildFileSystems() |
Get all the immediate child FileSystems embedded in this FileSystem.
|
FileSystem[] |
FilterFileSystem.getChildFileSystems() |
|
FileSystem[] |
HarFileSystem.getChildFileSystems() |
Used for delegation token related functionality.
|
FileSystem |
Path.getFileSystem(Configuration conf) |
Return the FileSystem that owns this Path.
|
protected FileSystem |
FSDataOutputStreamBuilder.getFS() |
|
protected FileSystem |
FsShell.getFS() |
|
protected static FileSystem |
FileSystem.getFSofPath(Path absOrFqPath,
Configuration conf) |
|
static FileSystem |
FileSystem.getNamed(java.lang.String name,
Configuration conf) |
Deprecated.
call
get(URI, Configuration) instead. |
FileSystem |
LocalFileSystem.getRaw() |
|
FileSystem |
ChecksumFileSystem.getRawFileSystem() |
get the raw file system
|
FileSystem |
FilterFileSystem.getRawFileSystem() |
Get the raw file system
|
static FileSystem |
FileSystem.newInstance(java.net.URI uri,
Configuration config) |
Returns the FileSystem for this URI's scheme and authority.
|
static FileSystem |
FileSystem.newInstance(java.net.URI uri,
Configuration conf,
java.lang.String user) |
Returns the FileSystem for this URI's scheme and authority and the
given user.
|
static FileSystem |
FileSystem.newInstance(Configuration conf) |
Returns a unique configured FileSystem implementation for the default
filesystem of the supplied configuration.
|
static FileSystem |
FileUtil.write(FileSystem fs,
Path path,
byte[] bytes) |
Writes bytes to a file.
|
static FileSystem |
FileUtil.write(FileSystem fs,
Path path,
java.lang.CharSequence charseq) |
Write a line of text to a file.
|
static FileSystem |
FileUtil.write(FileSystem fs,
Path path,
java.lang.CharSequence charseq,
java.nio.charset.Charset cs) |
Write a line of text to a file.
|
static FileSystem |
FileUtil.write(FileSystem fs,
Path path,
java.lang.Iterable<? extends java.lang.CharSequence> lines,
java.nio.charset.Charset cs) |
Write lines of text to a file.
|
| Modifier and Type | Method | Description |
|---|---|---|
static java.lang.Class<? extends FileSystem> |
FileSystem.getFileSystemClass(java.lang.String scheme,
Configuration conf) |
Get the FileSystem implementation class of a filesystem.
|
| Modifier and Type | Method | Description |
|---|---|---|
static boolean |
FileUtil.compareFs(FileSystem srcFs,
FileSystem destFs) |
|
static boolean |
FileUtil.copy(java.io.File src,
FileSystem dstFS,
Path dst,
boolean deleteSource,
Configuration conf) |
Copy local files to a FileSystem.
|
static boolean |
FileUtil.copy(FileSystem srcFS,
FileStatus srcStatus,
FileSystem dstFS,
Path dst,
boolean deleteSource,
boolean overwrite,
Configuration conf) |
Copy a file/directory tree within/between filesystems.
|
static boolean |
FileUtil.copy(FileSystem srcFS,
Path[] srcs,
FileSystem dstFS,
Path dst,
boolean deleteSource,
boolean overwrite,
Configuration conf) |
|
static boolean |
FileUtil.copy(FileSystem srcFS,
Path src,
java.io.File dst,
boolean deleteSource,
Configuration conf) |
Copy FileSystem files to local files.
|
static boolean |
FileUtil.copy(FileSystem srcFS,
Path src,
FileSystem dstFS,
Path dst,
boolean deleteSource,
boolean overwrite,
Configuration conf) |
Copy files between FileSystems.
|
static boolean |
FileUtil.copy(FileSystem srcFS,
Path src,
FileSystem dstFS,
Path dst,
boolean deleteSource,
Configuration conf) |
Copy files between FileSystems.
|
static boolean |
FileUtil.copyAsMove(FileSystem srcFS,
FileStatus srcStatus,
FileSystem dstFS,
Path dst,
boolean deleteSource,
boolean overwrite,
Configuration conf) |
Copy files between FileSystems with preserved permissions, ownership, links and ACEs.
|
static boolean |
FileUtil.copyMerge(FileSystem srcFS,
Path srcDir,
FileSystem dstFS,
Path dstFile,
boolean deleteSource,
Configuration conf,
java.lang.String addString) |
Copy all files in a directory to one output file (merge).
|
static FSDataOutputStream |
FileSystem.create(FileSystem fs,
Path file,
FsPermission permission) |
Create a file with the provided permission.
|
protected static org.apache.hadoop.fs.FileSystem.FSDataInputStreamBuilder |
FileSystem.createDataInputStreamBuilder(FileSystem fileSystem,
Path path) |
Create instance of the standard
FileSystem.FSDataInputStreamBuilder for the
given filesystem and path. |
protected static org.apache.hadoop.fs.FileSystem.FSDataInputStreamBuilder |
FileSystem.createDataInputStreamBuilder(FileSystem fileSystem,
PathHandle pathHandle) |
Create instance of the standard
FileSystem.FSDataInputStreamBuilder for the
given filesystem and path handle. |
protected static FSDataOutputStreamBuilder |
FileSystem.createDataOutputStreamBuilder(FileSystem fileSystem,
Path path) |
Create instance of the standard FSDataOutputStreamBuilder for the
given filesystem and path.
|
static Globber.GlobBuilder |
Globber.createGlobber(FileSystem filesystem) |
Create a builder for a Globber, bonded to the specific filesystem.
|
static void |
FileUtil.fullyDelete(FileSystem fs,
Path dir) |
Deprecated.
|
static TrashPolicy |
TrashPolicy.getInstance(Configuration conf,
FileSystem fs) |
Get an instance of the configured TrashPolicy based on the value
of the configuration parameter fs.trash.classname.
|
static TrashPolicy |
TrashPolicy.getInstance(Configuration conf,
FileSystem fs,
Path home) |
Deprecated.
Use
TrashPolicy.getInstance(Configuration, FileSystem) instead. |
void |
TrashPolicy.initialize(Configuration conf,
FileSystem fs) |
Used to setup the trash policy.
|
abstract void |
TrashPolicy.initialize(Configuration conf,
FileSystem fs,
Path home) |
Deprecated.
Use
TrashPolicy.initialize(Configuration, FileSystem) instead. |
void |
TrashPolicyDefault.initialize(Configuration conf,
FileSystem fs) |
|
void |
TrashPolicyDefault.initialize(Configuration conf,
FileSystem fs,
Path home) |
Deprecated.
|
Path |
Path.makeQualified(FileSystem fs) |
Deprecated.
|
static void |
FileUtil.maybeIgnoreMissingDirectory(FileSystem fs,
Path path,
java.io.FileNotFoundException e) |
Method to call after a FNFE has been raised on a treewalk, so as to
decide whether to throw the exception (default), or, if the FS
supports inconsistent directory listings, to log and ignore it.
|
static boolean |
FileSystem.mkdirs(FileSystem fs,
Path dir,
FsPermission permission) |
Create a directory with the provided permission.
|
static boolean |
Trash.moveToAppropriateTrash(FileSystem fs,
Path p,
Configuration conf) |
In case of the symlinks or mount points, one has to move the appropriate
trashbin in the actual volume of the path p being deleted.
|
abstract T |
FileSystemLinkResolver.next(FileSystem fs,
Path p) |
Calls the abstract FileSystem call equivalent to the specialized subclass
implementation in
FileSystemLinkResolver.doCall(Path). |
static void |
FileUtil.rename(FileSystem srcFs,
Path src,
Path dst,
Options.Rename... options) |
|
void |
InternalOperations.rename(FileSystem fs,
Path src,
Path dst,
Options.Rename... options) |
|
T |
FileSystemLinkResolver.resolve(FileSystem filesys,
Path path) |
Attempt calling overridden
FileSystemLinkResolver.doCall(Path) method with
specified FileSystem and Path. |
static java.util.function.Function<FileStatus,PathHandle> |
Options.HandleOpt.resolve(FileSystem fs,
Options.HandleOpt... opt) |
Utility function for mapping
getPathHandle(org.apache.hadoop.fs.FileStatus, org.apache.hadoop.fs.Options.HandleOpt...) to a
fixed set of handle options. |
static FileSystem |
FileUtil.write(FileSystem fs,
Path path,
byte[] bytes) |
Writes bytes to a file.
|
static FileSystem |
FileUtil.write(FileSystem fs,
Path path,
java.lang.CharSequence charseq) |
Write a line of text to a file.
|
static FileSystem |
FileUtil.write(FileSystem fs,
Path path,
java.lang.CharSequence charseq,
java.nio.charset.Charset cs) |
Write a line of text to a file.
|
static FileSystem |
FileUtil.write(FileSystem fs,
Path path,
java.lang.Iterable<? extends java.lang.CharSequence> lines,
java.nio.charset.Charset cs) |
Write lines of text to a file.
|
| Modifier and Type | Method | Description |
|---|---|---|
static FileSystem.Statistics |
FileSystem.getStatistics(java.lang.String scheme,
java.lang.Class<? extends FileSystem> cls) |
Deprecated.
|
| Constructor | Description |
|---|---|
ChecksumFileSystem(FileSystem fs) |
|
DelegateToFileSystem(java.net.URI theUri,
FileSystem theFsImpl,
Configuration conf,
java.lang.String supportedScheme,
boolean authorityRequired) |
|
FilterFileSystem(FileSystem fs) |
|
FSDataOutputStreamBuilder(FileSystem fileSystem,
Path p) |
Constructor.
|
GlobBuilder(FileSystem fs) |
Construct bonded to a filesystem.
|
HarFileSystem(FileSystem fs) |
Constructor to create a HarFileSystem with an
underlying filesystem.
|
LocalFileSystem(FileSystem rawLocalFileSystem) |
|
Stat(Path path,
long blockSize,
boolean deref,
FileSystem fs) |
|
Trash(FileSystem fs,
Configuration conf) |
Construct a trash can accessor for the FileSystem provided.
|
| Modifier and Type | Class | Description |
|---|---|---|
class |
FTPFileSystem |
A
FileSystem backed by an FTP client provided by Apache Commons Net. |
| Modifier and Type | Class | Description |
|---|---|---|
class |
HttpFileSystem |
A Filesystem that reads from HTTP endpoint.
|
class |
HttpsFileSystem |
A Filesystem that reads from HTTPS endpoint.
|
| Modifier and Type | Method | Description |
|---|---|---|
FileSystem |
FileSystemMultipartUploaderBuilder.getFS() |
|
protected FileSystem |
FutureDataInputStreamBuilderImpl.getFS() |
|
protected FileSystem |
MultipartUploaderBuilderImpl.getFS() |
| Constructor | Description |
|---|---|
DefaultBulkDeleteOperation(Path basePath,
FileSystem fs) |
|
FileSystemMultipartUploader(FileSystemMultipartUploaderBuilder builder,
FileSystem fs) |
|
FileSystemMultipartUploaderBuilder(FileSystem fileSystem,
Path path) |
|
FutureDataInputStreamBuilderImpl(FileSystem fileSystem,
Path path) |
Constructor.
|
FutureDataInputStreamBuilderImpl(FileSystem fileSystem,
PathHandle pathHandle) |
Constructor with PathHandle.
|
MultipartUploaderBuilderImpl(FileSystem fileSystem,
Path p) |
Constructor.
|
| Modifier and Type | Class | Description |
|---|---|---|
class |
SFTPFileSystem |
SFTP FileSystem.
|
| Modifier and Type | Field | Description |
|---|---|---|
FileSystem |
PathData.fs |
| Modifier and Type | Method | Description |
|---|---|---|
protected FileSystem |
BaseExpression.getFileSystem(PathData item) |
Returns the
FileSystem associated with the PathData item. |
| Modifier and Type | Class | Description |
|---|---|---|
class |
ViewFileSystem |
ViewFileSystem (extends the FileSystem interface) implements a client-side
mount table.
|
class |
ViewFileSystemOverloadScheme |
This class is extended from the ViewFileSystem for the overloaded
scheme file system.
|
| Modifier and Type | Method | Description |
|---|---|---|
FileSystem |
FsGetter.get(java.net.URI uri,
Configuration conf) |
Gets file system instance of given uri.
|
FileSystem[] |
ViewFileSystem.getChildFileSystems() |
|
FileSystem |
ViewFileSystemOverloadScheme.getFallbackFileSystem() |
|
FileSystem |
FsGetter.getNewInstance(java.net.URI uri,
Configuration conf) |
Gets new file system instance of given uri.
|
FileSystem |
ViewFileSystemOverloadScheme.getRawFileSystem(Path path,
Configuration conf) |
This is an admin only API to give access to its child raw file system, if
the path is link.
|
| Modifier and Type | Method | Description |
|---|---|---|
ViewFileSystemOverloadScheme.MountPathInfo<FileSystem> |
ViewFileSystemOverloadScheme.getMountPathInfo(Path path,
Configuration conf) |
Gets the mount path info, which contains the target file system and
remaining path to pass to the target file system.
|
| Modifier and Type | Method | Description |
|---|---|---|
static java.util.Map<ViewFileSystem.MountPoint,FsStatus> |
ViewFileSystemUtil.getStatus(FileSystem fileSystem,
Path path) |
Get FsStatus for all ViewFsMountPoints matching path for the given
ViewFileSystem.
|
static boolean |
ViewFileSystemUtil.isViewFileSystem(FileSystem fileSystem) |
Check if the FileSystem is a ViewFileSystem.
|
static boolean |
ViewFileSystemUtil.isViewFileSystemOverloadScheme(FileSystem fileSystem) |
Check if the FileSystem is a ViewFileSystemOverloadScheme.
|
| Modifier and Type | Method | Description |
|---|---|---|
static SequenceFile.Writer |
SequenceFile.createWriter(FileSystem fs,
Configuration conf,
Path name,
java.lang.Class keyClass,
java.lang.Class valClass) |
Deprecated.
|
static SequenceFile.Writer |
SequenceFile.createWriter(FileSystem fs,
Configuration conf,
Path name,
java.lang.Class keyClass,
java.lang.Class valClass,
int bufferSize,
short replication,
long blockSize,
boolean createParent,
SequenceFile.CompressionType compressionType,
CompressionCodec codec,
SequenceFile.Metadata metadata) |
Deprecated.
|
static SequenceFile.Writer |
SequenceFile.createWriter(FileSystem fs,
Configuration conf,
Path name,
java.lang.Class keyClass,
java.lang.Class valClass,
int bufferSize,
short replication,
long blockSize,
SequenceFile.CompressionType compressionType,
CompressionCodec codec,
Progressable progress,
SequenceFile.Metadata metadata) |
Deprecated.
|
static SequenceFile.Writer |
SequenceFile.createWriter(FileSystem fs,
Configuration conf,
Path name,
java.lang.Class keyClass,
java.lang.Class valClass,
SequenceFile.CompressionType compressionType) |
Deprecated.
|
static SequenceFile.Writer |
SequenceFile.createWriter(FileSystem fs,
Configuration conf,
Path name,
java.lang.Class keyClass,
java.lang.Class valClass,
SequenceFile.CompressionType compressionType,
CompressionCodec codec) |
Deprecated.
|
static SequenceFile.Writer |
SequenceFile.createWriter(FileSystem fs,
Configuration conf,
Path name,
java.lang.Class keyClass,
java.lang.Class valClass,
SequenceFile.CompressionType compressionType,
CompressionCodec codec,
Progressable progress) |
Deprecated.
|
static SequenceFile.Writer |
SequenceFile.createWriter(FileSystem fs,
Configuration conf,
Path name,
java.lang.Class keyClass,
java.lang.Class valClass,
SequenceFile.CompressionType compressionType,
CompressionCodec codec,
Progressable progress,
SequenceFile.Metadata metadata) |
Deprecated.
|
static SequenceFile.Writer |
SequenceFile.createWriter(FileSystem fs,
Configuration conf,
Path name,
java.lang.Class keyClass,
java.lang.Class valClass,
SequenceFile.CompressionType compressionType,
Progressable progress) |
Deprecated.
|
static void |
BloomMapFile.delete(FileSystem fs,
java.lang.String name) |
|
static void |
MapFile.delete(FileSystem fs,
java.lang.String name) |
Deletes the named map file.
|
static long |
MapFile.fix(FileSystem fs,
Path dir,
java.lang.Class<? extends Writable> keyClass,
java.lang.Class<? extends Writable> valueClass,
boolean dryrun,
Configuration conf) |
This method attempts to fix a corrupt MapFile by re-creating its index.
|
protected FSDataInputStream |
SequenceFile.Reader.openFile(FileSystem fs,
Path file,
int bufferSize,
long length) |
Override this method to specialize the type of
FSDataInputStream returned. |
static void |
MapFile.rename(FileSystem fs,
java.lang.String oldName,
java.lang.String newName) |
Renames an existing map directory.
|
| Constructor | Description |
|---|---|
Reader(FileSystem fs,
java.lang.String file,
Configuration conf) |
Construct an array reader for the named file.
|
Reader(FileSystem fs,
java.lang.String dirName,
Configuration conf) |
Deprecated.
|
Reader(FileSystem fs,
java.lang.String dirName,
WritableComparator comparator,
Configuration conf) |
Deprecated.
|
Reader(FileSystem fs,
java.lang.String dirName,
WritableComparator comparator,
Configuration conf,
boolean open) |
Deprecated.
|
Reader(FileSystem fs,
java.lang.String dirName,
Configuration conf) |
Deprecated.
|
Reader(FileSystem fs,
java.lang.String dirName,
WritableComparator comparator,
Configuration conf) |
Deprecated.
|
Reader(FileSystem fs,
Path file,
Configuration conf) |
Deprecated.
Use Reader(Configuration, Option...) instead.
|
Reader(FileSystem fs,
java.lang.String dirName,
Configuration conf) |
Construct a set reader for the named set.
|
Reader(FileSystem fs,
java.lang.String dirName,
WritableComparator comparator,
Configuration conf) |
Construct a set reader for the named set using the named comparator.
|
Sorter(FileSystem fs,
java.lang.Class<? extends WritableComparable> keyClass,
java.lang.Class valClass,
Configuration conf) |
Sort and merge files containing the named classes.
|
Sorter(FileSystem fs,
RawComparator comparator,
java.lang.Class keyClass,
java.lang.Class valClass,
Configuration conf) |
Sort and merge using an arbitrary
RawComparator. |
Sorter(FileSystem fs,
RawComparator comparator,
java.lang.Class keyClass,
java.lang.Class valClass,
Configuration conf,
SequenceFile.Metadata metadata) |
Sort and merge using an arbitrary
RawComparator. |
Writer(Configuration conf,
FileSystem fs,
java.lang.String file,
java.lang.Class<? extends Writable> valClass) |
Create the named file for values of the named class.
|
Writer(Configuration conf,
FileSystem fs,
java.lang.String file,
java.lang.Class<? extends Writable> valClass,
SequenceFile.CompressionType compress,
Progressable progress) |
Create the named file for values of the named class.
|
Writer(Configuration conf,
FileSystem fs,
java.lang.String dirName,
java.lang.Class<? extends WritableComparable> keyClass,
java.lang.Class valClass) |
Deprecated.
|
Writer(Configuration conf,
FileSystem fs,
java.lang.String dirName,
java.lang.Class<? extends WritableComparable> keyClass,
java.lang.Class<? extends Writable> valClass,
SequenceFile.CompressionType compress,
CompressionCodec codec,
Progressable progress) |
Deprecated.
|
Writer(Configuration conf,
FileSystem fs,
java.lang.String dirName,
java.lang.Class<? extends WritableComparable> keyClass,
java.lang.Class valClass,
SequenceFile.CompressionType compress) |
Deprecated.
|
Writer(Configuration conf,
FileSystem fs,
java.lang.String dirName,
java.lang.Class<? extends WritableComparable> keyClass,
java.lang.Class valClass,
SequenceFile.CompressionType compress,
Progressable progress) |
Deprecated.
|
Writer(Configuration conf,
FileSystem fs,
java.lang.String dirName,
WritableComparator comparator,
java.lang.Class valClass) |
Deprecated.
|
Writer(Configuration conf,
FileSystem fs,
java.lang.String dirName,
WritableComparator comparator,
java.lang.Class valClass,
SequenceFile.CompressionType compress) |
Deprecated.
|
Writer(Configuration conf,
FileSystem fs,
java.lang.String dirName,
WritableComparator comparator,
java.lang.Class valClass,
SequenceFile.CompressionType compress,
CompressionCodec codec,
Progressable progress) |
Deprecated.
|
Writer(Configuration conf,
FileSystem fs,
java.lang.String dirName,
WritableComparator comparator,
java.lang.Class valClass,
SequenceFile.CompressionType compress,
Progressable progress) |
Deprecated.
|
Writer(Configuration conf,
FileSystem fs,
java.lang.String dirName,
java.lang.Class<? extends WritableComparable> keyClass,
java.lang.Class valClass) |
Deprecated.
Use Writer(Configuration, Path, Option...) instead.
|
Writer(Configuration conf,
FileSystem fs,
java.lang.String dirName,
java.lang.Class<? extends WritableComparable> keyClass,
java.lang.Class valClass,
SequenceFile.CompressionType compress) |
Deprecated.
Use Writer(Configuration, Path, Option...) instead.
|
Writer(Configuration conf,
FileSystem fs,
java.lang.String dirName,
java.lang.Class<? extends WritableComparable> keyClass,
java.lang.Class valClass,
SequenceFile.CompressionType compress,
CompressionCodec codec,
Progressable progress) |
Deprecated.
Use Writer(Configuration, Path, Option...) instead.
|
Writer(Configuration conf,
FileSystem fs,
java.lang.String dirName,
java.lang.Class<? extends WritableComparable> keyClass,
java.lang.Class valClass,
SequenceFile.CompressionType compress,
Progressable progress) |
Deprecated.
Use Writer(Configuration, Path, Option...) instead.
|
Writer(Configuration conf,
FileSystem fs,
java.lang.String dirName,
WritableComparator comparator,
java.lang.Class valClass) |
Deprecated.
Use Writer(Configuration, Path, Option...) instead.
|
Writer(Configuration conf,
FileSystem fs,
java.lang.String dirName,
WritableComparator comparator,
java.lang.Class valClass,
SequenceFile.CompressionType compress) |
Deprecated.
Use Writer(Configuration, Path, Option...) instead.
|
Writer(Configuration conf,
FileSystem fs,
java.lang.String dirName,
WritableComparator comparator,
java.lang.Class valClass,
SequenceFile.CompressionType compress,
CompressionCodec codec,
Progressable progress) |
Deprecated.
Use Writer(Configuration, Path, Option...) instead.
|
Writer(Configuration conf,
FileSystem fs,
java.lang.String dirName,
WritableComparator comparator,
java.lang.Class valClass,
SequenceFile.CompressionType compress,
Progressable progress) |
Deprecated.
Use Writer(Configuration, Path, Option...)} instead.
|
Writer(FileSystem fs,
Configuration conf,
Path name,
java.lang.Class keyClass,
java.lang.Class valClass) |
Deprecated.
|
Writer(FileSystem fs,
Configuration conf,
Path name,
java.lang.Class keyClass,
java.lang.Class valClass,
int bufferSize,
short replication,
long blockSize,
Progressable progress,
SequenceFile.Metadata metadata) |
Deprecated.
|
Writer(FileSystem fs,
Configuration conf,
Path name,
java.lang.Class keyClass,
java.lang.Class valClass,
Progressable progress,
SequenceFile.Metadata metadata) |
Deprecated.
|
Writer(Configuration conf,
FileSystem fs,
java.lang.String dirName,
java.lang.Class<? extends WritableComparable> keyClass,
SequenceFile.CompressionType compress) |
Create a set naming the element class and compression type.
|
Writer(Configuration conf,
FileSystem fs,
java.lang.String dirName,
WritableComparator comparator,
SequenceFile.CompressionType compress) |
Create a set naming the element comparator and compression type.
|
Writer(FileSystem fs,
java.lang.String dirName,
java.lang.Class<? extends WritableComparable> keyClass) |
Deprecated.
pass a Configuration too
|
| Modifier and Type | Method | Description |
|---|---|---|
static java.util.List<java.util.Map.Entry<Path,java.lang.String>> |
WrappedIO.bulkDelete_delete(FileSystem fs,
Path base,
java.util.Collection<Path> paths) |
Delete a list of files/objects.
|
static int |
WrappedIO.bulkDelete_pageSize(FileSystem fs,
Path path) |
Get the maximum number of objects/files to delete in a single request.
|
static Path |
WrappedIO.fileSystem_getEnclosingRoot(FileSystem fs,
Path path) |
Return path of the enclosing root for a given path.
|
static FSDataInputStream |
WrappedIO.fileSystem_openFile(FileSystem fs,
Path path,
java.lang.String policy,
FileStatus status,
java.lang.Long length,
java.util.Map<java.lang.String,java.lang.String> options) |
OpenFile assistant, easy reflection-based access to
openFile(Path) and blocks
awaiting the operation completion. |
static java.io.Serializable |
WrappedStatistics.iostatisticsSnapshot_load(FileSystem fs,
Path path) |
Load IOStatisticsSnapshot from a Hadoop filesystem.
|
static void |
WrappedStatistics.iostatisticsSnapshot_save(java.io.Serializable snapshot,
FileSystem fs,
Path path,
boolean overwrite) |
Save IOStatisticsSnapshot to a Hadoop filesystem as a JSON file.
|
| Modifier and Type | Method | Description |
|---|---|---|
java.util.List<java.util.Map.Entry<Path,java.lang.String>> |
DynamicWrappedIO.bulkDelete_delete(FileSystem fs,
Path base,
java.util.Collection<Path> paths) |
Delete a list of files/objects.
|
int |
DynamicWrappedIO.bulkDelete_pageSize(FileSystem fileSystem,
Path path) |
Get the maximum number of objects/files to delete in a single request.
|
FSDataInputStream |
DynamicWrappedIO.fileSystem_openFile(FileSystem fs,
Path path,
java.lang.String policy,
FileStatus status,
java.lang.Long length,
java.util.Map<java.lang.String,java.lang.String> options) |
OpenFile assistant, easy reflection-based access to
FileSystem#openFile(Path) and blocks
awaiting the operation completion. |
java.io.Serializable |
DynamicWrappedStatistics.iostatisticsSnapshot_load(FileSystem fs,
Path path) |
Load IOStatisticsSnapshot from a Hadoop filesystem.
|
void |
DynamicWrappedStatistics.iostatisticsSnapshot_save(java.io.Serializable snapshot,
FileSystem fs,
Path path,
boolean overwrite) |
Save IOStatisticsSnapshot to a Hadoop filesystem as a JSON file.
|
static FSDataInputStream |
DynamicWrappedIO.openFile(FileSystem fs,
FileStatus status,
java.lang.String readPolicies) |
Open a file.
|
| Modifier and Type | Class | Description |
|---|---|---|
class |
AbstractMapRFileSystem |
An abstract base class which represents top-level API for MapR-FS implementation of Hadoop
FileSystem. |
| Modifier and Type | Field | Description |
|---|---|---|
protected static FileSystem |
RollingFileSystemSink.suppliedFilesystem |
| Modifier and Type | Method | Description |
|---|---|---|
static Configuration |
ProviderUtils.excludeIncompatibleCredentialProviders(Configuration config,
java.lang.Class<? extends FileSystem> fileSystemClass) |
There are certain integrations of the credential provider API in
which a recursive dependency between the provider and the hadoop
filesystem abstraction causes a problem.
|
| Modifier and Type | Method | Description |
|---|---|---|
T |
JsonSerialization.load(FileSystem fs,
Path path) |
Load from a Hadoop filesystem.
|
T |
JsonSerialization.load(FileSystem fs,
Path path,
FileStatus status) |
Load from a Hadoop filesystem.
|
static void |
RMVolumeShardingUtil.rebalanceVolumes(java.lang.String rebalanceDir,
int volumeCount,
boolean useVolumeSharding,
java.lang.String rmDir,
FileSystem fs) |
|
void |
JsonSerialization.save(FileSystem fs,
Path path,
T instance,
boolean overwrite) |
Save to a Hadoop filesystem.
|
Copyright © 2008–2025 Apache Software Foundation. All rights reserved.