| Package | Description |
|---|---|
| org.apache.hadoop.fs |
An abstract file system API.
|
| org.apache.hadoop.fs.shell |
Support for the execution of a file system command.
|
| org.apache.hadoop.fs.viewfs |
ViewFileSystem and ViewFileSystemOverloadScheme classes.
|
| org.apache.hadoop.util.functional |
Support for functional programming within the Hadoop APIs.
|
| Modifier and Type | Class | Description |
|---|---|---|
class |
BatchedRemoteIterator<K,E> |
A RemoteIterator that fetches elements in batches.
|
protected class |
FileSystem.DirListingIterator<T extends FileStatus> |
Generic iterator for implementing
FileSystem.listStatusIterator(Path). |
| Modifier and Type | Method | Description |
|---|---|---|
RemoteIterator<PartialListing<LocatedFileStatus>> |
BatchListingOperations.batchedListLocatedStatusIterator(java.util.List<Path> paths) |
Batched listing API that returns
PartialListings for the passed
Paths. |
RemoteIterator<PartialListing<FileStatus>> |
BatchListingOperations.batchedListStatusIterator(java.util.List<Path> paths) |
Batched listing API that returns
PartialListings for the
passed Paths. |
RemoteIterator<Path> |
AbstractFileSystem.listCorruptFileBlocks(Path path) |
|
RemoteIterator<Path> |
FileContext.listCorruptFileBlocks(Path path) |
List CorruptFile Blocks.
|
RemoteIterator<Path> |
FileSystem.listCorruptFileBlocks(Path path) |
List corrupted file blocks.
|
RemoteIterator<Path> |
FilterFileSystem.listCorruptFileBlocks(Path path) |
|
RemoteIterator<Path> |
FilterFs.listCorruptFileBlocks(Path path) |
|
RemoteIterator<LocatedFileStatus> |
FileContext.Util.listFiles(Path f,
boolean recursive) |
List the statuses and block locations of the files in the given path.
|
RemoteIterator<LocatedFileStatus> |
FileSystem.listFiles(Path f,
boolean recursive) |
List the statuses and block locations of the files in the given path.
|
RemoteIterator<LocatedFileStatus> |
AbstractFileSystem.listLocatedStatus(Path f) |
The specification of this method matches that of
FileContext.listLocatedStatus(Path) except that Path f
must be for this file system. |
RemoteIterator<LocatedFileStatus> |
ChecksumFileSystem.listLocatedStatus(Path f) |
List the statuses of the files/directories in the given path if the path is
a directory.
|
RemoteIterator<LocatedFileStatus> |
ChecksumFs.listLocatedStatus(Path f) |
|
RemoteIterator<LocatedFileStatus> |
FileContext.listLocatedStatus(Path f) |
List the statuses of the files/directories in the given path if the path is
a directory.
|
RemoteIterator<LocatedFileStatus> |
FileSystem.listLocatedStatus(Path f) |
List the statuses of the files/directories in the given path if the path is
a directory.
|
protected RemoteIterator<LocatedFileStatus> |
FileSystem.listLocatedStatus(Path f,
PathFilter filter) |
List a directory.
|
RemoteIterator<LocatedFileStatus> |
FilterFileSystem.listLocatedStatus(Path f) |
List files and its block locations in a directory.
|
protected RemoteIterator<LocatedFileStatus> |
FilterFileSystem.listLocatedStatus(Path f,
PathFilter filter) |
|
RemoteIterator<LocatedFileStatus> |
FilterFs.listLocatedStatus(Path f) |
|
RemoteIterator<FileStatus> |
FileContext.listStatus(Path f) |
List the statuses of the files/directories in the given path if the path is
a directory.
|
RemoteIterator<FileStatus> |
AbstractFileSystem.listStatusIterator(Path f) |
The specification of this method matches that of
FileContext.listStatus(Path) except that Path f must be for this
file system. |
RemoteIterator<FileStatus> |
ChecksumFileSystem.listStatusIterator(Path p) |
|
RemoteIterator<FileStatus> |
FileSystem.listStatusIterator(Path p) |
Returns a remote iterator so that followup calls are made on demand
while consuming the entries.
|
RemoteIterator<FileStatus> |
FilterFileSystem.listStatusIterator(Path f) |
Return a remote iterator for listing in a directory
|
| Modifier and Type | Method | Description |
|---|---|---|
RemoteIterator<PathData> |
PathData.getDirectoryContentsIterator() |
Returns a RemoteIterator for PathData objects of the items contained in the
given directory.
|
| Modifier and Type | Method | Description |
|---|---|---|
protected void |
Command.processPaths(PathData parent,
RemoteIterator<PathData> itemsIterator) |
Iterates over the given expanded paths and invokes
Command.processPath(PathData) on each element. |
| Modifier and Type | Method | Description |
|---|---|---|
RemoteIterator<LocatedFileStatus> |
ViewFileSystem.listLocatedStatus(Path f,
PathFilter filter) |
|
RemoteIterator<LocatedFileStatus> |
ViewFs.listLocatedStatus(Path f) |
|
RemoteIterator<FileStatus> |
ViewFs.listStatusIterator(Path f) |
| Modifier and Type | Class | Description |
|---|---|---|
static class |
RemoteIterators.WrappingRemoteIterator<S,T> |
Wrapper of another remote iterator; IOStatistics
and Closeable methods are passed down if implemented.
|
| Modifier and Type | Method | Description |
|---|---|---|
static <S> RemoteIterator<S> |
RemoteIterators.closingRemoteIterator(RemoteIterator<S> iterator,
java.io.Closeable toClose) |
This adds an extra close operation alongside the passthrough
to any Closeable.close() method supported by the source iterator.
|
static <S> RemoteIterator<S> |
RemoteIterators.filteringRemoteIterator(RemoteIterator<S> iterator,
FunctionRaisingIOE<? super S,java.lang.Boolean> filter) |
Create a RemoteIterator from a RemoteIterator and a filter
function which returns true for every element to be passed
through.
|
protected RemoteIterator<S> |
RemoteIterators.WrappingRemoteIterator.getSource() |
|
static <S> RemoteIterator<S> |
RemoteIterators.haltableRemoteIterator(RemoteIterator<S> iterator,
CallableRaisingIOE<java.lang.Boolean> continueWork) |
Wrap an iterator with one which adds a continuation probe.
|
static <S,T> |
RemoteIterators.mappingRemoteIterator(RemoteIterator<S> iterator,
FunctionRaisingIOE<? super S,T> mapper) |
Create an iterator from an iterator and a transformation function.
|
static RemoteIterator<java.lang.Long> |
RemoteIterators.rangeExcludingIterator(long start,
long excludedFinish) |
A remote iterator which simply counts up, stopping once the
value is greater than the value of
excludedFinish. |
static <T> RemoteIterator<T> |
RemoteIterators.remoteIteratorFromArray(T[] array) |
Create a remote iterator from an array.
|
static <T> RemoteIterator<T> |
RemoteIterators.remoteIteratorFromIterable(java.lang.Iterable<T> iterable) |
Create a remote iterator from a java.util.Iterable -e.g.
|
static <T> RemoteIterator<T> |
RemoteIterators.remoteIteratorFromIterator(java.util.Iterator<T> iterator) |
Create a remote iterator from a java.util.Iterator.
|
static <T> RemoteIterator<T> |
RemoteIterators.remoteIteratorFromSingleton(T singleton) |
Create an iterator from a singleton.
|
static <S,T> |
RemoteIterators.typeCastingRemoteIterator(RemoteIterator<S> iterator) |
Create a RemoteIterator from a RemoteIterator, casting the
type in the process.
|
| Modifier and Type | Method | Description |
|---|---|---|
static <T> void |
RemoteIterators.cleanupRemoteIterator(RemoteIterator<T> source) |
Clean up after an iteration.
|
static <S> RemoteIterator<S> |
RemoteIterators.closingRemoteIterator(RemoteIterator<S> iterator,
java.io.Closeable toClose) |
This adds an extra close operation alongside the passthrough
to any Closeable.close() method supported by the source iterator.
|
static <S> RemoteIterator<S> |
RemoteIterators.filteringRemoteIterator(RemoteIterator<S> iterator,
FunctionRaisingIOE<? super S,java.lang.Boolean> filter) |
Create a RemoteIterator from a RemoteIterator and a filter
function which returns true for every element to be passed
through.
|
static <T> long |
RemoteIterators.foreach(RemoteIterator<T> source,
ConsumerRaisingIOE<? super T> consumer) |
Apply an operation to all values of a RemoteIterator.
|
static <I> TaskPool.Builder<I> |
TaskPool.foreach(RemoteIterator<I> items) |
Create a task builder for the remote iterator.
|
static <S> RemoteIterator<S> |
RemoteIterators.haltableRemoteIterator(RemoteIterator<S> iterator,
CallableRaisingIOE<java.lang.Boolean> continueWork) |
Wrap an iterator with one which adds a continuation probe.
|
static <S,T> |
RemoteIterators.mappingRemoteIterator(RemoteIterator<S> iterator,
FunctionRaisingIOE<? super S,T> mapper) |
Create an iterator from an iterator and a transformation function.
|
static <T> T[] |
RemoteIterators.toArray(RemoteIterator<T> source,
T[] a) |
Build an array from a RemoteIterator.
|
static <T> java.util.List<T> |
RemoteIterators.toList(RemoteIterator<T> source) |
Build a list from a RemoteIterator.
|
static <S,T> |
RemoteIterators.typeCastingRemoteIterator(RemoteIterator<S> iterator) |
Create a RemoteIterator from a RemoteIterator, casting the
type in the process.
|
| Constructor | Description |
|---|---|
WrappingRemoteIterator(RemoteIterator<S> source) |
Copyright © 2008–2025 Apache Software Foundation. All rights reserved.