| Class | Description |
|---|---|
| CopyCommitter |
The CopyCommitter class is DistCp's OutputCommitter implementation.
|
| CopyFilter |
Interface for excluding files from DistCp.
|
| CopyListing |
The CopyListing abstraction is responsible for how the list of
sources and targets is constructed, for DistCp's copy function.
|
| CopyListing.AclsNotSupportedException | |
| CopyListing.XAttrsNotSupportedException | |
| CopyListingFileStatus |
CopyListingFileStatus is a view of
FileStatus, recording additional
data members useful to distcp. |
| CopyMapper |
Mapper class that executes the DistCp copy operation.
|
| CopyMapper.ChecksumComparison |
Indicates the checksum comparison result.
|
| CopyMapper.Counter |
Hadoop counters for the DistCp CopyMapper.
|
| CopyOutputFormat<K,V> |
The CopyOutputFormat is the Hadoop OutputFormat used in DistCp.
|
| DistCp |
DistCp is the main driver-class for DistCpV2.
|
| DistCpConstants |
Utility class to hold commonly used constants.
|
| DistCpContext |
This is the context of the distcp at runtime.
|
| DistCpOptions |
The Options class encapsulates all DistCp options.
|
| DistCpOptions.Builder |
The builder of the
DistCpOptions. |
| DistCpOptions.FileAttribute |
File attributes for preserve.
|
| DistCpOptionSwitch |
Enumeration mapping configuration keys to distcp command line
options.
|
| DistCpUtils |
Utility functions used in DistCp.
|
| DynamicInputFormat<K,V> |
DynamicInputFormat implements the "Worker pattern" for DistCp.
|
| DynamicRecordReader<K,V> |
The DynamicRecordReader is used in conjunction with the DynamicInputFormat
to implement the "Worker pattern" for DistCp.
|
| FileBasedCopyListing |
FileBasedCopyListing implements the CopyListing interface,
to create the copy-listing for DistCp,
by iterating over all source paths mentioned in a specified input-file.
|
| FileListingEntry | |
| GlobbedCopyListing |
GlobbedCopyListing implements the CopyListing interface, to create the copy
listing-file by "globbing" all specified source paths (wild-cards and all.)
|
| OptionsParser |
The OptionsParser parses out the command-line options passed to DistCp,
and interprets those specific to DistCp, to create an Options object.
|
| ProducerConsumer<T,R> |
ProducerConsumer class encapsulates input and output queues and a
thread-pool of Workers that loop on WorkRequest<T> inputQueue
and for each consumed WorkRequest Workers invoke
WorkRequestProcessor.processItem() and output resulting
WorkReport<R> to the outputQueue.
|
| RegexCopyFilter |
A CopyFilter which compares Java Regex Patterns to each Path to determine
whether a file should be copied.
|
| RegexpInConfigurationFilter |
Implementation of regex based filter for DistCp.
|
| RetriableCommand |
This class represents commands that be retried on failure, in a configurable
manner.
|
| RetriableDirectoryCreateCommand |
This class extends Retriable command to implement the creation of directories
with retries on failure.
|
| RetriableFileCopyCommand |
This class extends RetriableCommand to implement the copy of files,
with retries on failure.
|
| RetriableFileCopyCommand.CopyReadException |
Special subclass of IOException.
|
| SimpleCopyListing |
The SimpleCopyListing is responsible for making the exhaustive list of
all files/directories under its specified list of input-paths.
|
| ThrottledInputStream |
The ThrottleInputStream provides bandwidth throttling on a specified
InputStream.
|
| TrueCopyFilter |
A CopyFilter which always returns true.
|
| UniformSizeInputFormat |
UniformSizeInputFormat extends the InputFormat class, to produce
input-splits for DistCp.
|
| WorkReport<T> |
WorkReport<T> is a simple container for items of class T and its
corresponding retry counter that indicates how many times this item
was previously attempted to be processed.
|
| WorkRequest<T> |
WorkRequest<T> is a simple container for items of class T and its
corresponding retry counter that indicates how many times this item
was previously attempted to be processed.
|
| WorkRequestProcessor<T,R> |
Interface for ProducerConsumer worker loop.
|
Copyright © 2008–2025 Apache Software Foundation. All rights reserved.