| Package | Description |
|---|---|
| org.apache.hadoop.tools |
DistCp is a tool for replicating data using MapReduce jobs for concurrent
copy operations.
|
| org.apache.hadoop.tools.mapred | |
| org.apache.hadoop.tools.util |
| Modifier and Type | Method | Description |
|---|---|---|
protected CopyListingFileStatus |
CopyListing.getFileListingValue(CopyListingFileStatus fileStatus) |
Returns the value for an entry in the copy listing sequence file.
|
| Modifier and Type | Method | Description |
|---|---|---|
java.util.LinkedList<CopyListingFileStatus> |
FileListingEntry.getCopyListingFileStatus() |
| Modifier and Type | Method | Description |
|---|---|---|
protected org.apache.hadoop.io.Text |
CopyListing.getFileListingKey(FileListingEntry listingEntry,
CopyListingFileStatus fileStatus) |
Returns the key for an entry in the copy listing sequence file.
|
protected CopyListingFileStatus |
CopyListing.getFileListingValue(CopyListingFileStatus fileStatus) |
Returns the value for an entry in the copy listing sequence file.
|
| Modifier and Type | Method | Description |
|---|---|---|
FileListingEntry |
FileListingEntry.setCopyListingFileStatus(java.util.LinkedList<CopyListingFileStatus> copyListingFileStatus) |
| Constructor | Description |
|---|---|
CopyListingFileStatus(CopyListingFileStatus other) |
| Modifier and Type | Method | Description |
|---|---|---|
org.apache.hadoop.mapreduce.RecordReader<org.apache.hadoop.io.Text,CopyListingFileStatus> |
UniformSizeInputFormat.createRecordReader(org.apache.hadoop.mapreduce.InputSplit split,
org.apache.hadoop.mapreduce.TaskAttemptContext context) |
Implementation of InputFormat::createRecordReader().
|
| Modifier and Type | Method | Description |
|---|---|---|
void |
CopyMapper.map(org.apache.hadoop.io.Text relPath,
CopyListingFileStatus sourceFileStatus,
org.apache.hadoop.mapreduce.Mapper.Context context) |
Implementation of the Mapper::map().
|
| Modifier and Type | Method | Description |
|---|---|---|
static CopyListingFileStatus |
DistCpUtils.toCopyListingFileStatusHelper(org.apache.hadoop.fs.FileSystem fileSystem,
org.apache.hadoop.fs.FileStatus fileStatus,
boolean preserveAcls,
boolean preserveXAttrs,
boolean preserveRawXAttrs,
long chunkOffset,
long chunkLength) |
Converts a FileStatus to a CopyListingFileStatus.
|
| Modifier and Type | Method | Description |
|---|---|---|
static org.apache.hadoop.fs.Path |
DistCpUtils.getSplitChunkPath(org.apache.hadoop.fs.Path targetFile,
CopyListingFileStatus srcFileStatus) |
|
static void |
DistCpUtils.preserve(org.apache.hadoop.fs.FileSystem targetFS,
org.apache.hadoop.fs.Path path,
CopyListingFileStatus srcFileStatus,
java.util.EnumSet<DistCpOptions.FileAttribute> attributes,
boolean preserveRawXattrs) |
Preserve attribute on file matching that of the file status being sent
as argument.
|
Copyright © 2008–2025 Apache Software Foundation. All rights reserved.