Package org.apache.hadoop.tools.mapred

Class CopyMapper

java.lang.Object

org.apache.hadoop.mapreduce.Mapper<org.apache.hadoop.io.Text,CopyListingFileStatus,org.apache.hadoop.io.Text,org.apache.hadoop.io.Text>

org.apache.hadoop.tools.mapred.CopyMapper

public class CopyMapper
extends org.apache.hadoop.mapreduce.Mapper<org.apache.hadoop.io.Text,CopyListingFileStatus,org.apache.hadoop.io.Text,org.apache.hadoop.io.Text>

Mapper class that executes the DistCp copy operation. Implements the o.a.h.mapreduce.Mapper interface.

Nested Class Summary

Nested Classes

Modifier and Type	Class	Description
static class	CopyMapper.ChecksumComparison	Indicates the checksum comparison result.
static class	CopyMapper.Counter	Hadoop counters for the DistCp CopyMapper.

Nested classes/interfaces inherited from class org.apache.hadoop.mapreduce.Mapper

org.apache.hadoop.mapreduce.Mapper.Context

Constructor Summary

Constructors

Constructor	Description
CopyMapper()

Method Summary

Modifier and Type	Method	Description
protected void	cleanup(org.apache.hadoop.mapreduce.Mapper.Context context)
void	map(org.apache.hadoop.io.Text relPath, CopyListingFileStatus sourceFileStatus, org.apache.hadoop.mapreduce.Mapper.Context context)	Implementation of the Mapper::map().
void	setup(org.apache.hadoop.mapreduce.Mapper.Context context)	Implementation of the Mapper::setup() method.

Methods inherited from class org.apache.hadoop.mapreduce.Mapper

run

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

CopyMapper

public CopyMapper()

Method Detail

setup

public void setup(org.apache.hadoop.mapreduce.Mapper.Context context)
           throws java.io.IOException,
                  java.lang.InterruptedException

Implementation of the Mapper::setup() method. This extracts the DistCp- options specified in the Job's configuration, to set up the Job.

Overrides:

setup in class org.apache.hadoop.mapreduce.Mapper<org.apache.hadoop.io.Text,CopyListingFileStatus,org.apache.hadoop.io.Text,org.apache.hadoop.io.Text>

Parameters:

context - Mapper's context.

Throws:

java.io.IOException - On IO failure.

java.lang.InterruptedException - If the job is interrupted.

map

public void map(org.apache.hadoop.io.Text relPath,
                CopyListingFileStatus sourceFileStatus,
                org.apache.hadoop.mapreduce.Mapper.Context context)
         throws java.io.IOException,
                java.lang.InterruptedException

Implementation of the Mapper::map(). Does the copy.

Overrides:

map in class org.apache.hadoop.mapreduce.Mapper<org.apache.hadoop.io.Text,CopyListingFileStatus,org.apache.hadoop.io.Text,org.apache.hadoop.io.Text>

Parameters:

relPath - The target path.

sourceFileStatus - The source path.

Throws:

java.io.IOException

java.lang.InterruptedException

cleanup

protected void cleanup(org.apache.hadoop.mapreduce.Mapper.Context context)
                throws java.io.IOException,
                       java.lang.InterruptedException

Overrides:

cleanup in class org.apache.hadoop.mapreduce.Mapper<org.apache.hadoop.io.Text,CopyListingFileStatus,org.apache.hadoop.io.Text,org.apache.hadoop.io.Text>

Throws:

java.io.IOException

java.lang.InterruptedException