com.mapr.db.mapreduce

Class BulkLoadOutputFormat

java.lang.Object

org.apache.hadoop.mapreduce.OutputFormat<ByteBufWritableComparable,org.ojai.Document>

com.mapr.db.mapreduce.BulkLoadOutputFormat

All Implemented Interfaces:

org.apache.hadoop.conf.Configurable

public class BulkLoadOutputFormat
extends org.apache.hadoop.mapreduce.OutputFormat<ByteBufWritableComparable,org.ojai.Document>
implements org.apache.hadoop.conf.Configurable

This class defines the OutputFormat to be used when Ojai documents have to be imported into MapR Document-DB

Field Summary

Fields

Modifier and Type	Field and Description
static String	OUTPUT_TABLE

Constructor Summary

Constructors

Constructor and Description
BulkLoadOutputFormat()

Method Summary

Methods

Modifier and Type	Method and Description
void	checkOutputSpecs(org.apache.hadoop.mapreduce.JobContext context)
org.apache.hadoop.conf.Configuration	getConf()
org.apache.hadoop.mapreduce.OutputCommitter	getOutputCommitter(org.apache.hadoop.mapreduce.TaskAttemptContext context)
static List<ByteBufWritableComparable>	getPartitionSplitPoints(String tabName)
org.apache.hadoop.mapreduce.RecordWriter<ByteBufWritableComparable,org.ojai.Document>	getRecordWriter(org.apache.hadoop.mapreduce.TaskAttemptContext context)
void	setConf(org.apache.hadoop.conf.Configuration conf)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

OUTPUT_TABLE

public static final String OUTPUT_TABLE

See Also:

Constant Field Values

Constructor Detail

BulkLoadOutputFormat

public BulkLoadOutputFormat()

Method Detail

setConf

public void setConf(org.apache.hadoop.conf.Configuration conf)

Specified by:

setConf in interface org.apache.hadoop.conf.Configurable

getConf

public org.apache.hadoop.conf.Configuration getConf()

Specified by:

getConf in interface org.apache.hadoop.conf.Configurable

getRecordWriter

public org.apache.hadoop.mapreduce.RecordWriter<ByteBufWritableComparable,org.ojai.Document> getRecordWriter(org.apache.hadoop.mapreduce.TaskAttemptContext context)
                                                                                                      throws IOException,
                                                                                                             InterruptedException

Specified by:

getRecordWriter in class org.apache.hadoop.mapreduce.OutputFormat<ByteBufWritableComparable,org.ojai.Document>

Throws:

IOException

InterruptedException

checkOutputSpecs

public void checkOutputSpecs(org.apache.hadoop.mapreduce.JobContext context)
                      throws IOException,
                             InterruptedException

Specified by:

checkOutputSpecs in class org.apache.hadoop.mapreduce.OutputFormat<ByteBufWritableComparable,org.ojai.Document>

Throws:

IOException

InterruptedException

getOutputCommitter

public org.apache.hadoop.mapreduce.OutputCommitter getOutputCommitter(org.apache.hadoop.mapreduce.TaskAttemptContext context)
                                                               throws IOException,
                                                                      InterruptedException

Specified by:

getOutputCommitter in class org.apache.hadoop.mapreduce.OutputFormat<ByteBufWritableComparable,org.ojai.Document>

Throws:

IOException

InterruptedException

getPartitionSplitPoints

public static List<ByteBufWritableComparable> getPartitionSplitPoints(String tabName)
                                                               throws IOException

Parameters:

tabName -

Returns:

List of partitioning split points for TotalOrderPartitioner

Throws:

IOException