com.mapr.db.mapreduce.impl

Class RangeChecksumInputFormat

java.lang.Object

org.apache.hadoop.mapreduce.InputFormat<org.ojai.Value,org.ojai.Document>

com.mapr.db.mapreduce.TableInputFormat

com.mapr.db.mapreduce.impl.RangeChecksumInputFormat

All Implemented Interfaces:

org.apache.hadoop.conf.Configurable

public class RangeChecksumInputFormat
extends TableInputFormat

Field Summary

Fields

Modifier and Type	Field and Description
static java.lang.String	INCLUDEDREGIONFILENAME
static java.lang.String	SPLITFILENAME

Fields inherited from class com.mapr.db.mapreduce.TableInputFormat

cond, COND_OBJ, EXCLUDE_EMBEDDEDFAMILY, FIELD_PATH, GET_DELETES, INPUT_TABLE, jTable, READ_ALL_CFS, START_ROW, STOP_ROW

Constructor Summary

Constructors

Constructor and Description
RangeChecksumInputFormat()

Method Summary

Modifier and Type	Method and Description
java.util.List<org.apache.hadoop.mapreduce.InputSplit>	getSplits(org.apache.hadoop.mapreduce.JobContext context) Set up the splits which will be served as inputs to map tasks.
ByteBufWritableComparable	getSplitStartKey(ByteBufWritableComparable key)
protected boolean	includeRegionInSplit(byte[] startKey, byte[] endKey)
void	setConf(org.apache.hadoop.conf.Configuration configuration) This function is used to set parameters in the configuration.

Methods inherited from class com.mapr.db.mapreduce.TableInputFormat

createRecordReader, getConf

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

SPLITFILENAME

public static final java.lang.String SPLITFILENAME

See Also:

Constant Field Values

INCLUDEDREGIONFILENAME

public static final java.lang.String INCLUDEDREGIONFILENAME

See Also:

Constant Field Values

Constructor Detail

RangeChecksumInputFormat

public RangeChecksumInputFormat()

Method Detail

setConf

public void setConf(org.apache.hadoop.conf.Configuration configuration)

Description copied from class: TableInputFormat

This function is used to set parameters in the configuration. This is used to set relevant parameters for scanning JSON tables.

Specified by:

setConf in interface org.apache.hadoop.conf.Configurable

Overrides:

setConf in class TableInputFormat

Parameters:

configuration - Configuration object with parameters for TableInputFormat.

See Also:

Configurable.setConf( org.apache.hadoop.conf.Configuration)

getSplitStartKey

public ByteBufWritableComparable getSplitStartKey(ByteBufWritableComparable key)

includeRegionInSplit

protected boolean includeRegionInSplit(byte[] startKey,
                                       byte[] endKey)

getSplits

public java.util.List<org.apache.hadoop.mapreduce.InputSplit> getSplits(org.apache.hadoop.mapreduce.JobContext context)
                                                                 throws java.io.IOException,
                                                                        java.lang.InterruptedException

Description copied from class: TableInputFormat

Set up the splits which will be served as inputs to map tasks. The number of splits are same as the number of tablets for regular JSON tables. In case of marlin tables, if there is a topicPartition shared between two tablets, they are considered to be part of same split.

Overrides:

getSplits in class TableInputFormat

Parameters:

context - The current job context.

Returns:

List of input splits.

Throws:

java.io.IOException

java.lang.InterruptedException

See Also:

InputFormat.getSplits(org.apache.hadoop.mapreduce.JobContext)