Package org.apache.hadoop.metrics2.sink

Class KafkaSink

java.lang.Object

org.apache.hadoop.metrics2.sink.KafkaSink

All Implemented Interfaces:

java.io.Closeable, java.lang.AutoCloseable, org.apache.hadoop.metrics2.MetricsPlugin, org.apache.hadoop.metrics2.MetricsSink

@Public
@Evolving
public class KafkaSink
extends java.lang.Object
implements org.apache.hadoop.metrics2.MetricsSink, java.io.Closeable

A metrics sink that writes to a Kafka broker. This requires you to configure a broker_list and a topic in the metrics2 configuration file. The broker_list must contain a comma-separated list of kafka broker host and ports. The topic will contain only one topic.

Field Summary

Fields

Modifier and Type	Field	Description
static java.lang.String	BROKER_LIST
static java.lang.String	TOPIC

Constructor Summary

Constructors

Constructor	Description
KafkaSink()

Method Summary

Modifier and Type	Method	Description
void	close()
void	flush()
void	init(org.apache.commons.configuration2.SubsetConfiguration conf)
void	putMetrics(org.apache.hadoop.metrics2.MetricsRecord record)
void	setProducer(org.apache.kafka.clients.producer.Producer<java.lang.Integer,byte[]> p)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

BROKER_LIST

public static final java.lang.String BROKER_LIST

See Also:

Constant Field Values

TOPIC

public static final java.lang.String TOPIC

See Also:

Constant Field Values

Constructor Detail

KafkaSink

public KafkaSink()

Method Detail

setProducer

public void setProducer(org.apache.kafka.clients.producer.Producer<java.lang.Integer,byte[]> p)

init

public void init(org.apache.commons.configuration2.SubsetConfiguration conf)

Specified by:

init in interface org.apache.hadoop.metrics2.MetricsPlugin

putMetrics

public void putMetrics(org.apache.hadoop.metrics2.MetricsRecord record)

Specified by:

putMetrics in interface org.apache.hadoop.metrics2.MetricsSink

flush

public void flush()

Specified by:

flush in interface org.apache.hadoop.metrics2.MetricsSink

close

public void close()
           throws java.io.IOException

Specified by:

close in interface java.lang.AutoCloseable

Specified by:

close in interface java.io.Closeable

Throws:

java.io.IOException