Package org.apache.hadoop.fs.azurebfs.services

Class AbfsOutputStreamStatisticsImpl

java.lang.Object

org.apache.hadoop.fs.azurebfs.services.AbfsOutputStreamStatisticsImpl

All Implemented Interfaces:

AbfsOutputStreamStatistics, org.apache.hadoop.fs.statistics.IOStatisticsSource, org.apache.hadoop.fs.store.BlockUploadStatistics

public class AbfsOutputStreamStatisticsImpl
extends java.lang.Object
implements AbfsOutputStreamStatistics

OutputStream statistics implementation for Abfs.

Constructor Summary

Constructors

Constructor	Description
AbfsOutputStreamStatisticsImpl()

Method Summary

Modifier and Type	Method	Description
void	blockAllocated()	Increment the counter to indicate a block has been allocated.
void	blockReleased()	Increment the counter to indicate a block has been released.
void	bytesToUpload(long bytes)	Records the need to upload bytes and increments the total bytes that needs to be uploaded.
long	getBytesToUpload()
long	getBytesUploadFailed()
long	getBytesUploadSuccessful()
org.apache.hadoop.fs.statistics.IOStatistics	getIOStatistics()	Get the IOStatisticsStore instance from AbfsOutputStreamStatistics.
long	getQueueShrunkOps()
double	getTimeSpentOnPutRequest()	Getter for mean value of time taken to complete a PUT request by AbfsOutputStream.
long	getTimeSpentOnTaskWait()
long	getWriteCurrentBufferOperations()
void	queueShrunk()	Number of times task queue is shrunk.
org.apache.hadoop.fs.statistics.DurationTracker	timeSpentTaskWait()	Time spent in waiting for tasks to be completed in the blocking queue.
java.lang.String	toString()	String to show AbfsOutputStream statistics values in AbfsOutputStream.
void	uploadFailed(long bytes)	Records the total bytes failed to upload through AbfsOutputStream.
void	uploadSuccessful(long bytes)	Records the total bytes successfully uploaded through AbfsOutputStream.
void	writeCurrentBuffer()	Number of times buffer is written to the service after a write operation.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, wait, wait, wait

Constructor Detail

AbfsOutputStreamStatisticsImpl

public AbfsOutputStreamStatisticsImpl()

Method Detail

bytesToUpload

public void bytesToUpload(long bytes)

Records the need to upload bytes and increments the total bytes that needs to be uploaded.

Specified by:

bytesToUpload in interface AbfsOutputStreamStatistics

Parameters:

bytes - total bytes to upload. Negative bytes are ignored.

uploadSuccessful

public void uploadSuccessful(long bytes)

Records the total bytes successfully uploaded through AbfsOutputStream.

Specified by:

uploadSuccessful in interface AbfsOutputStreamStatistics

Parameters:

bytes - number of bytes that were successfully uploaded. Negative bytes are ignored.

uploadFailed

public void uploadFailed(long bytes)

Records the total bytes failed to upload through AbfsOutputStream.

Specified by:

uploadFailed in interface AbfsOutputStreamStatistics

Parameters:

bytes - number of bytes failed to upload. Negative bytes are ignored.

timeSpentTaskWait

public org.apache.hadoop.fs.statistics.DurationTracker timeSpentTaskWait()

Time spent in waiting for tasks to be completed in the blocking queue. Records the total time spent waiting for a task to complete. When the thread executor has a task queue BlockingQueue of size greater than or equal to 2 times the maxConcurrentRequestCounts then, it waits for a task in that queue to finish, then do the next task in the queue. This time spent while waiting for the task to be completed is being recorded in this counter.

Specified by:

timeSpentTaskWait in interface AbfsOutputStreamStatistics

Returns:

instance of the DurationTracker that tracks the time for waiting.

queueShrunk

public void queueShrunk()

Number of times task queue is shrunk. Records the number of times AbfsOutputStream try to remove the completed write operations from the beginning of write operation task queue.

Specified by:

queueShrunk in interface AbfsOutputStreamStatistics

writeCurrentBuffer

public void writeCurrentBuffer()

Number of times buffer is written to the service after a write operation. Records the number of times AbfsOutputStream writes the buffer to the service via the AbfsClient and appends the buffer to the service.

Specified by:

writeCurrentBuffer in interface AbfsOutputStreamStatistics

blockAllocated

public void blockAllocated()

Increment the counter to indicate a block has been allocated.

Specified by:

blockAllocated in interface org.apache.hadoop.fs.store.BlockUploadStatistics

blockReleased

public void blockReleased()

Increment the counter to indicate a block has been released.

Specified by:

blockReleased in interface org.apache.hadoop.fs.store.BlockUploadStatistics

getIOStatistics

public org.apache.hadoop.fs.statistics.IOStatistics getIOStatistics()

Get the IOStatisticsStore instance from AbfsOutputStreamStatistics. A getter for IOStatisticsStore instance which extends IOStatistics.

Specified by:

getIOStatistics in interface AbfsOutputStreamStatistics

Specified by:

getIOStatistics in interface org.apache.hadoop.fs.statistics.IOStatisticsSource

Returns:

IOStatisticsStore instance.

getBytesToUpload

@VisibleForTesting
public long getBytesToUpload()

getBytesUploadSuccessful

@VisibleForTesting
public long getBytesUploadSuccessful()

getBytesUploadFailed

@VisibleForTesting
public long getBytesUploadFailed()

getTimeSpentOnTaskWait

@VisibleForTesting
public long getTimeSpentOnTaskWait()

getQueueShrunkOps

@VisibleForTesting
public long getQueueShrunkOps()

getWriteCurrentBufferOperations

@VisibleForTesting
public long getWriteCurrentBufferOperations()

getTimeSpentOnPutRequest

@VisibleForTesting
public double getTimeSpentOnPutRequest()

Getter for mean value of time taken to complete a PUT request by AbfsOutputStream.

Returns:

mean value.

toString

public java.lang.String toString()

String to show AbfsOutputStream statistics values in AbfsOutputStream.

Specified by:

toString in interface AbfsOutputStreamStatistics

Overrides:

toString in class java.lang.Object

Returns:

String with AbfsOutputStream statistics.