Package org.apache.hadoop.fs.impl

Class AbstractMultipartUploader

java.lang.Object

org.apache.hadoop.fs.impl.AbstractMultipartUploader

All Implemented Interfaces:

java.io.Closeable, java.lang.AutoCloseable, MultipartUploader, IOStatisticsSource

Direct Known Subclasses:

FileSystemMultipartUploader

public abstract class AbstractMultipartUploader
extends java.lang.Object
implements MultipartUploader

Standard base class for Multipart Uploaders.

Constructor Summary

Constructors

Modifier	Constructor	Description
protected	AbstractMultipartUploader(Path basePath)	Instantiate.

Method Summary

Modifier and Type	Method	Description
java.util.concurrent.CompletableFuture<java.lang.Integer>	abortUploadsUnderPath(Path path)	Best effort attempt to aborts multipart uploads under a path.
protected void	checkPartHandles(java.util.Map<java.lang.Integer,PartHandle> partHandles)	Utility method to validate partHandles.
protected void	checkPath(Path path)	Validate a path.
protected void	checkPutArguments(Path filePath, java.io.InputStream inputStream, int partNumber, UploadHandle uploadId, long lengthInBytes)	Check all the arguments to the MultipartUploader.putPart(UploadHandle, int, Path, InputStream, long) operation.
protected void	checkUploadId(byte[] uploadId)	Utility method to validate uploadIDs.
void	close()	Perform any cleanup.
protected Path	getBasePath()

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface org.apache.hadoop.fs.statistics.IOStatisticsSource

getIOStatistics

Methods inherited from interface org.apache.hadoop.fs.MultipartUploader

abort, complete, putPart, startUpload

Constructor Detail

AbstractMultipartUploader

protected AbstractMultipartUploader(Path basePath)

Instantiate.

Parameters:

basePath - base path

Method Detail

close

public void close()
           throws java.io.IOException

Perform any cleanup. The upload is not required to support any operations after this.

Specified by:

close in interface java.lang.AutoCloseable

Specified by:

close in interface java.io.Closeable

Throws:

java.io.IOException - problems on close.

getBasePath

protected Path getBasePath()

checkPath

protected void checkPath(Path path)

Validate a path.

Parameters:

path - path to check.

checkUploadId

protected void checkUploadId(byte[] uploadId)
                      throws java.lang.IllegalArgumentException

Utility method to validate uploadIDs.

Parameters:

uploadId - Upload ID

Throws:

java.lang.IllegalArgumentException - invalid ID

checkPartHandles

protected void checkPartHandles(java.util.Map<java.lang.Integer,PartHandle> partHandles)

Utility method to validate partHandles.

Parameters:

partHandles - handles

Throws:

java.lang.IllegalArgumentException - if the parts are invalid

checkPutArguments

protected void checkPutArguments(Path filePath,
                                 java.io.InputStream inputStream,
                                 int partNumber,
                                 UploadHandle uploadId,
                                 long lengthInBytes)
                          throws java.lang.IllegalArgumentException

Check all the arguments to the MultipartUploader.putPart(UploadHandle, int, Path, InputStream, long) operation.

Parameters:

filePath - Target path for upload (as MultipartUploader.startUpload(Path)).

inputStream - Data for this part. Implementations MUST close this stream after reading in the data.

partNumber - Index of the part relative to others.

uploadId - Identifier from MultipartUploader.startUpload(Path).

lengthInBytes - Target length to read from the stream.

Throws:

java.lang.IllegalArgumentException - invalid argument

abortUploadsUnderPath

public java.util.concurrent.CompletableFuture<java.lang.Integer> abortUploadsUnderPath(Path path)
                                                                                throws java.io.IOException

Best effort attempt to aborts multipart uploads under a path. Not all implementations support this, and those which do may be vulnerable to eventually consistent listings of current uploads -some may be missed..

Specified by:

abortUploadsUnderPath in interface MultipartUploader

Parameters:

path - path to abort uploads under.

Returns:

a future to -1.

Throws:

java.io.IOException - raised on errors performing I/O.