Package org.apache.hadoop.crypto

Class CryptoOutputStream

java.lang.Object

java.io.OutputStream

java.io.FilterOutputStream

org.apache.hadoop.crypto.CryptoOutputStream

All Implemented Interfaces:

java.io.Closeable, java.io.Flushable, java.lang.AutoCloseable, CanSetDropBehind, IOStatisticsSource, StreamCapabilities, Syncable

@Private
@Evolving
public class CryptoOutputStream
extends java.io.FilterOutputStream
implements Syncable, CanSetDropBehind, StreamCapabilities, IOStatisticsSource

CryptoOutputStream encrypts data. It is not thread-safe. AES CTR mode is required in order to ensure that the plain text and cipher text have a 1:1 mapping. The encryption is buffer based. The key points of the encryption are (1) calculating counter and (2) padding through stream position.

counter = base + pos/(algorithm blocksize); padding = pos%(algorithm blocksize);

The underlying stream offset is maintained as state. Note that while some of this class' methods are synchronized, this is just to match the threadsafety behavior of DFSOutputStream. See HADOOP-11710.

Nested Class Summary

Nested classes/interfaces inherited from interface org.apache.hadoop.fs.StreamCapabilities

StreamCapabilities.StreamCapability

Field Summary

Fields inherited from class java.io.FilterOutputStream

out

Fields inherited from interface org.apache.hadoop.fs.StreamCapabilities

ABORTABLE_STREAM, DROPBEHIND, HFLUSH, HSYNC, IOSTATISTICS, IOSTATISTICS_CONTEXT, PREADBYTEBUFFER, READAHEAD, READBYTEBUFFER, UNBUFFER, VECTOREDIO

Constructor Summary

Constructors

Constructor	Description
CryptoOutputStream(java.io.OutputStream out, CryptoCodec codec, byte[] key, byte[] iv)
CryptoOutputStream(java.io.OutputStream out, CryptoCodec codec, byte[] key, byte[] iv, long streamOffset)
CryptoOutputStream(java.io.OutputStream out, CryptoCodec codec, byte[] key, byte[] iv, long streamOffset, boolean closeOutputStream)
CryptoOutputStream(java.io.OutputStream out, CryptoCodec codec, int bufferSize, byte[] key, byte[] iv)
CryptoOutputStream(java.io.OutputStream out, CryptoCodec codec, int bufferSize, byte[] key, byte[] iv, long streamOffset)
CryptoOutputStream(java.io.OutputStream out, CryptoCodec codec, int bufferSize, byte[] key, byte[] iv, long streamOffset, boolean closeOutputStream)

Method Summary

Modifier and Type	Method	Description
void	close()
void	flush()	To flush, we need to encrypt the data in the buffer and write to the underlying stream, then do the flush.
IOStatistics	getIOStatistics()	Return a statistics instance.
java.io.OutputStream	getWrappedStream()
boolean	hasCapability(java.lang.String capability)	Query the stream for a specific capability.
void	hflush()	Flush out the data in client's user buffer.
void	hsync()	Similar to posix fsync, flush out the data in client's user buffer all the way to the disk device (but the disk may have it in its cache).
void	setDropBehind(java.lang.Boolean dropCache)	Configure whether the stream should drop the cache.
void	sync()	Deprecated.
void	write(byte[] b, int off, int len)	Encryption is buffer based.
void	write(int b)

Methods inherited from class java.io.FilterOutputStream

write

Methods inherited from class java.io.OutputStream

nullOutputStream

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

CryptoOutputStream

public CryptoOutputStream(java.io.OutputStream out,
                          CryptoCodec codec,
                          int bufferSize,
                          byte[] key,
                          byte[] iv)
                   throws java.io.IOException

Throws:

java.io.IOException

CryptoOutputStream

public CryptoOutputStream(java.io.OutputStream out,
                          CryptoCodec codec,
                          int bufferSize,
                          byte[] key,
                          byte[] iv,
                          long streamOffset)
                   throws java.io.IOException

Throws:

java.io.IOException

CryptoOutputStream

public CryptoOutputStream(java.io.OutputStream out,
                          CryptoCodec codec,
                          int bufferSize,
                          byte[] key,
                          byte[] iv,
                          long streamOffset,
                          boolean closeOutputStream)
                   throws java.io.IOException

Throws:

java.io.IOException

CryptoOutputStream

public CryptoOutputStream(java.io.OutputStream out,
                          CryptoCodec codec,
                          byte[] key,
                          byte[] iv)
                   throws java.io.IOException

Throws:

java.io.IOException

CryptoOutputStream

public CryptoOutputStream(java.io.OutputStream out,
                          CryptoCodec codec,
                          byte[] key,
                          byte[] iv,
                          long streamOffset)
                   throws java.io.IOException

Throws:

java.io.IOException

CryptoOutputStream

public CryptoOutputStream(java.io.OutputStream out,
                          CryptoCodec codec,
                          byte[] key,
                          byte[] iv,
                          long streamOffset,
                          boolean closeOutputStream)
                   throws java.io.IOException

Throws:

java.io.IOException

Method Detail

getWrappedStream

public java.io.OutputStream getWrappedStream()

write

public void write(byte[] b,
                  int off,
                  int len)
           throws java.io.IOException

Encryption is buffer based. If there is enough room in inBuffer, then write to this buffer. If inBuffer is full, then do encryption and write data to the underlying stream.

Overrides:

write in class java.io.FilterOutputStream

Parameters:

b - the data.

off - the start offset in the data.

len - the number of bytes to write.

Throws:

java.io.IOException - raised on errors performing I/O.

close

public void close()
           throws java.io.IOException

Specified by:

close in interface java.lang.AutoCloseable

Specified by:

close in interface java.io.Closeable

Overrides:

close in class java.io.FilterOutputStream

Throws:

java.io.IOException

flush

public void flush()
           throws java.io.IOException

To flush, we need to encrypt the data in the buffer and write to the underlying stream, then do the flush.

Specified by:

flush in interface java.io.Flushable

Overrides:

flush in class java.io.FilterOutputStream

Throws:

java.io.IOException

write

public void write(int b)
           throws java.io.IOException

Overrides:

write in class java.io.FilterOutputStream

Throws:

java.io.IOException

setDropBehind

public void setDropBehind(java.lang.Boolean dropCache)
                   throws java.io.IOException,
                          java.lang.UnsupportedOperationException

Description copied from interface: CanSetDropBehind

Configure whether the stream should drop the cache.

Specified by:

setDropBehind in interface CanSetDropBehind

Parameters:

dropCache - Whether to drop the cache. null means to use the default value.

Throws:

java.io.IOException - If there was an error changing the dropBehind setting. UnsupportedOperationException If this stream doesn't support setting the drop-behind.

java.lang.UnsupportedOperationException

hflush

public void hflush()
            throws java.io.IOException

Description copied from interface: Syncable

Flush out the data in client's user buffer. After the return of this call, new readers will see the data.

Specified by:

hflush in interface Syncable

Throws:

java.io.IOException - if any error occurs

hsync

public void hsync()
           throws java.io.IOException

Description copied from interface: Syncable

Similar to posix fsync, flush out the data in client's user buffer all the way to the disk device (but the disk may have it in its cache).

Specified by:

hsync in interface Syncable

Throws:

java.io.IOException - if error occurs

sync

@Deprecated
public void sync()
          throws java.io.IOException

Deprecated.

Specified by:

sync in interface Syncable

Throws:

java.io.IOException

See Also:

Syncable.hflush()

hasCapability

public boolean hasCapability(java.lang.String capability)

Description copied from interface: StreamCapabilities

Query the stream for a specific capability.

Specified by:

hasCapability in interface StreamCapabilities

Parameters:

capability - string to query the stream support for.

Returns:

True if the stream supports capability.

getIOStatistics

public IOStatistics getIOStatistics()

Description copied from interface: IOStatisticsSource

Return a statistics instance.

It is not a requirement that the same instance is returned every time. IOStatisticsSource.

If the object implementing this is Closeable, this method may return null if invoked on a closed object, even if it returns a valid instance when called earlier.

Specified by:

getIOStatistics in interface IOStatisticsSource

Returns:

an IOStatistics instance or null