Package org.apache.hadoop.fs.cosn

Class CosNOutputStream

java.lang.Object

java.io.OutputStream

org.apache.hadoop.fs.cosn.CosNOutputStream

All Implemented Interfaces:

java.io.Closeable, java.io.Flushable, java.lang.AutoCloseable

public class CosNOutputStream
extends java.io.OutputStream

The output stream for the COS blob store. Implement streaming upload to COS based on the multipart upload function. ( the maximum size of each part is 5GB) Support up to 40TB single file by multipart upload (each part is 5GB). Improve the upload performance of writing large files by using byte buffers and a fixed thread pool.

Constructor Summary

Constructors

Constructor	Description
CosNOutputStream(org.apache.hadoop.conf.Configuration conf, org.apache.hadoop.fs.cosn.NativeFileSystemStore store, java.lang.String key, long blockSize, java.util.concurrent.ExecutorService executorService)

Method Summary

Modifier and Type	Method	Description
void	close()
void	flush()
void	write(byte[] b)
void	write(byte[] b, int off, int len)
void	write(int b)

Methods inherited from class java.io.OutputStream

nullOutputStream

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

CosNOutputStream

public CosNOutputStream(org.apache.hadoop.conf.Configuration conf,
                        org.apache.hadoop.fs.cosn.NativeFileSystemStore store,
                        java.lang.String key,
                        long blockSize,
                        java.util.concurrent.ExecutorService executorService)
                 throws java.io.IOException

Throws:

java.io.IOException

Method Detail

flush

public void flush()
           throws java.io.IOException

Specified by:

flush in interface java.io.Flushable

Overrides:

flush in class java.io.OutputStream

Throws:

java.io.IOException

close

public void close()
           throws java.io.IOException

Specified by:

close in interface java.lang.AutoCloseable

Specified by:

close in interface java.io.Closeable

Overrides:

close in class java.io.OutputStream

Throws:

java.io.IOException

write

public void write(byte[] b,
                  int off,
                  int len)
           throws java.io.IOException

Overrides:

write in class java.io.OutputStream

Throws:

java.io.IOException

write

public void write(byte[] b)
           throws java.io.IOException

Overrides:

write in class java.io.OutputStream

Throws:

java.io.IOException

write

public void write(int b)
           throws java.io.IOException

Specified by:

write in class java.io.OutputStream

Throws:

java.io.IOException