Package org.apache.hadoop.fs.aliyun.oss

Class AliyunOSSBlockOutputStream

java.lang.Object

java.io.OutputStream

org.apache.hadoop.fs.aliyun.oss.AliyunOSSBlockOutputStream

All Implemented Interfaces:

java.io.Closeable, java.io.Flushable, java.lang.AutoCloseable

public class AliyunOSSBlockOutputStream
extends java.io.OutputStream

Asynchronous multi-part based uploading mechanism to support huge file which is larger than 5GB. Data will be buffered on local disk, then uploaded to OSS in close() method.

Constructor Summary

Constructors

Constructor	Description
AliyunOSSBlockOutputStream(org.apache.hadoop.conf.Configuration conf, AliyunOSSFileSystemStore store, java.lang.String key, int blockSize, org.apache.hadoop.fs.aliyun.oss.OSSDataBlocks.BlockFactory blockFactory, BlockOutputStreamStatistics statistics, java.util.concurrent.ExecutorService executorService)

Method Summary

Modifier and Type	Method	Description
void	close()
void	flush()	The flush operation does not trigger an upload; that awaits the next block being full.
void	write(byte[] b, int off, int len)
void	write(int b)

Methods inherited from class java.io.OutputStream

nullOutputStream, write

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

AliyunOSSBlockOutputStream

public AliyunOSSBlockOutputStream(org.apache.hadoop.conf.Configuration conf,
                                  AliyunOSSFileSystemStore store,
                                  java.lang.String key,
                                  int blockSize,
                                  org.apache.hadoop.fs.aliyun.oss.OSSDataBlocks.BlockFactory blockFactory,
                                  BlockOutputStreamStatistics statistics,
                                  java.util.concurrent.ExecutorService executorService)
                           throws java.io.IOException

Throws:

java.io.IOException

Method Detail

flush

public void flush()
           throws java.io.IOException

The flush operation does not trigger an upload; that awaits the next block being full. What it does do is call flush() on the current block, leaving it to choose how to react.

Specified by:

flush in interface java.io.Flushable

Overrides:

flush in class java.io.OutputStream

Throws:

java.io.IOException - Any IO problem.

close

public void close()
           throws java.io.IOException

Specified by:

close in interface java.lang.AutoCloseable

Specified by:

close in interface java.io.Closeable

Overrides:

close in class java.io.OutputStream

Throws:

java.io.IOException

write

public void write(int b)
           throws java.io.IOException

Specified by:

write in class java.io.OutputStream

Throws:

java.io.IOException

write

public void write(byte[] b,
                  int off,
                  int len)
           throws java.io.IOException

Overrides:

write in class java.io.OutputStream

Throws:

java.io.IOException