Package org.apache.flink.fs.osshadoop

Class FlinkOSSFileSystem

java.lang.Object

org.apache.flink.core.fs.FileSystem

org.apache.flink.runtime.fs.hdfs.HadoopFileSystem

org.apache.flink.fs.osshadoop.FlinkOSSFileSystem

All Implemented Interfaces:

org.apache.flink.core.fs.IFileSystem

public class FlinkOSSFileSystem
extends org.apache.flink.runtime.fs.hdfs.HadoopFileSystem

Implementation of the Flink FileSystem interface for Aliyun OSS. This class implements the common behavior implemented directly by Flink and delegates common calls to an implementation of Hadoop's filesystem abstraction.

Nested Class Summary

Nested classes/interfaces inherited from class org.apache.flink.core.fs.FileSystem

org.apache.flink.core.fs.FileSystem.FSKey, org.apache.flink.core.fs.FileSystem.WriteMode

Field Summary

Fields

Modifier and Type	Field	Description
static final long	MULTIPART_UPLOAD_PART_SIZE_MIN

Constructor Summary

Constructors

Constructor	Description
FlinkOSSFileSystem(org.apache.hadoop.fs.FileSystem fileSystem, long ossUploadPartSize, int maxConcurrentUploadsPerStream, String localTmpDirectory, OSSAccessor ossAccessor)

Method Summary

Modifier and Type	Method	Description
org.apache.flink.core.fs.RecoverableWriter	createRecoverableWriter()
String	getLocalTmpDir()

Methods inherited from class org.apache.flink.runtime.fs.hdfs.HadoopFileSystem

create, create, createRecoverableWriter, delete, exists, getDefaultBlockSize, getFileBlockLocations, getFileStatus, getHadoopFileSystem, getHomeDirectory, getUri, getWorkingDirectory, isDistributedFS, listStatus, mkdirs, open, open, rename, toHadoopPath

Methods inherited from class org.apache.flink.core.fs.FileSystem

create, get, getDefaultFsUri, getLocalFileSystem, getUnguardedFileSystem, initialize, initialize, initOutPathDistFS, initOutPathLocalFS

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface org.apache.flink.core.fs.IFileSystem

canCopyPaths

Field Details

MULTIPART_UPLOAD_PART_SIZE_MIN

public static final long MULTIPART_UPLOAD_PART_SIZE_MIN

See Also:

• Constant Field Values

Constructor Details

FlinkOSSFileSystem

public FlinkOSSFileSystem(org.apache.hadoop.fs.FileSystem fileSystem,
 long ossUploadPartSize,
 int maxConcurrentUploadsPerStream,
 String localTmpDirectory,
 OSSAccessor ossAccessor)

Method Details

createRecoverableWriter

public org.apache.flink.core.fs.RecoverableWriter createRecoverableWriter()
                                                                   throws IOException

Specified by:

createRecoverableWriter in interface org.apache.flink.core.fs.IFileSystem

Overrides:

createRecoverableWriter in class org.apache.flink.runtime.fs.hdfs.HadoopFileSystem

Throws:

IOException

getLocalTmpDir

public String getLocalTmpDir()