Package org.apache.hadoop.maprfs

Class AbstractMapRFileSystem

java.lang.Object

org.apache.hadoop.conf.Configured

org.apache.hadoop.fs.FileSystem

org.apache.hadoop.maprfs.AbstractMapRFileSystem

All Implemented Interfaces:

java.io.Closeable, java.lang.AutoCloseable, Configurable, BulkDeleteSource, PathCapabilities, Fid, DelegationTokenIssuer

public abstract class AbstractMapRFileSystem
extends FileSystem
implements Fid

An abstract base class which represents top-level API for MapR-FS implementation of Hadoop FileSystem. This class should be used from Hadoop side to get access to MapR-FS specific functionality. The concrete MapR-FS implementation of the Hadoop distributed file system should extend this class and provide an implementation of all declared methods.

Nested Class Summary

Nested classes/interfaces inherited from class org.apache.hadoop.fs.FileSystem

FileSystem.DirectoryEntries, FileSystem.DirListingIterator<T extends FileStatus>, FileSystem.Statistics

Field Summary

Fields inherited from class org.apache.hadoop.fs.FileSystem

DEFAULT_FS, FS_DEFAULT_NAME_KEY, LOG, SHUTDOWN_HOOK_PRIORITY, statistics, TRASH_PREFIX, USER_HOME_PREFIX

Fields inherited from interface org.apache.hadoop.security.token.DelegationTokenIssuer

TOKEN_LOG

Constructor Summary

Constructors

Constructor	Description
AbstractMapRFileSystem()

Method Summary

Modifier and Type	Method	Description
abstract int	copyAce(Path src, Path dest)	This method copies ACEs on source to destination.
abstract FSDataOutputStream	createFid(java.lang.String pfid, java.lang.String file, boolean overwrite)
abstract PathId	createPathId()	create PathId: A Factory method to create PathIds.
abstract void	deleteAces(Path path, boolean recursive)	This method deletes all ACEs of a file or directory.
abstract void	setAces(Path path, java.lang.String strAces, boolean isSet, int noinherit, int preservemodebits, boolean recursive)	This method fully replaces ACEs of a file or directory recursively, discarding all existing ones.

Methods inherited from class org.apache.hadoop.fs.FileSystem

access, append, append, append, append, append, appendFile, areSymlinksEnabled, cancelDeleteOnExit, canonicalizeUri, checkPath, clearStatistics, close, closeAll, closeAllForUGI, completeLocalOutput, concat, copyFromLocalFile, copyFromLocalFile, copyFromLocalFile, copyFromLocalFile, copyToLocalFile, copyToLocalFile, copyToLocalFile, create, create, create, create, create, create, create, create, create, create, create, create, create, createBulkDelete, createDataInputStreamBuilder, createDataInputStreamBuilder, createDataOutputStreamBuilder, createFid, createFile, createMultipartUploader, createNewFile, createNonRecursive, createNonRecursive, createNonRecursive, createPathHandle, createSnapshot, createSnapshot, createSymlink, delete, delete, deleteFid, deleteOnExit, deleteSnapshot, enableSymlinks, exists, fixRelativePart, get, get, get, getAclStatus, getAdditionalTokenIssuers, getAllStatistics, getAllStoragePolicies, getBlockSize, getCanonicalServiceName, getCanonicalUri, getChildFileSystems, getContentSummary, getDefaultBlockSize, getDefaultBlockSize, getDefaultPort, getDefaultReplication, getDefaultReplication, getDefaultUri, getDelegationToken, getEnclosingRoot, getFileBlockLocations, getFileBlockLocations, getFileChecksum, getFileChecksum, getFileLinkStatus, getFileStatus, getFileSystemClass, getFSofPath, getGlobalStorageStatistics, getHomeDirectory, getInitialWorkingDirectory, getJobTrackerAddrs, getLength, getLinkTarget, getLocal, getName, getNamed, getPathHandle, getQuotaUsage, getReplication, getScheme, getServerDefaults, getServerDefaults, getStatistics, getStatistics, getStatus, getStatus, getStoragePolicy, getStorageStatistics, getTrashRoot, getTrashRoots, getUri, getUsed, getUsed, getWorkingDirectory, getXAttr, getXAttrs, getXAttrs, getZkConnectString, globStatus, globStatus, hasPathCapability, initialize, isDirectory, isFile, listCorruptFileBlocks, listFiles, listLocatedStatus, listLocatedStatus, listStatus, listStatus, listStatus, listStatus, listStatusBatch, listStatusIterator, listXAttrs, makeQualified, mkdirs, mkdirs, mkdirs, mkdirsFid, mkdirsFid, modifyAclEntries, moveFromLocalFile, moveFromLocalFile, moveToLocalFile, msync, newInstance, newInstance, newInstance, newInstanceLocal, open, open, open, open, openFid, openFid, openFid2, openFile, openFile, openFileWithOptions, openFileWithOptions, primitiveCreate, primitiveMkdir, primitiveMkdir, printStatistics, processDeleteOnExit, removeAcl, removeAclEntries, removeDefaultAcl, removeXAttr, rename, rename, renameSnapshot, resolveLink, resolvePath, satisfyStoragePolicy, setAcl, setDefaultUri, setDefaultUri, setOwner, setOwnerFid, setPermission, setQuota, setQuotaByStorageType, setReplication, setStoragePolicy, setTimes, setVerifyChecksum, setWorkingDirectory, setWriteChecksum, setXAttr, setXAttr, startLocalOutput, supportsSymlinks, truncate, unsetStoragePolicy

Methods inherited from class org.apache.hadoop.conf.Configured

getConf, setConf

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface org.apache.hadoop.security.token.DelegationTokenIssuer

addDelegationTokens

Methods inherited from interface org.apache.hadoop.maprfs.Fid

createFid, deleteFid, mkdirsFid, mkdirsFid, openFid, openFid, openFid2, setOwnerFid

Constructor Detail

AbstractMapRFileSystem

public AbstractMapRFileSystem()

Method Detail

createPathId

public abstract PathId createPathId()

Description copied from class: FileSystem

create PathId: A Factory method to create PathIds. PathIds are used by MapRFS in the direct shuffle to get access to the file paths.

Overrides:

createPathId in class FileSystem

createFid

public abstract FSDataOutputStream createFid(java.lang.String pfid,
                                             java.lang.String file,
                                             boolean overwrite)
                                      throws java.io.IOException

Specified by:

createFid in interface Fid

Throws:

java.io.IOException

copyAce

public abstract int copyAce(Path src,
                            Path dest)
                     throws java.io.IOException

This method copies ACEs on source to destination.

Parameters:

src - path of source

dest - path of destination

Throws:

java.io.IOException - if an ACE could not be read/modified

setAces

public abstract void setAces(Path path,
                             java.lang.String strAces,
                             boolean isSet,
                             int noinherit,
                             int preservemodebits,
                             boolean recursive)
                      throws java.io.IOException

This method fully replaces ACEs of a file or directory recursively, discarding all existing ones. Accepts ACE parameter as String in short format. [rf:ace],[wf:ace],[ef:ace],[rd:ace],[ac:ace],[dc:ace],[ld:ace]

Parameters:

path - path to set ACEs

strAces - string of file ACEs in short format

isSet - fully replace or stay existing ACE

noinherit - do not inherit aces instead use umask

preservemodebits - to not overwrite mode bits

recursive - whether to apply ACE recursively true/false

Throws:

java.io.IOException - if an ACE could not be replaced

deleteAces

public abstract void deleteAces(Path path,
                                boolean recursive)
                         throws java.io.IOException

This method deletes all ACEs of a file or directory.

Parameters:

path - path to delete ACEs

Throws:

java.io.IOException - if an ACEs could not be modified