Package com.mapr.fs

Class MapRFileSystem

java.lang.Object
org.apache.hadoop.conf.Configured
org.apache.hadoop.fs.FileSystem
org.apache.hadoop.maprfs.AbstractMapRFileSystem
com.mapr.fs.MapRFileSystem
All Implemented Interfaces:
com.mapr.fs.jni.MapRConstants, Closeable, AutoCloseable, org.apache.hadoop.conf.Configurable, org.apache.hadoop.fs.BulkDeleteSource, org.apache.hadoop.fs.PathCapabilities, org.apache.hadoop.maprfs.Fid, org.apache.hadoop.security.token.DelegationTokenIssuer
public class MapRFileSystem extends org.apache.hadoop.maprfs.AbstractMapRFileSystem implements com.mapr.fs.jni.MapRConstants

  • Nested Class Summary

    Nested classes/interfaces inherited from class org.apache.hadoop.fs.FileSystem

    org.apache.hadoop.fs.FileSystem.DirectoryEntries, org.apache.hadoop.fs.FileSystem.DirListingIterator<T extends org.apache.hadoop.fs.FileStatus>, org.apache.hadoop.fs.FileSystem.Statistics

    Nested classes/interfaces inherited from interface com.mapr.fs.jni.MapRConstants

    com.mapr.fs.jni.MapRConstants.ErrorValue, com.mapr.fs.jni.MapRConstants.JniUsername, com.mapr.fs.jni.MapRConstants.PutConstants, com.mapr.fs.jni.MapRConstants.RowConstants

  • Field Summary

    Fields
    Modifier and Type
    Field
    Description
    static final String[]
    emptyStringArray
     
    static final URI
    MAPRFS_BASE_URI
     
    final int
    MaxNumFileAces
     
    protected com.google.common.collect.BiMap<Integer,String>
    securityPolicyIdToNameMap_
     
    protected com.google.common.collect.BiMap<String,Integer>
    securityPolicyNameToIdMap_
     

    Fields inherited from class org.apache.hadoop.fs.FileSystem

    DEFAULT_FS, FS_DEFAULT_NAME_KEY, SHUTDOWN_HOOK_PRIORITY, statistics, TRASH_PREFIX, USER_HOME_PREFIX

    Fields inherited from interface org.apache.hadoop.security.token.DelegationTokenIssuer

    TOKEN_LOG

    Fields inherited from interface com.mapr.fs.jni.MapRConstants

    AtimeBit, AuditBit, ChunkSizeBit, ClusterConfDefault, CompressBit, CompressorTypeBit, DEFAULT_USER_IDENTIFIER, DEFAULT_USER_IDENTIFIER_ESCAPED, DefaultChunkSize, DefaultCLDBIp, DefaultCLDBPort, DiskFlushBit, EMPTY_BYTE_ARRAY, EMPTY_END_ROW, EMPTY_START_ROW, FidNameBit, GlobalClusterConfDefault, GroupBit, HADOOP_MAX_BLOCKSIZE, HADOOP_SECURITY_SPOOFED_GID, HADOOP_SECURITY_SPOOFED_GROUP, HADOOP_SECURITY_SPOOFED_UID, HADOOP_SECURITY_SPOOFED_USER, HOSTNAME_IP_SEPARATOR, IP_PORT_SEPARATOR, IPV6_ADDR_ENDER, IPV6_ADDR_STARTER, IPv6DefaultCLDBIp, LAST_ROW, LATEST_TIMESTAMP, MAPR_ENV_VAR, MAPR_PROPERTY_HOME, MapRClusterDir, MapRClusterDirPattern, MapRClusterDirSlash, MAPRFS_PREFIX, MAPRFS_SCHEME, MapRHomeDefault, MAX_CLUSTERS_CROSSED, MAX_PATH_LENGTH, MAX_PORT_NUMBER, MAX_RA_THREADS, MIN_RA_THREADS, MinChunkSize, ModeBit, MtimeBit, MULTI_ADDR_SEPARATOR, NUM_CONTAINERS_PER_RPC, OLDEST_TIMESTAMP, RA_THREADS_PER_STREAM, ReplBit, SSL_TRUSTSTORE, UserBit, UTF8_ENCODING, WireSecureBit

  • Constructor Summary

    Constructors
    Constructor
    Description
    MapRFileSystem()
     
    MapRFileSystem(String uname)
     
    MapRFileSystem(String cName, String[] cldbLocations)
     
    MapRFileSystem(String cName, String[] cldbLocations, String uname)
     

  • Method Summary

    Modifier and Type
    Method
    Description
    void
    access(org.apache.hadoop.fs.Path path, org.apache.hadoop.fs.permission.FsAction mode)
     
    void
    addAceEntryError(ArrayList<FileAceEntry> acesList, org.apache.hadoop.fs.Path path, int err)
     
    org.apache.hadoop.security.token.Token<?>[]
    addDelegationTokens(String renewer, org.apache.hadoop.security.Credentials credentials)
     
    int
    addFidMountPathToCache(String fidStr, String path, boolean forceUpdate)
     
    int
    addSecurityPolicy(org.apache.hadoop.fs.Path path, String securityPolicyTag, boolean recursive)
    This method adds a single security policy tag to the list of existing security policy tags (if any) for the file or directory specified in path.
    int
    addSecurityPolicy(org.apache.hadoop.fs.Path path, List<String> securityPolicyTags, boolean recursive)
    This method adds one or more security policy tags to the list of existing security policy tags (if any) for the file or directory specified in path.
    boolean
    addTableEntryToMetadata(String tablePath)
     
    boolean
    addTableEntryToMetadata(String tablePath, int retryCount)
     
    void
    addTableReplica(org.apache.hadoop.fs.Path tableURI, com.mapr.fs.proto.Dbserver.TableReplicaDesc desc, com.mapr.fs.proto.Dbserver.TableReplAutoSetupInfo ainfo)
     
    void
    addTableUpstream(org.apache.hadoop.fs.Path tableURI, com.mapr.fs.proto.Dbserver.TableUpstreamDesc desc)
     
    org.apache.hadoop.fs.FSDataOutputStream
    append(org.apache.hadoop.fs.Path f, int bufferSize, org.apache.hadoop.util.Progressable progress)
    Append to an existing file (optional operation).
    void
    clearQueryServiceParam()
    Clears the QueryServiceParam for the default cluster.
    void
    clearQueryServiceParam(String clusterName)
    Clears the QueryServiceParam for the specified cluster.
    void
    close()
     
    int
    copyAce(org.apache.hadoop.fs.Path src, org.apache.hadoop.fs.Path dst)
    This method copies ACEs on source to destination.
    org.apache.hadoop.fs.FSDataOutputStream
    create(org.apache.hadoop.fs.Path f, boolean overwrite)
    Opens an FSDataOutputStream at the indicated Path.
    org.apache.hadoop.fs.FSDataOutputStream
    create(org.apache.hadoop.fs.Path f, boolean overwrite, int bufferSize)
    Opens an FSDataOutputStream at the indicated Path.
    org.apache.hadoop.fs.FSDataOutputStream
    create(org.apache.hadoop.fs.Path f, boolean overwrite, int bufferSize, short replication, long blockSize)
     
    org.apache.hadoop.fs.FSDataOutputStream
    create(org.apache.hadoop.fs.Path f, boolean overwrite, int bufferSize, org.apache.hadoop.util.Progressable progress)
    Opens an FSDataOutputStream at the indicated Path with write-progress reporting.
    org.apache.hadoop.fs.FSDataOutputStream
    create(org.apache.hadoop.fs.Path f, int mask, org.apache.hadoop.fs.permission.FsPermission permission, boolean createIfNonExistant, boolean append, boolean overwrite, int bufferSize, short replication, long blockSize, org.apache.hadoop.util.Progressable progress, boolean createParent)
     
    org.apache.hadoop.fs.FSDataOutputStream
    create(org.apache.hadoop.fs.Path f, short replication)
    Opens an FSDataOutputStream at the indicated Path.
    org.apache.hadoop.fs.FSDataOutputStream
    create(org.apache.hadoop.fs.Path f, short replication, org.apache.hadoop.util.Progressable progress)
    Opens an FSDataOutputStream at the indicated Path with write-progress reporting.
    org.apache.hadoop.fs.FSDataOutputStream
    create(org.apache.hadoop.fs.Path f, org.apache.hadoop.fs.permission.FsPermission permission, boolean overwrite, int bufferSize, short replication, long blockSize, org.apache.hadoop.util.Progressable progress)
     
    org.apache.hadoop.fs.FSDataOutputStream
    create(org.apache.hadoop.fs.Path f, org.apache.hadoop.fs.permission.FsPermission permission, EnumSet<org.apache.hadoop.fs.CreateFlag> flag, int bufferSize, short replication, long blockSize, org.apache.hadoop.util.Progressable progress, org.apache.hadoop.fs.Options.ChecksumOpt checksumOpt)
     
    org.apache.hadoop.fs.FSDataOutputStream
    create(org.apache.hadoop.fs.Path f, org.apache.hadoop.util.Progressable progress)
    Create an FSDataOutputStream at the indicated Path with write-progress reporting.
    void
    createColumnFamily(org.apache.hadoop.fs.Path tableURI, String name, com.mapr.fs.proto.Dbserver.ColumnFamilyAttr cfAttr)
     
    void
    createColumnFamily(org.apache.hadoop.fs.Path tableURI, String name, com.mapr.fs.proto.Dbserver.ColumnFamilyAttr cfAttr, com.mapr.baseutils.utils.AceHelper.DBPermission dbperm, List<String> securityPolicyTagList)
     
    void
    createColumnFamily(org.apache.hadoop.fs.Path tableURI, String name, com.mapr.fs.proto.Dbserver.ColumnFamilyAttr cfAttr, List<String> securityPolicyTagList)
     
    org.apache.hadoop.fs.FSDataOutputStream
    createFid(String pfid, String file)
     
    org.apache.hadoop.fs.FSDataOutputStream
    createFid(String pfid, String file, boolean overwrite)
     
    int
    createHardlink(org.apache.hadoop.fs.Path oldpath, org.apache.hadoop.fs.Path newpath)
     
    org.apache.hadoop.fs.FSDataOutputStream
    createNonRecursive(org.apache.hadoop.fs.Path f, org.apache.hadoop.fs.permission.FsPermission permission, boolean overwrite, int bufferSize, short replication, long blockSize, org.apache.hadoop.util.Progressable progress)
     
    org.apache.hadoop.fs.PathId
    createPathId()
     
    int
    createSnapshot(String cluster, String volumeName, int volId, int rootCid, String snapshotName, boolean mirrorSnapshot, long expirationTime, String username)
     
    int
    createSnapshot(String cluster, String volumeName, int volId, int rootCid, String snapshotName, boolean mirrorSnapshot, long expirationTime, String username, long clusterOps)
     
    void
    createSymbolicLink(org.apache.hadoop.fs.Path target, org.apache.hadoop.fs.Path link)
     
    int
    createSymlink(String target, org.apache.hadoop.fs.Path link, boolean createParent)
     
    void
    createSymlink(org.apache.hadoop.fs.Path target, org.apache.hadoop.fs.Path link, boolean createParent)
     
    void
    createTable(org.apache.hadoop.fs.Path tableURI)
     
    void
    createTable(org.apache.hadoop.fs.Path tableURI, byte[][] splitKeys, boolean isBulkLoad, boolean isJson)
     
    void
    createTable(org.apache.hadoop.fs.Path tableURI, byte[][] splitKeys, boolean isBulkLoad, boolean isJson, boolean insertOrder)
     
    void
    createTable(org.apache.hadoop.fs.Path tableURI, String user)
     
    void
    createTable(org.apache.hadoop.fs.Path tableURI, String user, byte[][] splitKeys)
     
    void
    createTable(org.apache.hadoop.fs.Path tableURI, String user, com.mapr.fs.proto.Dbserver.TableAttr attr, com.mapr.baseutils.utils.AceHelper.DBPermission dbperm, byte[][] splitKeys, int auditValue)
     
    void
    createTable(org.apache.hadoop.fs.Path tableURI, String user, com.mapr.fs.proto.Dbserver.TableAttr attr, com.mapr.baseutils.utils.AceHelper.DBPermission dbperm, byte[][] splitKeys, int auditValue, List<String> securityPolicyTagList)
     
    void
    createTable(org.apache.hadoop.fs.Path tableURI, String user, com.mapr.fs.proto.Dbserver.TableAttr attr, com.mapr.baseutils.utils.AceHelper.DBPermission dbperm, byte[][] splitKeys, int auditValue, List<String> securityPolicyTagList, TableCreateOptions options)
     
    void
    createTable(org.apache.hadoop.fs.Path tableURI, String user, com.mapr.fs.proto.Dbserver.TableAttr attr, com.mapr.baseutils.utils.AceHelper.DBPermission dbperm, int auditValue)
     
    void
    createTable(org.apache.hadoop.fs.Path tableURI, String user, com.mapr.fs.proto.Dbserver.TableAttr attr, com.mapr.baseutils.utils.AceHelper.DBPermission dbperm, int auditValue, List<String> securityPolicyTagList)
     
    String
    createTable(org.apache.hadoop.fs.Path tableURI, String user, com.mapr.fs.proto.Dbserver.TableAttr attr, com.mapr.fs.proto.Dbserver.TableAces aces, byte[][] splitKeys, boolean needServerInfo, int auditValue)
     
    String
    createTable(org.apache.hadoop.fs.Path tableURI, String user, com.mapr.fs.proto.Dbserver.TableAttr attr, com.mapr.fs.proto.Dbserver.TableAces aces, byte[][] splitKeys, boolean needServerInfo, int auditValue, List<String> securityPolicyTagList)
     
    String
    createTable(org.apache.hadoop.fs.Path tableURI, String user, com.mapr.fs.proto.Dbserver.TableAttr attr, com.mapr.fs.proto.Dbserver.TableAces aces, byte[][] splitKeys, boolean needServerInfo, int auditValue, List<String> securityPolicyTagList, TableCreateOptions options)
     
    int
    createVolLink(String cluster, String volName, org.apache.hadoop.fs.Path volLink, boolean writeable, boolean isHidden)
     
    static com.mapr.fs.jni.MapRUserInfo
    CurrentUserInfo()
     
    static com.mapr.fs.jni.MapRUserInfo
    CurrentUserInfo(String uname)
     
    int
    delAces(org.apache.hadoop.fs.Path path, boolean recursive)
     
    int
    delAces(org.apache.hadoop.fs.Path path, boolean recursive, int symLinkHeight)
     
    boolean
    delete(org.apache.hadoop.fs.Path f)
     
    boolean
    delete(org.apache.hadoop.fs.Path f, boolean recursive)
    Delete a file.
    void
    deleteAces(org.apache.hadoop.fs.Path path)
    This method deletes all ACEs of a file or directory.
    void
    deleteAces(org.apache.hadoop.fs.Path path, boolean recursive)
    This method deletes all ACEs of a file or directory recursively.
    void
    deleteColumnFamily(org.apache.hadoop.fs.Path tableURI, String name)
     
    boolean
    deleteFid(String pfid, String dir)
     
    boolean
    deleteTable(org.apache.hadoop.fs.Path tablePath)
     
    int
    deleteVolLink(String cluster, String volLink)
     
    void
    editTableReplica(org.apache.hadoop.fs.Path tableURI, String clusterName, String replicaPath, boolean allowAllCfs, com.mapr.fs.proto.Dbserver.TableReplicaDesc desc)
     
    void
    editTableReplica(org.apache.hadoop.fs.Path tableURI, String clusterName, String replicaPath, String topicName, boolean allowAllCfs, com.mapr.fs.proto.Dbserver.TableReplicaDesc desc)
     
    void
    enablePrivilegedProcessAccess(boolean enable)
     
    <ReturnType>
    ReturnType
    executeCommand(com.mapr.fs.FSCommandHandler handler, com.mapr.fs.FSCommandHandler.ICommandExecutor<ReturnType> executor)
     
    int
    fetchGNSConf()
     
    static String
    fidToString(com.mapr.fs.proto.Common.FidMsg fid)
    Deprecated.
    Use Fids.fidToString(FidMsg)
    void
    forceLocalResolution(URI name)
     
    String
    GatewaySourceToString(int source)
     
    List<MapRFileAce>
    getAces(org.apache.hadoop.fs.Path path)
    This method gets the ACEs of a file or directory.
    ArrayList<FileAceEntry>
    getAces(org.apache.hadoop.fs.Path path, boolean recursive)
     
    ArrayList<FileAceEntry>
    getAces(org.apache.hadoop.fs.Path path, boolean recursive, int symLinkHeight)
     
    ArrayList<FileAceEntry>
    getAces(org.apache.hadoop.fs.Path path, boolean recursive, int symLinkHeight, int serveridx)
     
    List<com.mapr.fs.proto.Dbserver.DataMask>
    getAllDataMasks()
    Retrieves all the info for a all data mask
    int
    getCidFromPath(org.apache.hadoop.fs.Path path)
     
    static ClusterConf
    getClusterConf()
     
    List<ClusterConf.ClusterEntry>
    getClusterList()
     
    String
    getClusterName(URI p)
     
    String
    getClusterNameUnchecked(String str)
     
    boolean
    getClusterNameUnique()
     
    Map<String,Integer>
    getClusterSecurityPolicies()
     
    byte[]
    getContainerInfo(org.apache.hadoop.fs.Path path, List<Integer> cidList)
     
    com.mapr.fs.proto.Dbserver.DataMask
    getDataMask(String dmName)
    Retrieves all the info for a particular data mask given the name
    String
    getDataMaskNameFromId(int id)
    Returns the data mask name given the data mask ID.
    long
    getDefaultBlockSize()
     
    String
    getDefaultClusterName()
     
    short
    getDefaultReplication()
     
    org.apache.hadoop.fs.BlockLocation[]
    getFileBlockLocations(org.apache.hadoop.fs.FileStatus file, long start, long len)
     
    com.mapr.fs.jni.MapRFileCount
    getFileCount(org.apache.hadoop.fs.Path f)
     
    org.apache.hadoop.fs.FileStatus
    getFileLinkStatus(org.apache.hadoop.fs.Path f)
     
    org.apache.hadoop.fs.FileStatus
    getFileStatus(org.apache.hadoop.fs.Path f)
     
    com.mapr.fs.jni.IPPort[]
    getGatewayIps(String file)
     
    com.mapr.fs.jni.IPPort[]
    getGatewayIps(String file, String dstCluster, boolean skipCache, com.mapr.fs.jni.GatewaySource source)
     
    org.apache.hadoop.fs.Path
    getHomeDirectory()
    utility functions
    InetSocketAddress[]
    getJobTrackerAddrs(org.apache.hadoop.conf.Configuration conf)
     
    org.apache.hadoop.fs.Path
    getLinkTarget(org.apache.hadoop.fs.Path f)
     
    MapRClientImpl
    getMapRClient()
     
    Object
    getMapRClient(String uri)
     
    MapRBlockLocation[]
    getMapRFileBlockLocations(org.apache.hadoop.fs.FileStatus file, long start, long len, boolean usePrimaryFid, boolean needDiskBlocks, boolean fullBlockInfo)
     
    MapRFileStatus
    getMapRFileStatus(org.apache.hadoop.fs.Path f)
     
    String
    getMountPath(String cluster, String username, int pCid, int pCinum, int pUniq)
     
    String
    getMountPath(String cluster, String username, int pCid, int pCinum, int pUniq, boolean useCache)
     
    String
    getMountPath(String cluster, String username, int pCid, int pCinum, int pUniq, boolean useCache, boolean skipFSCall)
     
    String
    getMountPathFid(String fidStr)
     
    String
    getMountPathFidCached(String fidStr)
     
    String
    getMountPathFidCached(String fidStr, boolean skipFSCall)
     
    String
    getName(org.apache.hadoop.fs.Path p)
     
    String
    getNameStr(String str)
     
    QueryServiceParam
    getQueryServiceParam()
    Return the QueryServiceParam from the default cluster.
    QueryServiceParam
    getQueryServiceParam(String clusterName)
    Return the QueryServiceParam from the specified cluster.
    static int
    getRAThreads()
     
    com.mapr.fs.proto.Dbserver.TableBasicStats
    getScanRangeStats(org.apache.hadoop.fs.Path tableURI, String indexFid, byte[] stKey, byte[] endKey)
     
    String
    getScheme()
     
    int
    getSecurityPolicy(List<org.apache.hadoop.fs.Path> paths, List<MapRPathToSecurityPolicyTags> securityPolicyTags)
    This method returns the security policies associated with the files or directories specified in list of paths specified in paths.
    int
    getSecurityPolicy(org.apache.hadoop.fs.Path path, List<String> securityPolicyTags)
    This method returns the security policies associated with the file or directory specified in path.
    int
    getSecurityPolicyId(String policyName)
    This method gets the security policy id for a single security policy name.
    List<Integer>
    getSecurityPolicyIds(List<String> securityPolicyTagList)
    This method gets the security policy ids for given security policy names from the policy cache maintained in the MapClient in JNI.
    String
    getSecurityPolicyName(int policyID)
    This method gets the security policyname for a given security policy id.
    String
    getSecurityPolicyNameOrId(int spId)
    This method gets the security policyname for a given security policy id.
    String
    getServerForCid(int cid)
     
    String
    getServerForCid(int cid, String cluster)
     
    MapRFileStatus
    getStat(org.apache.hadoop.fs.Path path)
     
    org.apache.hadoop.fs.FsStatus
    getStatus()
     
    org.apache.hadoop.fs.FsStatus
    getStatus(org.apache.hadoop.fs.Path p)
     
    TableBasicAttrs
    getTableBasicAttrs(org.apache.hadoop.fs.Path tableURI)
     
    TableProperties
    getTableProperties(org.apache.hadoop.fs.Path tableURI)
     
    com.mapr.fs.proto.Dbserver.TableBasicStats
    getTableStats(org.apache.hadoop.fs.Path tableURI, String indexFid)
     
    com.mapr.fs.proto.Dbserver.TabletLookupResponse
    getTablets(org.apache.hadoop.fs.Path tableURI, String indexFid, byte[] stKey, byte[] endKey, boolean needSpaceUsage)
     
    com.mapr.fs.proto.Dbserver.TabletLookupResponse
    getTablets(org.apache.hadoop.fs.Path tableURI, String indexFid, byte[] stKey, byte[] endKey, boolean needSpaceUsage, boolean prefetchTabletMap)
     
    MapRTabletScanner
    getTabletScanner(org.apache.hadoop.fs.Path tableURI, String indexFid)
     
    MapRTabletScanner
    getTabletScanner(org.apache.hadoop.fs.Path tableURI, String indexFid, boolean needSpaceUsage, boolean prefetchTabletMap)
     
    MapRTabletScanner
    getTabletScanner(org.apache.hadoop.fs.Path tableURI, String indexFid, byte[] startKey)
     
    MapRTabletScanner
    getTabletScanner(org.apache.hadoop.fs.Path tableURI, String indexFid, byte[] startKey, byte[] endKey, boolean needSpaceUsage, boolean prefetchTabletMap)
     
    com.mapr.fs.proto.Dbserver.TabletStatResponse
    getTabletStat(org.apache.hadoop.fs.Path tablePath, com.mapr.fs.proto.Common.FidMsg tabletFid)
     
    static String[]
    getTrimmedStrings(String str)
    Splits a comma separated value String, trimming leading and trailing whitespace on each value.
    URI
    getUri()
    Returns a URI whose scheme and authority identify this FileSystem.
    long
    getUsed()
    Return the total size of all files in the filesystem.
    com.mapr.fs.jni.MapRUserInfo
    getUserInfo()
     
    String
    getVolumeName(int volId)
    This method gets the volume name for a given volume id.
    String
    getVolumeNameCached(int volId)
    This method gets the volume name for a given volume id.
    org.apache.hadoop.fs.Path
    getWorkingDirectory()
    Get the current working directory for the given file system
    byte[]
    getXAttr(org.apache.hadoop.fs.Path path, String name)
    Get the extended attribute associated with the given name on the given file or directory.
    Map<String,byte[]>
    getXAttrs(org.apache.hadoop.fs.Path path)
    Get all the extended attribute name/value pairs associated with the given file or directory.
    Map<String,byte[]>
    getXAttrs(org.apache.hadoop.fs.Path path, List<String> names)
    Get the extended attributes associated with the given list of names on the given file or directory.
    String
    getZkConnectString()
     
    void
    initialize(URI name, org.apache.hadoop.conf.Configuration conf)
     
    void
    initialize(URI name, org.apache.hadoop.conf.Configuration conf, boolean isExpandAuditTool)
     
    boolean
    isChangelog(org.apache.hadoop.fs.Path path)
     
    static boolean
    isFidString(String fid)
    Deprecated.
    Use Fids.isFidString(String)
    boolean
    isJsonTable(org.apache.hadoop.fs.Path path)
     
    boolean
    isStream(org.apache.hadoop.fs.Path path)
     
    boolean
    isTable(org.apache.hadoop.fs.Path path)
     
    List<com.mapr.fs.proto.Dbserver.ColumnFamilyAttr>
    listColumnFamily(org.apache.hadoop.fs.Path tableURI, boolean wantAces)
     
    List<com.mapr.fs.proto.Dbserver.ColumnFamilyAttr>
    listColumnFamily(org.apache.hadoop.fs.Path tableURI, boolean wantAces, boolean useCached)
     
    int
    listDirLite(org.apache.hadoop.fs.Path f)
    Path should be a directory.
    MapRFileStatus[]
    listMapRStatus(org.apache.hadoop.fs.Path f, boolean showVols, boolean showHidden)
     
    MapRFileStatus[]
    listStatus(org.apache.hadoop.fs.Path f)
    List the statuses of the files/directories in the given path if the path is a directory.
    MapRReaddirLite
    listStatusLite(org.apache.hadoop.fs.Path f, int cid, int cinum, int uniq, int count, long cookie, boolean showHidden)
    Path should be a directory.
    com.mapr.fs.proto.Dbserver.TableReplicaListResponse
    listTableIndexes(org.apache.hadoop.fs.Path tableURI, boolean wantStats, boolean skipFieldsReadPermCheck, boolean refreshNow)
     
    com.mapr.fs.proto.Dbserver.TableReplicaListResponse
    listTableReplicas(org.apache.hadoop.fs.Path tableURI, boolean wantStats, boolean refreshNow, boolean getCompactInfo)
     
    com.mapr.fs.proto.Dbserver.TableUpstreamListResponse
    listTableUpstreams(org.apache.hadoop.fs.Path tableURI)
     
    List<String>
    listXAttrs(org.apache.hadoop.fs.Path path)
    Get all the extended attribute names associated with the given file or directory.
    com.mapr.fs.proto.Fileserver.KvstoreLookupResponse
    lookupKV(org.apache.hadoop.fs.Path tableURI, com.mapr.fs.proto.Fileserver.KvStoreKey key)
     
    org.apache.hadoop.fs.Path
    makeAbsolute(org.apache.hadoop.fs.Path path)
     
    void
    mergeTableRegion(org.apache.hadoop.fs.Path tableURI, String fidstr)
     
    boolean
    mkdirs(org.apache.hadoop.fs.Path p, boolean createParent, org.apache.hadoop.fs.permission.FsPermission permission)
     
    boolean
    mkdirs(org.apache.hadoop.fs.Path p, org.apache.hadoop.fs.permission.FsPermission permission)
    Make the given file and all non-existent parents into directories.
    boolean
    mkdirs(org.apache.hadoop.fs.Path p, org.apache.hadoop.fs.permission.FsPermission permission, boolean compress)
    mkdirs with compression option
    boolean
    mkdirs(org.apache.hadoop.fs.Path f, org.apache.hadoop.fs.permission.FsPermission permission, boolean compress, long chunkSize)
    mkdirs with compression and chunksize option
    boolean
    mkdirs(org.apache.hadoop.fs.Path f, org.apache.hadoop.fs.permission.FsPermission permission, long chunkSize)
    mkdirs with chunksize option
    String
    mkdirsFid(String pfid, String dir)
     
    String
    mkdirsFid(org.apache.hadoop.fs.Path p)
     
    void
    modifyAces(org.apache.hadoop.fs.Path path, List<MapRFileAce> aces)
    This method modifies ACEs of a file or directory.
    int
    modifyAudit(org.apache.hadoop.fs.Path path, boolean val)
     
    void
    modifyColumnFamily(org.apache.hadoop.fs.Path tableURI, String name, com.mapr.fs.proto.Dbserver.ColumnFamilyAttr cfAttr)
     
    void
    modifyColumnFamily(org.apache.hadoop.fs.Path tableURI, String name, com.mapr.fs.proto.Dbserver.ColumnFamilyAttr cfAttr, com.mapr.baseutils.utils.AceHelper.DBPermission dbperm)
     
    void
    modifyColumnFamily(org.apache.hadoop.fs.Path tableURI, String name, com.mapr.fs.proto.Dbserver.ColumnFamilyAttr cfAttr, com.mapr.fs.proto.Dbserver.SecurityPolicyOperation securityPolicyOp, com.mapr.baseutils.utils.AceHelper.DBPermission dbperm)
     
    void
    modifyColumnFamily(org.apache.hadoop.fs.Path tableURI, String name, com.mapr.fs.proto.Dbserver.SecurityPolicyOperation securityPolicyOp, com.mapr.fs.proto.Dbserver.ColumnFamilyAttr cfAttr)
     
    void
    modifyDbCfSecurityPolicy(org.apache.hadoop.fs.Path tableURI, com.mapr.baseutils.utils.AceHelper.DBPermission dbperm, List<String> securityPolicyTagList, com.mapr.fs.proto.Dbserver.SecurityPolicyOperation op, String cfname)
     
    void
    modifyDbSecurityPolicy(org.apache.hadoop.fs.Path tableURI, com.mapr.baseutils.utils.AceHelper.DBPermission dbperm, List<String> securityPolicyTagList, com.mapr.fs.proto.Dbserver.SecurityPolicyOperation op)
     
    void
    modifyTableAttr(org.apache.hadoop.fs.Path tableURI, com.mapr.fs.proto.Dbserver.TableAttr am, com.mapr.baseutils.utils.AceHelper.DBPermission dbperm)
     
    void
    modifyTableAttr(org.apache.hadoop.fs.Path tableURI, com.mapr.fs.proto.Dbserver.TableAttr am, com.mapr.baseutils.utils.AceHelper.DBPermission dbperm, boolean genUuid)
     
    void
    modifyTableAttr(org.apache.hadoop.fs.Path tableURI, com.mapr.fs.proto.Dbserver.TableAttr am, com.mapr.baseutils.utils.AceHelper.DBPermission dbperm, boolean genUuid, com.mapr.fs.proto.Dbserver.SecurityPolicyOperation securityPolicyOp)
     
    void
    modifyTableAttr(org.apache.hadoop.fs.Path tableURI, com.mapr.fs.proto.Dbserver.TableAttr am, com.mapr.fs.proto.Dbserver.TableAces aces)
     
    void
    modifyTableAttr(org.apache.hadoop.fs.Path tableURI, com.mapr.fs.proto.Dbserver.TableAttr am, com.mapr.fs.proto.Dbserver.TableAces aces, boolean genUuid, com.mapr.fs.proto.Dbserver.SecurityPolicyOperation securityPolicyOp)
     
    int
    mountVolume(String cluster, String volName, String mountPath, String username)
    Creates directory entry for volName at mountPath.
    org.apache.hadoop.fs.FSDataInputStream
    open(org.apache.hadoop.fs.Path f, int bufferSize)
     
    org.apache.hadoop.fs.FSDataInputStream
    openFid(String fid, byte[][] ips, int[] ports, long chunkSize, long fileSize)
     
    org.apache.hadoop.fs.FSDataInputStream
    openFid(String pfid, String file, byte[][] ips, int[] ports)
     
    org.apache.hadoop.fs.FSDataInputStream
    openFid2(org.apache.hadoop.fs.PathId pfid, String file, int readAheadBytesHint)
     
    Inode
    openTable(org.apache.hadoop.fs.Path tableURI, MapRHTable htable)
     
    Inode
    openTableWithFid(org.apache.hadoop.fs.Path priTableURI, String indexFid, MapRHTable htable)
     
    void
    packTableRegion(org.apache.hadoop.fs.Path tableURI, String fidstr, int ctype)
     
    com.mapr.fs.jni.MapRUserInfo
    populateAndGetUserInfo(org.apache.hadoop.fs.Path p)
     
    void
    populateUserInfo(org.apache.hadoop.fs.Path p)
     
    int
    printSecurityPolicies(org.apache.hadoop.fs.Path path, boolean recursive)
    This method prints the security policies associated with the files or directories specified in list of paths specified in paths.
    int
    removeAllSecurityPolicies(org.apache.hadoop.fs.Path path, boolean recursive)
    This method removes all security policy tags associated to the file or directory specified by path.
    int
    removeRecursive(org.apache.hadoop.fs.Path f)
     
    byte[]
    removeS3Bucket(String bucketName, String domainName)
     
    int
    removeSecurityPolicy(org.apache.hadoop.fs.Path path, String securityPolicyTag, boolean recursive)
    This method removes the security policy named securityPolicy from the list of existing security policies (if any) for the file or directory specified in path.
    int
    removeSecurityPolicy(org.apache.hadoop.fs.Path path, List<String> securityPolicyTags, boolean recursive)
    This method removes one or more security policy tags from the list of existing security policy tags (if any) for the file or directory specified in path.
    void
    removeTableReplica(org.apache.hadoop.fs.Path tableURI, com.mapr.fs.proto.Dbserver.TableReplicaDesc desc)
     
    void
    removeTableUpstream(org.apache.hadoop.fs.Path tableURI, com.mapr.fs.proto.Dbserver.TableUpstreamDesc desc)
     
    void
    removeXAttr(org.apache.hadoop.fs.Path path, String name)
    Remove the extended attribute (specified by name) associated with the given file or directory.
    boolean
    rename(org.apache.hadoop.fs.Path src, org.apache.hadoop.fs.Path dst)
    Renames Path src to Path dst.
    protected org.apache.hadoop.fs.Path
    resolveLink(org.apache.hadoop.fs.Path f)
     
    org.apache.hadoop.fs.Path
    resolveTablePath(org.apache.hadoop.fs.Path path)
     
    byte[]
    s3BucketCreate(String path, String bktName, String domain, int aId, boolean worm, long ownwerUid)
     
    MapRFileStatus[]
    scanDir(String cluster, String fidstr)
     
    byte[]
    scanKV(String cluster, String fidstr, byte[] start, byte[] end, int maxkeys)
     
    byte[]
    scanKV(String cluster, String fidstr, byte[] start, byte[] end, int maxkeys, boolean fromGfsck)
     
    com.mapr.fs.proto.Fileserver.KvstoreScanResponse
    scanKVGivenFid(org.apache.hadoop.fs.Path URI, com.mapr.fs.proto.Common.FidMsg kvFid, com.mapr.fs.proto.Fileserver.KvStoreKey start, com.mapr.fs.proto.Fileserver.KvStoreKey end)
     
    void
    setAces(org.apache.hadoop.fs.Path path, String strAces, boolean isSet, int noinherit, int preservemodebits, boolean recursive)
    This method fully replaces ACEs of a file or directory recursively, discarding all existing ones.
    int
    setAces(org.apache.hadoop.fs.Path path, ArrayList<com.mapr.fs.proto.Common.FileACE> aces, boolean isSet, int noinherit, int preservemodebits, boolean recursive, org.apache.hadoop.fs.Path hintAcePath)
     
    int
    setAces(org.apache.hadoop.fs.Path path, ArrayList<com.mapr.fs.proto.Common.FileACE> aces, boolean isSet, int noinherit, int preservemodebits, boolean recursive, org.apache.hadoop.fs.Path hintAcePath, int symLinkHeight)
     
    void
    setAces(org.apache.hadoop.fs.Path path, List<MapRFileAce> aces)
    This method fully replace ACEs of a file or directory, discarding all existing ones.
    void
    setAces(org.apache.hadoop.fs.Path path, List<MapRFileAce> aces, boolean recursive)
    This method fully replace ACEs of a file or directory recursively, discarding all existing ones.
    int
    setChunkSize(org.apache.hadoop.fs.Path path, long val)
     
    int
    setCompression(org.apache.hadoop.fs.Path path, boolean val, String compName)
     
    int
    setDiskFlush(org.apache.hadoop.fs.Path path, boolean val)
     
    void
    setOwner(org.apache.hadoop.fs.Path p, String user, String group)
     
    void
    setOwnerFid(String pfid, String user, String group)
     
    void
    setPermission(org.apache.hadoop.fs.Path p, org.apache.hadoop.fs.permission.FsPermission permission)
     
    void
    setQueryServiceParam(QueryServiceParam qsp)
    Sets the QueryServiceParam for the default cluster.
    void
    setQueryServiceParam(String clusterName, QueryServiceParam qsp)
    Sets the QueryServiceParam for the specified cluster.
    int
    setSecurityPolicy(org.apache.hadoop.fs.Path path, String securityPolicyTag, boolean recursive)
    This method sets the security policy tag to the file or directory specified in path, replacing all existing tags.
    int
    setSecurityPolicy(org.apache.hadoop.fs.Path path, List<String> securityPolicyTags, boolean recursive)
    This method sets one or more security policy tags for the file or directory specified in path, replacing any existing security policies.
    void
    setTimes(org.apache.hadoop.fs.Path p, long mtime, long atime)
     
    int
    setWireSecurity(org.apache.hadoop.fs.Path path, boolean val)
     
    void
    setWorkingDirectory(org.apache.hadoop.fs.Path new_dir)
    Set the current working directory for the given file system.
    void
    setXAttr(org.apache.hadoop.fs.Path path, String name, byte[] value)
    Set or replace an extended attribute on a file or directory.
    void
    setXAttr(org.apache.hadoop.fs.Path path, String name, byte[] value, EnumSet<org.apache.hadoop.fs.XAttrSetFlag> flag)
    Set an extended attribute on a file or directory.
    MapRFileStatus[]
    slashReaddir(String authority)
     
    void
    splitTableRegion(org.apache.hadoop.fs.Path tableURI, String fidstr, boolean ignoreRegionTooSmallError)
     
    boolean
    supportsSymlinks()
     
    com.mapr.fs.jni.JNIFileTierStatus
    tierOp(int op, org.apache.hadoop.fs.Path path, boolean verbose, boolean blocking, long shaHigh, long shaLow, long uniq)
     
    boolean
    truncate(org.apache.hadoop.fs.Path f, long newLength)
    Truncate the file in the indicated path to the indicated size.
    int
    unmountVolume(String cluster, String volName, String mountPath, String username, int pCid, int pCinum, int pUniq)
    Removes directory entry for volName Expects absolute path for mountPath
    static void
    validateFid(String fid)
    Deprecated.
    Use Fids.validateFid(String)

    Methods inherited from class org.apache.hadoop.fs.FileSystem

    append, append, append, append, appendFile, areSymlinksEnabled, cancelDeleteOnExit, canonicalizeUri, checkPath, clearStatistics, closeAll, closeAllForUGI, completeLocalOutput, concat, copyFromLocalFile, copyFromLocalFile, copyFromLocalFile, copyFromLocalFile, copyToLocalFile, copyToLocalFile, copyToLocalFile, create, create, create, create, createBulkDelete, createDataInputStreamBuilder, createDataInputStreamBuilder, createDataOutputStreamBuilder, createFile, createMultipartUploader, createNewFile, createNonRecursive, createNonRecursive, createPathHandle, createSnapshot, createSnapshot, deleteOnExit, deleteSnapshot, enableSymlinks, exists, fixRelativePart, get, get, get, getAclStatus, getAdditionalTokenIssuers, getAllStatistics, getAllStoragePolicies, getBlockSize, getCanonicalServiceName, getCanonicalUri, getChildFileSystems, getContentSummary, getDefaultBlockSize, getDefaultPort, getDefaultReplication, getDefaultUri, getDelegationToken, getEnclosingRoot, getFileBlockLocations, getFileChecksum, getFileChecksum, getFileSystemClass, getFSofPath, getGlobalStorageStatistics, getInitialWorkingDirectory, getLength, getLocal, getName, getNamed, getPathHandle, getQuotaUsage, getReplication, getServerDefaults, getServerDefaults, getStatistics, getStatistics, getStoragePolicy, getStorageStatistics, getTrashRoot, getTrashRoots, getUsed, globStatus, globStatus, hasPathCapability, isDirectory, isFile, listCorruptFileBlocks, listFiles, listLocatedStatus, listLocatedStatus, listStatus, listStatus, listStatus, listStatusBatch, listStatusIterator, makeQualified, mkdirs, mkdirs, modifyAclEntries, moveFromLocalFile, moveFromLocalFile, moveToLocalFile, msync, newInstance, newInstance, newInstance, newInstanceLocal, open, open, open, openFid, openFid, openFile, openFile, openFileWithOptions, openFileWithOptions, primitiveCreate, primitiveMkdir, primitiveMkdir, printStatistics, processDeleteOnExit, removeAcl, removeAclEntries, removeDefaultAcl, rename, renameSnapshot, resolvePath, satisfyStoragePolicy, setAcl, setDefaultUri, setDefaultUri, setQuota, setQuotaByStorageType, setReplication, setStoragePolicy, setVerifyChecksum, setWriteChecksum, startLocalOutput, unsetStoragePolicy

    Methods inherited from class org.apache.hadoop.conf.Configured

    getConf, setConf

    Methods inherited from class java.lang.Object

    clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

    Methods inherited from interface org.apache.hadoop.maprfs.Fid

    openFid, openFid

  • Field Details

    • MAPRFS_BASE_URI

      public static final URI MAPRFS_BASE_URI

    • securityPolicyNameToIdMap_

      protected com.google.common.collect.BiMap<String,Integer> securityPolicyNameToIdMap_

    • securityPolicyIdToNameMap_

      protected com.google.common.collect.BiMap<Integer,String> securityPolicyIdToNameMap_

    • MaxNumFileAces

      public final int MaxNumFileAces
      See Also:

    • emptyStringArray

      public static final String[] emptyStringArray

  • Constructor Details

  • Method Details

    • CurrentUserInfo

      public static com.mapr.fs.jni.MapRUserInfo CurrentUserInfo() throws IOException
      Throws:
      IOException

    • CurrentUserInfo

      public static com.mapr.fs.jni.MapRUserInfo CurrentUserInfo(String uname) throws IOException
      Throws:
      IOException

    • initialize

      public void initialize(URI name, org.apache.hadoop.conf.Configuration conf) throws IOException
      Overrides:
      initialize in class org.apache.hadoop.fs.FileSystem
      Throws:
      IOException

    • initialize

      public void initialize(URI name, org.apache.hadoop.conf.Configuration conf, boolean isExpandAuditTool) throws IOException
      Throws:
      IOException

    • createPathId

      public org.apache.hadoop.fs.PathId createPathId()
      Specified by:
      createPathId in class org.apache.hadoop.maprfs.AbstractMapRFileSystem

    • forceLocalResolution

      public void forceLocalResolution(URI name) throws IOException
      Throws:
      IOException

    • access

      public void access(org.apache.hadoop.fs.Path path, org.apache.hadoop.fs.permission.FsAction mode) throws org.apache.hadoop.security.AccessControlException, FileNotFoundException, IOException
      Overrides:
      access in class org.apache.hadoop.fs.FileSystem
      Throws:
      org.apache.hadoop.security.AccessControlException
      FileNotFoundException
      IOException

    • create

      public org.apache.hadoop.fs.FSDataOutputStream create(org.apache.hadoop.fs.Path f, org.apache.hadoop.fs.permission.FsPermission permission, EnumSet<org.apache.hadoop.fs.CreateFlag> flag, int bufferSize, short replication, long blockSize, org.apache.hadoop.util.Progressable progress, org.apache.hadoop.fs.Options.ChecksumOpt checksumOpt) throws IOException
      Overrides:
      create in class org.apache.hadoop.fs.FileSystem
      Throws:
      IOException

    • createNonRecursive

      public org.apache.hadoop.fs.FSDataOutputStream createNonRecursive(org.apache.hadoop.fs.Path f, org.apache.hadoop.fs.permission.FsPermission permission, boolean overwrite, int bufferSize, short replication, long blockSize, org.apache.hadoop.util.Progressable progress) throws IOException
      Overrides:
      createNonRecursive in class org.apache.hadoop.fs.FileSystem
      Throws:
      IOException

    • create

      public org.apache.hadoop.fs.FSDataOutputStream create(org.apache.hadoop.fs.Path f, int mask, org.apache.hadoop.fs.permission.FsPermission permission, boolean createIfNonExistant, boolean append, boolean overwrite, int bufferSize, short replication, long blockSize, org.apache.hadoop.util.Progressable progress, boolean createParent) throws IOException
      Throws:
      IOException

    • create

      public org.apache.hadoop.fs.FSDataOutputStream create(org.apache.hadoop.fs.Path f, boolean overwrite, int bufferSize, short replication, long blockSize) throws IOException
      Overrides:
      create in class org.apache.hadoop.fs.FileSystem
      Throws:
      IOException

    • create

      public org.apache.hadoop.fs.FSDataOutputStream create(org.apache.hadoop.fs.Path f, org.apache.hadoop.fs.permission.FsPermission permission, boolean overwrite, int bufferSize, short replication, long blockSize, org.apache.hadoop.util.Progressable progress) throws IOException
      Specified by:
      create in class org.apache.hadoop.fs.FileSystem
      Throws:
      IOException

    • create

      public org.apache.hadoop.fs.FSDataOutputStream create(org.apache.hadoop.fs.Path f, boolean overwrite) throws IOException
      Opens an FSDataOutputStream at the indicated Path.
      Overrides:
      create in class org.apache.hadoop.fs.FileSystem
      Throws:
      IOException

    • create

      public org.apache.hadoop.fs.FSDataOutputStream create(org.apache.hadoop.fs.Path f, org.apache.hadoop.util.Progressable progress) throws IOException
      Create an FSDataOutputStream at the indicated Path with write-progress reporting. Files are overwritten by default.
      Overrides:
      create in class org.apache.hadoop.fs.FileSystem
      Throws:
      IOException

    • create

      public org.apache.hadoop.fs.FSDataOutputStream create(org.apache.hadoop.fs.Path f, short replication) throws IOException
      Opens an FSDataOutputStream at the indicated Path. Files are overwritten by default.
      Overrides:
      create in class org.apache.hadoop.fs.FileSystem
      Throws:
      IOException

    • create

      public org.apache.hadoop.fs.FSDataOutputStream create(org.apache.hadoop.fs.Path f, short replication, org.apache.hadoop.util.Progressable progress) throws IOException
      Opens an FSDataOutputStream at the indicated Path with write-progress reporting. Files are overwritten by default.
      Overrides:
      create in class org.apache.hadoop.fs.FileSystem
      Throws:
      IOException

    • create

      public org.apache.hadoop.fs.FSDataOutputStream create(org.apache.hadoop.fs.Path f, boolean overwrite, int bufferSize) throws IOException
      Opens an FSDataOutputStream at the indicated Path.
      Overrides:
      create in class org.apache.hadoop.fs.FileSystem
      Parameters:
      f - the file name to open
      overwrite - if a file with this name already exists, then if true, the file will be overwritten, and if false an error will be thrown.
      bufferSize - the size of the buffer to be used.
      Throws:
      IOException

    • create

      public org.apache.hadoop.fs.FSDataOutputStream create(org.apache.hadoop.fs.Path f, boolean overwrite, int bufferSize, org.apache.hadoop.util.Progressable progress) throws IOException
      Opens an FSDataOutputStream at the indicated Path with write-progress reporting.
      Overrides:
      create in class org.apache.hadoop.fs.FileSystem
      Parameters:
      f - the file name to open
      overwrite - if a file with this name already exists, then if true, the file will be overwritten, and if false an error will be thrown.
      bufferSize - the size of the buffer to be used.
      Throws:
      IOException

    • truncate

      public boolean truncate(org.apache.hadoop.fs.Path f, long newLength) throws IOException
      Truncate the file in the indicated path to the indicated size.
      • Fails if path is a directory.
      • Fails if path does not exist.
      • Fails if path is not closed.
      • Fails if new size is greater than current size.
      Overrides:
      truncate in class org.apache.hadoop.fs.FileSystem
      Parameters:
      f - The path to the file to be truncated
      newLength - The size the file is to be truncated to
      Returns:
      true if the file has been truncated to the desired newLength and is immediately available to be reused for write operations such as append, or false if a background process of adjusting the length of the last block has been started, and clients should wait for it to complete before proceeding with further file updates.
      Throws:
      IOException

    • open

      public org.apache.hadoop.fs.FSDataInputStream open(org.apache.hadoop.fs.Path f, int bufferSize) throws IOException, org.apache.hadoop.security.AccessControlException
      Specified by:
      open in class org.apache.hadoop.fs.FileSystem
      Throws:
      IOException
      org.apache.hadoop.security.AccessControlException

    • getUri

      public URI getUri()
      Returns a URI whose scheme and authority identify this FileSystem.
      Specified by:
      getUri in class org.apache.hadoop.fs.FileSystem

    • getScheme

      public String getScheme()
      Overrides:
      getScheme in class org.apache.hadoop.fs.FileSystem

    • append

      public org.apache.hadoop.fs.FSDataOutputStream append(org.apache.hadoop.fs.Path f, int bufferSize, org.apache.hadoop.util.Progressable progress) throws IOException, org.apache.hadoop.security.AccessControlException
      Append to an existing file (optional operation).
      Specified by:
      append in class org.apache.hadoop.fs.FileSystem
      Parameters:
      f - the existing file to be appended.
      bufferSize - the size of the buffer to be used.
      progress - for reporting progress if it is not null.
      Throws:
      IOException
      org.apache.hadoop.security.AccessControlException

    • getFileStatus

      public org.apache.hadoop.fs.FileStatus getFileStatus(org.apache.hadoop.fs.Path f) throws IOException
      Specified by:
      getFileStatus in class org.apache.hadoop.fs.FileSystem
      Throws:
      IOException

    • rename

      public boolean rename(org.apache.hadoop.fs.Path src, org.apache.hadoop.fs.Path dst) throws IOException
      Renames Path src to Path dst. Can take place on local fs or remote DFS.
      Specified by:
      rename in class org.apache.hadoop.fs.FileSystem
      Throws:
      IOException

    • delete

      public boolean delete(org.apache.hadoop.fs.Path f, boolean recursive) throws IOException
      Delete a file.
      Specified by:
      delete in class org.apache.hadoop.fs.FileSystem
      Parameters:
      f - the path to delete.
      recursive - if path is a directory and set to true, the directory is deleted else throws an exception. In case of a file the recursive can be set to either true or false.
      Returns:
      true if delete is successful else false.
      Throws:
      IOException

    • deleteTable

      public boolean deleteTable(org.apache.hadoop.fs.Path tablePath) throws IOException
      Throws:
      IOException

    • delete

      public boolean delete(org.apache.hadoop.fs.Path f) throws IOException
      Overrides:
      delete in class org.apache.hadoop.fs.FileSystem
      Throws:
      IOException

    • setWorkingDirectory

      public void setWorkingDirectory(org.apache.hadoop.fs.Path new_dir)
      Set the current working directory for the given file system. All relative paths will be resolved relative to it.
      Specified by:
      setWorkingDirectory in class org.apache.hadoop.fs.FileSystem
      Parameters:
      new_dir -

    • getWorkingDirectory

      public org.apache.hadoop.fs.Path getWorkingDirectory()
      Get the current working directory for the given file system
      Specified by:
      getWorkingDirectory in class org.apache.hadoop.fs.FileSystem
      Returns:
      the directory pathname

    • getDefaultBlockSize

      public long getDefaultBlockSize()
      Overrides:
      getDefaultBlockSize in class org.apache.hadoop.fs.FileSystem

    • getDefaultReplication

      public short getDefaultReplication()
      Overrides:
      getDefaultReplication in class org.apache.hadoop.fs.FileSystem

    • getUserInfo

      public com.mapr.fs.jni.MapRUserInfo getUserInfo()

    • populateUserInfo

      public void populateUserInfo(org.apache.hadoop.fs.Path p) throws IOException
      Throws:
      IOException

    • populateAndGetUserInfo

      public com.mapr.fs.jni.MapRUserInfo populateAndGetUserInfo(org.apache.hadoop.fs.Path p) throws IOException
      Throws:
      IOException

    • mkdirs

      public boolean mkdirs(org.apache.hadoop.fs.Path p, org.apache.hadoop.fs.permission.FsPermission permission) throws IOException
      Make the given file and all non-existent parents into directories. Has the semantics of Unix 'mkdir -p'. Existence of the directory hierarchy is not an error.
      Specified by:
      mkdirs in class org.apache.hadoop.fs.FileSystem
      Throws:
      IOException

    • mkdirs

      public boolean mkdirs(org.apache.hadoop.fs.Path p, boolean createParent, org.apache.hadoop.fs.permission.FsPermission permission) throws IOException
      Throws:
      IOException

    • mkdirs

      public boolean mkdirs(org.apache.hadoop.fs.Path p, org.apache.hadoop.fs.permission.FsPermission permission, boolean compress) throws IOException
      mkdirs with compression option
      Throws:
      IOException

    • mkdirs

      public boolean mkdirs(org.apache.hadoop.fs.Path f, org.apache.hadoop.fs.permission.FsPermission permission, long chunkSize) throws IOException
      mkdirs with chunksize option
      Throws:
      IOException

    • mkdirs

      public boolean mkdirs(org.apache.hadoop.fs.Path f, org.apache.hadoop.fs.permission.FsPermission permission, boolean compress, long chunkSize) throws IOException
      mkdirs with compression and chunksize option
      Throws:
      IOException

    • getMapRFileStatus

      public MapRFileStatus getMapRFileStatus(org.apache.hadoop.fs.Path f) throws IOException
      Throws:
      IOException

    • fetchGNSConf

      public int fetchGNSConf() throws IOException
      Throws:
      IOException

    • slashReaddir

      public MapRFileStatus[] slashReaddir(String authority) throws IOException
      Throws:
      IOException

    • listMapRStatus

      public MapRFileStatus[] listMapRStatus(org.apache.hadoop.fs.Path f, boolean showVols, boolean showHidden) throws IOException
      Throws:
      IOException

    • listStatusLite

      public MapRReaddirLite listStatusLite(org.apache.hadoop.fs.Path f, int cid, int cinum, int uniq, int count, long cookie, boolean showHidden) throws IOException
      Path should be a directory.
      Throws:
      IOException

    • listDirLite

      public int listDirLite(org.apache.hadoop.fs.Path f) throws IOException
      Path should be a directory. Called from hadoop mfs -lsf . Implemented for Bug 31193 - hadoop fs -ls takes hours to finish on millions of files.
      Throws:
      IOException

    • listStatus

      public MapRFileStatus[] listStatus(org.apache.hadoop.fs.Path f) throws IOException
      List the statuses of the files/directories in the given path if the path is a directory.
      Specified by:
      listStatus in class org.apache.hadoop.fs.FileSystem
      Parameters:
      f - given path
      Returns:
      the statuses of the files/directories in the given patch
      Throws:
      IOException

    • close

      public void close() throws IOException
      Specified by:
      close in interface AutoCloseable
      Specified by:
      close in interface Closeable
      Overrides:
      close in class org.apache.hadoop.fs.FileSystem
      Throws:
      IOException

    • getUsed

      public long getUsed() throws IOException
      Return the total size of all files in the filesystem.
      Overrides:
      getUsed in class org.apache.hadoop.fs.FileSystem
      Throws:
      IOException

    • supportsSymlinks

      public boolean supportsSymlinks()
      Overrides:
      supportsSymlinks in class org.apache.hadoop.fs.FileSystem

    • createSymlink

      public void createSymlink(org.apache.hadoop.fs.Path target, org.apache.hadoop.fs.Path link, boolean createParent) throws org.apache.hadoop.security.AccessControlException, org.apache.hadoop.fs.FileAlreadyExistsException, FileNotFoundException, org.apache.hadoop.fs.ParentNotDirectoryException, IOException
      Overrides:
      createSymlink in class org.apache.hadoop.fs.FileSystem
      Throws:
      org.apache.hadoop.security.AccessControlException
      org.apache.hadoop.fs.FileAlreadyExistsException
      FileNotFoundException
      org.apache.hadoop.fs.ParentNotDirectoryException
      IOException

    • createSymlink

      public int createSymlink(String target, org.apache.hadoop.fs.Path link, boolean createParent) throws IOException
      Throws:
      IOException

    • removeRecursive

      public int removeRecursive(org.apache.hadoop.fs.Path f) throws org.apache.hadoop.security.AccessControlException, FileNotFoundException, IOException
      Throws:
      org.apache.hadoop.security.AccessControlException
      FileNotFoundException
      IOException

    • getMapRClient

      public MapRClientImpl getMapRClient() throws IOException
      Throws:
      IOException

    • createHardlink

      public int createHardlink(org.apache.hadoop.fs.Path oldpath, org.apache.hadoop.fs.Path newpath) throws org.apache.hadoop.security.AccessControlException, org.apache.hadoop.fs.FileAlreadyExistsException, FileNotFoundException, org.apache.hadoop.fs.ParentNotDirectoryException, IOException
      Throws:
      org.apache.hadoop.security.AccessControlException
      org.apache.hadoop.fs.FileAlreadyExistsException
      FileNotFoundException
      org.apache.hadoop.fs.ParentNotDirectoryException
      IOException

    • scanDir

      public MapRFileStatus[] scanDir(String cluster, String fidstr) throws IOException
      Throws:
      IOException

    • scanKV

      public byte[] scanKV(String cluster, String fidstr, byte[] start, byte[] end, int maxkeys) throws IOException
      Throws:
      IOException

    • scanKV

      public byte[] scanKV(String cluster, String fidstr, byte[] start, byte[] end, int maxkeys, boolean fromGfsck) throws IOException
      Throws:
      IOException

    • scanKVGivenFid

      public com.mapr.fs.proto.Fileserver.KvstoreScanResponse scanKVGivenFid(org.apache.hadoop.fs.Path URI, com.mapr.fs.proto.Common.FidMsg kvFid, com.mapr.fs.proto.Fileserver.KvStoreKey start, com.mapr.fs.proto.Fileserver.KvStoreKey end) throws IOException
      Throws:
      IOException

    • lookupKV

      public com.mapr.fs.proto.Fileserver.KvstoreLookupResponse lookupKV(org.apache.hadoop.fs.Path tableURI, com.mapr.fs.proto.Fileserver.KvStoreKey key) throws IOException
      Throws:
      IOException

    • createVolLink

      public int createVolLink(String cluster, String volName, org.apache.hadoop.fs.Path volLink, boolean writeable, boolean isHidden) throws IOException
      Throws:
      IOException

    • deleteVolLink

      public int deleteVolLink(String cluster, String volLink) throws IOException
      Throws:
      IOException

    • getHomeDirectory

      public org.apache.hadoop.fs.Path getHomeDirectory()
      utility functions
      Overrides:
      getHomeDirectory in class org.apache.hadoop.fs.FileSystem

    • makeAbsolute

      public org.apache.hadoop.fs.Path makeAbsolute(org.apache.hadoop.fs.Path path)

    • getClusterNameUnchecked

      public String getClusterNameUnchecked(String str)

    • getNameStr

      public String getNameStr(String str)

    • getName

      public String getName(org.apache.hadoop.fs.Path p)

    • getMapRFileBlockLocations

      public MapRBlockLocation[] getMapRFileBlockLocations(org.apache.hadoop.fs.FileStatus file, long start, long len, boolean usePrimaryFid, boolean needDiskBlocks, boolean fullBlockInfo) throws IOException
      Throws:
      IOException

    • getFileBlockLocations

      public org.apache.hadoop.fs.BlockLocation[] getFileBlockLocations(org.apache.hadoop.fs.FileStatus file, long start, long len) throws IOException
      Overrides:
      getFileBlockLocations in class org.apache.hadoop.fs.FileSystem
      Throws:
      IOException

    • setOwner

      public void setOwner(org.apache.hadoop.fs.Path p, String user, String group) throws IOException
      Overrides:
      setOwner in class org.apache.hadoop.fs.FileSystem
      Throws:
      IOException

    • setOwnerFid

      public void setOwnerFid(String pfid, String user, String group) throws IOException
      Specified by:
      setOwnerFid in interface org.apache.hadoop.maprfs.Fid
      Overrides:
      setOwnerFid in class org.apache.hadoop.fs.FileSystem
      Throws:
      IOException

    • setTimes

      public void setTimes(org.apache.hadoop.fs.Path p, long mtime, long atime) throws IOException
      Overrides:
      setTimes in class org.apache.hadoop.fs.FileSystem
      Throws:
      IOException

    • setPermission

      public void setPermission(org.apache.hadoop.fs.Path p, org.apache.hadoop.fs.permission.FsPermission permission) throws IOException
      Overrides:
      setPermission in class org.apache.hadoop.fs.FileSystem
      Throws:
      IOException

    • getFileLinkStatus

      public org.apache.hadoop.fs.FileStatus getFileLinkStatus(org.apache.hadoop.fs.Path f) throws org.apache.hadoop.security.AccessControlException, FileNotFoundException, org.apache.hadoop.fs.UnsupportedFileSystemException, IOException
      Overrides:
      getFileLinkStatus in class org.apache.hadoop.fs.FileSystem
      Throws:
      org.apache.hadoop.security.AccessControlException
      FileNotFoundException
      org.apache.hadoop.fs.UnsupportedFileSystemException
      IOException

    • getLinkTarget

      public org.apache.hadoop.fs.Path getLinkTarget(org.apache.hadoop.fs.Path f) throws IOException
      Overrides:
      getLinkTarget in class org.apache.hadoop.fs.FileSystem
      Throws:
      IOException

    • resolveLink

      protected org.apache.hadoop.fs.Path resolveLink(org.apache.hadoop.fs.Path f) throws IOException
      Overrides:
      resolveLink in class org.apache.hadoop.fs.FileSystem
      Throws:
      IOException

    • getStatus

      public org.apache.hadoop.fs.FsStatus getStatus() throws IOException
      Overrides:
      getStatus in class org.apache.hadoop.fs.FileSystem
      Throws:
      IOException

    • getStatus

      public org.apache.hadoop.fs.FsStatus getStatus(org.apache.hadoop.fs.Path p) throws IOException
      Overrides:
      getStatus in class org.apache.hadoop.fs.FileSystem
      Throws:
      IOException

    • setXAttr

      public void setXAttr(org.apache.hadoop.fs.Path path, String name, byte[] value, EnumSet<org.apache.hadoop.fs.XAttrSetFlag> flag) throws IOException
      Set an extended attribute on a file or directory.
      Overrides:
      setXAttr in class org.apache.hadoop.fs.FileSystem
      Parameters:
      path - The path to the file or directory.
      name - The extended attribute name. This must be prefixed with the namespace followed by ".". For example, "user.attr".
      value - The extended attribute value.
      flag - The value must be CREATE, to create a new extended attribute, or REPLACE, to replace an existing extended attribute. When creating a new extended attribute, an extended attribute with the given name must not already exist and when replacing, an extended attribute with the given name must already exist; else, an error is returned.
      Throws:
      IOException

    • setXAttr

      public void setXAttr(org.apache.hadoop.fs.Path path, String name, byte[] value) throws IOException
      Set or replace an extended attribute on a file or directory.
      Overrides:
      setXAttr in class org.apache.hadoop.fs.FileSystem
      Parameters:
      path - The path to the file or directory.
      name - The extended attribute name. This must be prefixed with the namespace followed by ".". For example, "user.attr".
      value - The extended attribute value.
      Throws:
      IOException

    • getXAttr

      public byte[] getXAttr(org.apache.hadoop.fs.Path path, String name) throws IOException
      Get the extended attribute associated with the given name on the given file or directory.
      Overrides:
      getXAttr in class org.apache.hadoop.fs.FileSystem
      Parameters:
      path - The path to the file or directory.
      name - The name of the extended attribute (to retrieve). The name must be prefixed with the namespace followed by ".". For example, "user.attr".
      Throws:
      IOException

    • getXAttrs

      public Map<String,byte[]> getXAttrs(org.apache.hadoop.fs.Path path) throws IOException
      Get all the extended attribute name/value pairs associated with the given file or directory. Only those extended attributes which the logged-in user has access to are returned.
      Overrides:
      getXAttrs in class org.apache.hadoop.fs.FileSystem
      Parameters:
      path - The path to the file or directory.
      Throws:
      IOException

    • getXAttrs

      public Map<String,byte[]> getXAttrs(org.apache.hadoop.fs.Path path, List<String> names) throws IOException
      Get the extended attributes associated with the given list of names on the given file or directory. Only those extended attributes which the logged-in user has access to are returned.
      Overrides:
      getXAttrs in class org.apache.hadoop.fs.FileSystem
      Parameters:
      path - The path to the file or directory.
      names - The names of the extended attributes (to retrieve).
      Throws:
      IOException

    • listXAttrs

      public List<String> listXAttrs(org.apache.hadoop.fs.Path path) throws IOException
      Get all the extended attribute names associated with the given file or directory.
      Overrides:
      listXAttrs in class org.apache.hadoop.fs.FileSystem
      Parameters:
      path - The path to the file or directory.
      Throws:
      IOException

    • removeXAttr

      public void removeXAttr(org.apache.hadoop.fs.Path path, String name) throws IOException
      Remove the extended attribute (specified by name) associated with the given file or directory.
      Overrides:
      removeXAttr in class org.apache.hadoop.fs.FileSystem
      Parameters:
      path - The path to the file or directory.
      name - The name of the extended attribute (to remove). The name must be prefixed with the namespace followed by ".". For example, "user.attr".
      Throws:
      IOException

    • executeCommand

      public <ReturnType> ReturnType executeCommand(com.mapr.fs.FSCommandHandler handler, com.mapr.fs.FSCommandHandler.ICommandExecutor<ReturnType> executor) throws IOException
      Throws:
      IOException

    • setCompression

      public int setCompression(org.apache.hadoop.fs.Path path, boolean val, String compName) throws IOException
      Throws:
      IOException

    • tierOp

      public com.mapr.fs.jni.JNIFileTierStatus tierOp(int op, org.apache.hadoop.fs.Path path, boolean verbose, boolean blocking, long shaHigh, long shaLow, long uniq) throws IOException
      Throws:
      IOException

    • getStat

      public MapRFileStatus getStat(org.apache.hadoop.fs.Path path) throws IOException
      Throws:
      IOException

    • getFileCount

      public com.mapr.fs.jni.MapRFileCount getFileCount(org.apache.hadoop.fs.Path f) throws IOException
      Throws:
      IOException

    • modifyAudit

      public int modifyAudit(org.apache.hadoop.fs.Path path, boolean val) throws IOException
      Throws:
      IOException

    • setWireSecurity

      public int setWireSecurity(org.apache.hadoop.fs.Path path, boolean val) throws IOException
      Throws:
      IOException

    • setDiskFlush

      public int setDiskFlush(org.apache.hadoop.fs.Path path, boolean val) throws IOException
      Throws:
      IOException

    • setAces

      public void setAces(org.apache.hadoop.fs.Path path, List<MapRFileAce> aces) throws IOException
      This method fully replace ACEs of a file or directory, discarding all existing ones.
      Parameters:
      path - path to set ACEs
      aces - list of file ACEs
      Throws:
      IOException - if an ACE could not be replaced

    • setAces

      public void setAces(org.apache.hadoop.fs.Path path, List<MapRFileAce> aces, boolean recursive) throws IOException
      This method fully replace ACEs of a file or directory recursively, discarding all existing ones.
      Parameters:
      path - path to set ACEs (recursively)
      aces - list of file ACEs
      recursive - whether to apply ACE recursively true/false
      Throws:
      IOException - if an ACE could not be replaced

    • modifyAces

      public void modifyAces(org.apache.hadoop.fs.Path path, List<MapRFileAce> aces) throws IOException
      This method modifies ACEs of a file or directory. It can add new ACEs or replace an existing ones. All existing ACEs that are unspecified in the current call are retained without changes.
      Parameters:
      path - path to set ACEs
      aces - list of file ACEs
      Throws:
      IOException - if an ACE could not be modified

    • deleteAces

      public void deleteAces(org.apache.hadoop.fs.Path path) throws IOException
      This method deletes all ACEs of a file or directory.
      Parameters:
      path - path to delete ACEs
      Throws:
      IOException - if an ACEs could not be modified

    • deleteAces

      public void deleteAces(org.apache.hadoop.fs.Path path, boolean recursive) throws IOException
      This method deletes all ACEs of a file or directory recursively.
      Specified by:
      deleteAces in class org.apache.hadoop.maprfs.AbstractMapRFileSystem
      Parameters:
      path - path to delete ACEs (recursively)
      recursive - whether to delete ACE recursively true/false
      Throws:
      IOException - if an ACEs could not be modified

    • getAces

      public List<MapRFileAce> getAces(org.apache.hadoop.fs.Path path) throws IOException
      This method gets the ACEs of a file or directory.
      Parameters:
      path - path to set ACEs
      Returns:
      list of aces of a file or directory
      Throws:
      IOException - if an ACE could not be read

    • addAceEntryError

      public void addAceEntryError(ArrayList<FileAceEntry> acesList, org.apache.hadoop.fs.Path path, int err)

    • getAces

      public ArrayList<FileAceEntry> getAces(org.apache.hadoop.fs.Path path, boolean recursive) throws IOException
      Throws:
      IOException

    • getAces

      public ArrayList<FileAceEntry> getAces(org.apache.hadoop.fs.Path path, boolean recursive, int symLinkHeight) throws IOException
      Throws:
      IOException

    • getAces

      public ArrayList<FileAceEntry> getAces(org.apache.hadoop.fs.Path path, boolean recursive, int symLinkHeight, int serveridx) throws IOException
      Throws:
      IOException

    • copyAce

      public int copyAce(org.apache.hadoop.fs.Path src, org.apache.hadoop.fs.Path dst) throws IOException
      This method copies ACEs on source to destination.
      Specified by:
      copyAce in class org.apache.hadoop.maprfs.AbstractMapRFileSystem
      Parameters:
      src - path of source
      dest - path of destination
      Throws:
      IOException - if an ACE could not be read/modified

    • delAces

      public int delAces(org.apache.hadoop.fs.Path path, boolean recursive) throws IOException
      Throws:
      IOException

    • delAces

      public int delAces(org.apache.hadoop.fs.Path path, boolean recursive, int symLinkHeight) throws IOException
      Throws:
      IOException

    • setAces

      public void setAces(org.apache.hadoop.fs.Path path, String strAces, boolean isSet, int noinherit, int preservemodebits, boolean recursive) throws IOException
      This method fully replaces ACEs of a file or directory recursively, discarding all existing ones. Accepts ACE parameter as String in short format. [rf:],[wf:],[ef:],[rd:],[ac:],[dc:],[ld:]
      Specified by:
      setAces in class org.apache.hadoop.maprfs.AbstractMapRFileSystem
      Parameters:
      path - path to set ACEs
      strAces - string of file ACEs in short format
      isSet - fully replace ACE if true or merge with existing ACE if false
      noinherit - do not inherit aces instead use umask
      preservemodebits - to not overwrite mode bits
      recursive - whether to apply ACE recursively true/false
      Throws:
      IOException - if an ACE could not be replaced

    • setAces

      public int setAces(org.apache.hadoop.fs.Path path, ArrayList<com.mapr.fs.proto.Common.FileACE> aces, boolean isSet, int noinherit, int preservemodebits, boolean recursive, org.apache.hadoop.fs.Path hintAcePath) throws IOException
      Throws:
      IOException

    • setAces

      public int setAces(org.apache.hadoop.fs.Path path, ArrayList<com.mapr.fs.proto.Common.FileACE> aces, boolean isSet, int noinherit, int preservemodebits, boolean recursive, org.apache.hadoop.fs.Path hintAcePath, int symLinkHeight) throws IOException
      Throws:
      IOException

    • setChunkSize

      public int setChunkSize(org.apache.hadoop.fs.Path path, long val) throws IOException
      Throws:
      IOException

    • getCidFromPath

      public int getCidFromPath(org.apache.hadoop.fs.Path path)

    • mountVolume

      public int mountVolume(String cluster, String volName, String mountPath, String username)
      Creates directory entry for volName at mountPath. Expects absolute path for mountPath

    • unmountVolume

      public int unmountVolume(String cluster, String volName, String mountPath, String username, int pCid, int pCinum, int pUniq)
      Removes directory entry for volName Expects absolute path for mountPath

    • getVolumeName

      public String getVolumeName(int volId) throws IOException
      This method gets the volume name for a given volume id.
      Parameters:
      volId - volume id
      Returns:
      volume name
      Throws:
      IOException - if input volume id is invalid.

    • getVolumeNameCached

      public String getVolumeNameCached(int volId) throws IOException
      This method gets the volume name for a given volume id.
      Parameters:
      volId - volume id
      Returns:
      volume name
      Throws:
      IOException - if input volume id is invalid.

    • getMountPathFid

      public String getMountPathFid(String fidStr) throws IOException
      Throws:
      IOException

    • addFidMountPathToCache

      public int addFidMountPathToCache(String fidStr, String path, boolean forceUpdate)

    • getMountPathFidCached

      public String getMountPathFidCached(String fidStr) throws IOException
      Throws:
      IOException

    • getMountPathFidCached

      public String getMountPathFidCached(String fidStr, boolean skipFSCall) throws IOException
      Throws:
      IOException

    • getMountPath

      public String getMountPath(String cluster, String username, int pCid, int pCinum, int pUniq, boolean useCache)

    • getMountPath

      public String getMountPath(String cluster, String username, int pCid, int pCinum, int pUniq, boolean useCache, boolean skipFSCall)

    • getMountPath

      public String getMountPath(String cluster, String username, int pCid, int pCinum, int pUniq)

    • createSnapshot

      public int createSnapshot(String cluster, String volumeName, int volId, int rootCid, String snapshotName, boolean mirrorSnapshot, long expirationTime, String username)

    • createSnapshot

      public int createSnapshot(String cluster, String volumeName, int volId, int rootCid, String snapshotName, boolean mirrorSnapshot, long expirationTime, String username, long clusterOps)

    • getQueryServiceParam

      public QueryServiceParam getQueryServiceParam() throws IOException, InterruptedException
      Return the QueryServiceParam from the default cluster.
      Throws:
      IOException
      InterruptedException

    • getQueryServiceParam

      public QueryServiceParam getQueryServiceParam(String clusterName) throws IOException, InterruptedException
      Return the QueryServiceParam from the specified cluster.
      Throws:
      IOException
      InterruptedException

    • setQueryServiceParam

      public void setQueryServiceParam(QueryServiceParam qsp) throws IOException, InterruptedException
      Sets the QueryServiceParam for the default cluster.
      Throws:
      IOException
      InterruptedException

    • setQueryServiceParam

      public void setQueryServiceParam(String clusterName, QueryServiceParam qsp) throws IOException, InterruptedException
      Sets the QueryServiceParam for the specified cluster.
      Throws:
      IOException
      InterruptedException

    • clearQueryServiceParam

      public void clearQueryServiceParam() throws IOException, InterruptedException
      Clears the QueryServiceParam for the default cluster.
      Throws:
      IOException
      InterruptedException

    • clearQueryServiceParam

      public void clearQueryServiceParam(String clusterName) throws IOException, InterruptedException
      Clears the QueryServiceParam for the specified cluster.
      Throws:
      IOException
      InterruptedException

    • getZkConnectString

      public String getZkConnectString() throws IOException
      Overrides:
      getZkConnectString in class org.apache.hadoop.fs.FileSystem
      Throws:
      IOException

    • getMapRClient

      public Object getMapRClient(String uri) throws IOException
      Throws:
      IOException

    • getJobTrackerAddrs

      public InetSocketAddress[] getJobTrackerAddrs(org.apache.hadoop.conf.Configuration conf) throws IOException
      Overrides:
      getJobTrackerAddrs in class org.apache.hadoop.fs.FileSystem
      Throws:
      IOException

    • getClusterConf

      public static ClusterConf getClusterConf()

    • getTrimmedStrings

      public static String[] getTrimmedStrings(String str)
      Splits a comma separated value String, trimming leading and trailing whitespace on each value.
      Parameters:
      str - a comma separated with values
      Returns:
      an array of String values

    • fidToString

      @Deprecated public static String fidToString(com.mapr.fs.proto.Common.FidMsg fid)
      Deprecated.
      Use Fids.fidToString(FidMsg)
      Convert FidMsg to String form

    • isFidString

      @Deprecated public static boolean isFidString(String fid)
      Deprecated.
      Use Fids.isFidString(String)

    • validateFid

      @Deprecated public static void validateFid(String fid) throws IOException
      Deprecated.
      Use Fids.validateFid(String)
      Throws:
      IOException

    • createSymbolicLink

      public void createSymbolicLink(org.apache.hadoop.fs.Path target, org.apache.hadoop.fs.Path link) throws IOException
      Throws:
      IOException

    • openTable

      public Inode openTable(org.apache.hadoop.fs.Path tableURI, MapRHTable htable) throws IOException
      Throws:
      IOException

    • openTableWithFid

      public Inode openTableWithFid(org.apache.hadoop.fs.Path priTableURI, String indexFid, MapRHTable htable) throws IOException
      Throws:
      IOException

    • getSecurityPolicyNameOrId

      public String getSecurityPolicyNameOrId(int spId) throws IOException
      This method gets the security policyname for a given security policy id. Results are cached.
      Parameters:
      spId - security policy id
      Returns:
      security policy name
      Throws:
      IOException

    • getSecurityPolicyName

      public String getSecurityPolicyName(int policyID) throws IOException
      This method gets the security policyname for a given security policy id. Results are cached.
      Parameters:
      spId - security policy id
      Returns:
      security policy name
      Throws:
      IOException

    • getSecurityPolicyIds

      public List<Integer> getSecurityPolicyIds(List<String> securityPolicyTagList) throws IOException
      This method gets the security policy ids for given security policy names from the policy cache maintained in the MapClient in JNI. Results are not cached. This method should be called only for admin/non-datapath operations
      Parameters:
      spNames - security policy names
      Returns:
      security policy Ids
      Throws:
      IOException

    • getSecurityPolicyId

      public int getSecurityPolicyId(String policyName) throws IOException
      This method gets the security policy id for a single security policy name. Results are cached.
      Parameters:
      spId - security policy id
      Returns:
      security policy Name
      Throws:
      IOException

    • getClusterSecurityPolicies

      public Map<String,Integer> getClusterSecurityPolicies() throws IOException
      Throws:
      IOException

    • createTable

      public String createTable(org.apache.hadoop.fs.Path tableURI, String user, com.mapr.fs.proto.Dbserver.TableAttr attr, com.mapr.fs.proto.Dbserver.TableAces aces, byte[][] splitKeys, boolean needServerInfo, int auditValue) throws IOException
      Throws:
      IOException

    • createTable

      public String createTable(org.apache.hadoop.fs.Path tableURI, String user, com.mapr.fs.proto.Dbserver.TableAttr attr, com.mapr.fs.proto.Dbserver.TableAces aces, byte[][] splitKeys, boolean needServerInfo, int auditValue, List<String> securityPolicyTagList) throws IOException
      Throws:
      IOException

    • createTable

      public String createTable(org.apache.hadoop.fs.Path tableURI, String user, com.mapr.fs.proto.Dbserver.TableAttr attr, com.mapr.fs.proto.Dbserver.TableAces aces, byte[][] splitKeys, boolean needServerInfo, int auditValue, List<String> securityPolicyTagList, TableCreateOptions options) throws IOException
      Throws:
      IOException

    • createTable

      public void createTable(org.apache.hadoop.fs.Path tableURI, String user, com.mapr.fs.proto.Dbserver.TableAttr attr, com.mapr.baseutils.utils.AceHelper.DBPermission dbperm, int auditValue) throws IOException
      Throws:
      IOException

    • createTable

      public void createTable(org.apache.hadoop.fs.Path tableURI, String user, com.mapr.fs.proto.Dbserver.TableAttr attr, com.mapr.baseutils.utils.AceHelper.DBPermission dbperm, int auditValue, List<String> securityPolicyTagList) throws IOException
      Throws:
      IOException

    • createTable

      public void createTable(org.apache.hadoop.fs.Path tableURI, String user, com.mapr.fs.proto.Dbserver.TableAttr attr, com.mapr.baseutils.utils.AceHelper.DBPermission dbperm, byte[][] splitKeys, int auditValue, List<String> securityPolicyTagList) throws IOException
      Throws:
      IOException

    • createTable

      public void createTable(org.apache.hadoop.fs.Path tableURI, String user, com.mapr.fs.proto.Dbserver.TableAttr attr, com.mapr.baseutils.utils.AceHelper.DBPermission dbperm, byte[][] splitKeys, int auditValue, List<String> securityPolicyTagList, TableCreateOptions options) throws IOException
      Throws:
      IOException

    • createTable

      public void createTable(org.apache.hadoop.fs.Path tableURI, String user, com.mapr.fs.proto.Dbserver.TableAttr attr, com.mapr.baseutils.utils.AceHelper.DBPermission dbperm, byte[][] splitKeys, int auditValue) throws IOException
      Throws:
      IOException

    • createTable

      public void createTable(org.apache.hadoop.fs.Path tableURI, String user) throws IOException
      Throws:
      IOException

    • createTable

      public void createTable(org.apache.hadoop.fs.Path tableURI) throws IOException
      Throws:
      IOException

    • createTable

      public void createTable(org.apache.hadoop.fs.Path tableURI, String user, byte[][] splitKeys) throws IOException
      Throws:
      IOException

    • createTable

      public void createTable(org.apache.hadoop.fs.Path tableURI, byte[][] splitKeys, boolean isBulkLoad, boolean isJson) throws IOException
      Throws:
      IOException

    • createTable

      public void createTable(org.apache.hadoop.fs.Path tableURI, byte[][] splitKeys, boolean isBulkLoad, boolean isJson, boolean insertOrder) throws IOException
      Throws:
      IOException

    • getTablets

      public com.mapr.fs.proto.Dbserver.TabletLookupResponse getTablets(org.apache.hadoop.fs.Path tableURI, String indexFid, byte[] stKey, byte[] endKey, boolean needSpaceUsage) throws IOException
      Throws:
      IOException

    • getTablets

      public com.mapr.fs.proto.Dbserver.TabletLookupResponse getTablets(org.apache.hadoop.fs.Path tableURI, String indexFid, byte[] stKey, byte[] endKey, boolean needSpaceUsage, boolean prefetchTabletMap) throws IOException
      Throws:
      IOException

    • createColumnFamily

      public void createColumnFamily(org.apache.hadoop.fs.Path tableURI, String name, com.mapr.fs.proto.Dbserver.ColumnFamilyAttr cfAttr) throws IOException
      Throws:
      IOException

    • createColumnFamily

      public void createColumnFamily(org.apache.hadoop.fs.Path tableURI, String name, com.mapr.fs.proto.Dbserver.ColumnFamilyAttr cfAttr, com.mapr.baseutils.utils.AceHelper.DBPermission dbperm, List<String> securityPolicyTagList) throws IOException
      Throws:
      IOException

    • createColumnFamily

      public void createColumnFamily(org.apache.hadoop.fs.Path tableURI, String name, com.mapr.fs.proto.Dbserver.ColumnFamilyAttr cfAttr, List<String> securityPolicyTagList) throws IOException
      Throws:
      IOException

    • modifyColumnFamily

      public void modifyColumnFamily(org.apache.hadoop.fs.Path tableURI, String name, com.mapr.fs.proto.Dbserver.ColumnFamilyAttr cfAttr, com.mapr.baseutils.utils.AceHelper.DBPermission dbperm) throws IOException
      Throws:
      IOException

    • modifyColumnFamily

      public void modifyColumnFamily(org.apache.hadoop.fs.Path tableURI, String name, com.mapr.fs.proto.Dbserver.ColumnFamilyAttr cfAttr, com.mapr.fs.proto.Dbserver.SecurityPolicyOperation securityPolicyOp, com.mapr.baseutils.utils.AceHelper.DBPermission dbperm) throws IOException
      Throws:
      IOException

    • modifyColumnFamily

      public void modifyColumnFamily(org.apache.hadoop.fs.Path tableURI, String name, com.mapr.fs.proto.Dbserver.ColumnFamilyAttr cfAttr) throws IOException
      Throws:
      IOException

    • modifyColumnFamily

      public void modifyColumnFamily(org.apache.hadoop.fs.Path tableURI, String name, com.mapr.fs.proto.Dbserver.SecurityPolicyOperation securityPolicyOp, com.mapr.fs.proto.Dbserver.ColumnFamilyAttr cfAttr) throws IOException
      Throws:
      IOException

    • deleteColumnFamily

      public void deleteColumnFamily(org.apache.hadoop.fs.Path tableURI, String name) throws IOException
      Throws:
      IOException

    • listColumnFamily

      public List<com.mapr.fs.proto.Dbserver.ColumnFamilyAttr> listColumnFamily(org.apache.hadoop.fs.Path tableURI, boolean wantAces) throws IOException
      Throws:
      IOException

    • listColumnFamily

      public List<com.mapr.fs.proto.Dbserver.ColumnFamilyAttr> listColumnFamily(org.apache.hadoop.fs.Path tableURI, boolean wantAces, boolean useCached) throws IOException
      Throws:
      IOException

    • modifyDbSecurityPolicy

      public void modifyDbSecurityPolicy(org.apache.hadoop.fs.Path tableURI, com.mapr.baseutils.utils.AceHelper.DBPermission dbperm, List<String> securityPolicyTagList, com.mapr.fs.proto.Dbserver.SecurityPolicyOperation op) throws IOException
      Throws:
      IOException

    • modifyDbCfSecurityPolicy

      public void modifyDbCfSecurityPolicy(org.apache.hadoop.fs.Path tableURI, com.mapr.baseutils.utils.AceHelper.DBPermission dbperm, List<String> securityPolicyTagList, com.mapr.fs.proto.Dbserver.SecurityPolicyOperation op, String cfname) throws IOException
      Throws:
      IOException

    • modifyTableAttr

      public void modifyTableAttr(org.apache.hadoop.fs.Path tableURI, com.mapr.fs.proto.Dbserver.TableAttr am, com.mapr.baseutils.utils.AceHelper.DBPermission dbperm) throws IOException
      Throws:
      IOException

    • modifyTableAttr

      public void modifyTableAttr(org.apache.hadoop.fs.Path tableURI, com.mapr.fs.proto.Dbserver.TableAttr am, com.mapr.baseutils.utils.AceHelper.DBPermission dbperm, boolean genUuid) throws IOException
      Throws:
      IOException

    • modifyTableAttr

      public void modifyTableAttr(org.apache.hadoop.fs.Path tableURI, com.mapr.fs.proto.Dbserver.TableAttr am, com.mapr.baseutils.utils.AceHelper.DBPermission dbperm, boolean genUuid, com.mapr.fs.proto.Dbserver.SecurityPolicyOperation securityPolicyOp) throws IOException
      Throws:
      IOException

    • modifyTableAttr

      public void modifyTableAttr(org.apache.hadoop.fs.Path tableURI, com.mapr.fs.proto.Dbserver.TableAttr am, com.mapr.fs.proto.Dbserver.TableAces aces) throws IOException
      Throws:
      IOException

    • modifyTableAttr

      public void modifyTableAttr(org.apache.hadoop.fs.Path tableURI, com.mapr.fs.proto.Dbserver.TableAttr am, com.mapr.fs.proto.Dbserver.TableAces aces, boolean genUuid, com.mapr.fs.proto.Dbserver.SecurityPolicyOperation securityPolicyOp) throws IOException
      Throws:
      IOException

    • getTableBasicAttrs

      public TableBasicAttrs getTableBasicAttrs(org.apache.hadoop.fs.Path tableURI) throws IOException
      Throws:
      IOException

    • getTableProperties

      public TableProperties getTableProperties(org.apache.hadoop.fs.Path tableURI) throws IOException
      Throws:
      IOException

    • splitTableRegion

      public void splitTableRegion(org.apache.hadoop.fs.Path tableURI, String fidstr, boolean ignoreRegionTooSmallError) throws IOException
      Throws:
      IOException

    • packTableRegion

      public void packTableRegion(org.apache.hadoop.fs.Path tableURI, String fidstr, int ctype) throws IOException
      Throws:
      IOException

    • mergeTableRegion

      public void mergeTableRegion(org.apache.hadoop.fs.Path tableURI, String fidstr) throws IOException
      Throws:
      IOException

    • getTabletScanner

      public MapRTabletScanner getTabletScanner(org.apache.hadoop.fs.Path tableURI, String indexFid) throws IOException
      Throws:
      IOException

    • getTabletScanner

      public MapRTabletScanner getTabletScanner(org.apache.hadoop.fs.Path tableURI, String indexFid, boolean needSpaceUsage, boolean prefetchTabletMap) throws IOException
      Throws:
      IOException

    • getContainerInfo

      public byte[] getContainerInfo(org.apache.hadoop.fs.Path path, List<Integer> cidList) throws IOException
      Throws:
      IOException

    • getTabletScanner

      public MapRTabletScanner getTabletScanner(org.apache.hadoop.fs.Path tableURI, String indexFid, byte[] startKey) throws IOException
      Throws:
      IOException

    • getTabletScanner

      public MapRTabletScanner getTabletScanner(org.apache.hadoop.fs.Path tableURI, String indexFid, byte[] startKey, byte[] endKey, boolean needSpaceUsage, boolean prefetchTabletMap) throws IOException
      Throws:
      IOException

    • getTabletStat

      public com.mapr.fs.proto.Dbserver.TabletStatResponse getTabletStat(org.apache.hadoop.fs.Path tablePath, com.mapr.fs.proto.Common.FidMsg tabletFid) throws IOException
      Throws:
      IOException

    • addTableReplica

      public void addTableReplica(org.apache.hadoop.fs.Path tableURI, com.mapr.fs.proto.Dbserver.TableReplicaDesc desc, com.mapr.fs.proto.Dbserver.TableReplAutoSetupInfo ainfo) throws IOException, UnsupportedOperationException
      Throws:
      IOException
      UnsupportedOperationException

    • editTableReplica

      public void editTableReplica(org.apache.hadoop.fs.Path tableURI, String clusterName, String replicaPath, boolean allowAllCfs, com.mapr.fs.proto.Dbserver.TableReplicaDesc desc) throws IOException
      Throws:
      IOException

    • editTableReplica

      public void editTableReplica(org.apache.hadoop.fs.Path tableURI, String clusterName, String replicaPath, String topicName, boolean allowAllCfs, com.mapr.fs.proto.Dbserver.TableReplicaDesc desc) throws IOException
      Throws:
      IOException

    • getTableStats

      public com.mapr.fs.proto.Dbserver.TableBasicStats getTableStats(org.apache.hadoop.fs.Path tableURI, String indexFid) throws IOException
      Throws:
      IOException

    • getScanRangeStats

      public com.mapr.fs.proto.Dbserver.TableBasicStats getScanRangeStats(org.apache.hadoop.fs.Path tableURI, String indexFid, byte[] stKey, byte[] endKey) throws IOException
      Throws:
      IOException

    • listTableIndexes

      public com.mapr.fs.proto.Dbserver.TableReplicaListResponse listTableIndexes(org.apache.hadoop.fs.Path tableURI, boolean wantStats, boolean skipFieldsReadPermCheck, boolean refreshNow) throws IOException
      Throws:
      IOException

    • listTableReplicas

      public com.mapr.fs.proto.Dbserver.TableReplicaListResponse listTableReplicas(org.apache.hadoop.fs.Path tableURI, boolean wantStats, boolean refreshNow, boolean getCompactInfo) throws IOException
      Throws:
      IOException

    • removeTableReplica

      public void removeTableReplica(org.apache.hadoop.fs.Path tableURI, com.mapr.fs.proto.Dbserver.TableReplicaDesc desc) throws IOException
      Throws:
      IOException

    • addTableUpstream

      public void addTableUpstream(org.apache.hadoop.fs.Path tableURI, com.mapr.fs.proto.Dbserver.TableUpstreamDesc desc) throws IOException
      Throws:
      IOException

    • listTableUpstreams

      public com.mapr.fs.proto.Dbserver.TableUpstreamListResponse listTableUpstreams(org.apache.hadoop.fs.Path tableURI) throws IOException
      Throws:
      IOException

    • removeTableUpstream

      public void removeTableUpstream(org.apache.hadoop.fs.Path tableURI, com.mapr.fs.proto.Dbserver.TableUpstreamDesc desc) throws IOException
      Throws:
      IOException

    • getServerForCid

      public String getServerForCid(int cid, String cluster) throws IOException
      Throws:
      IOException

    • getDefaultClusterName

      public String getDefaultClusterName()

    • getClusterName

      public String getClusterName(URI p) throws IOException
      Throws:
      IOException

    • getServerForCid

      public String getServerForCid(int cid) throws IOException
      Throws:
      IOException

    • openFid2

      public org.apache.hadoop.fs.FSDataInputStream openFid2(org.apache.hadoop.fs.PathId pfid, String file, int readAheadBytesHint) throws IOException
      Specified by:
      openFid2 in interface org.apache.hadoop.maprfs.Fid
      Overrides:
      openFid2 in class org.apache.hadoop.fs.FileSystem
      Throws:
      IOException

    • openFid

      public org.apache.hadoop.fs.FSDataInputStream openFid(String fid, byte[][] ips, int[] ports, long chunkSize, long fileSize) throws IOException
      Throws:
      IOException

    • openFid

      public org.apache.hadoop.fs.FSDataInputStream openFid(String pfid, String file, byte[][] ips, int[] ports) throws IOException
      Throws:
      IOException

    • createFid

      public org.apache.hadoop.fs.FSDataOutputStream createFid(String pfid, String file) throws IOException
      Specified by:
      createFid in interface org.apache.hadoop.maprfs.Fid
      Overrides:
      createFid in class org.apache.hadoop.fs.FileSystem
      Throws:
      IOException

    • createFid

      public org.apache.hadoop.fs.FSDataOutputStream createFid(String pfid, String file, boolean overwrite) throws IOException
      Specified by:
      createFid in interface org.apache.hadoop.maprfs.Fid
      Specified by:
      createFid in class org.apache.hadoop.maprfs.AbstractMapRFileSystem
      Throws:
      IOException

    • deleteFid

      public boolean deleteFid(String pfid, String dir) throws IOException
      Specified by:
      deleteFid in interface org.apache.hadoop.maprfs.Fid
      Overrides:
      deleteFid in class org.apache.hadoop.fs.FileSystem
      Throws:
      IOException

    • mkdirsFid

      public String mkdirsFid(String pfid, String dir) throws IOException
      Specified by:
      mkdirsFid in interface org.apache.hadoop.maprfs.Fid
      Overrides:
      mkdirsFid in class org.apache.hadoop.fs.FileSystem
      Throws:
      IOException

    • mkdirsFid

      public String mkdirsFid(org.apache.hadoop.fs.Path p) throws IOException
      Specified by:
      mkdirsFid in interface org.apache.hadoop.maprfs.Fid
      Overrides:
      mkdirsFid in class org.apache.hadoop.fs.FileSystem
      Throws:
      IOException

    • resolveTablePath

      public org.apache.hadoop.fs.Path resolveTablePath(org.apache.hadoop.fs.Path path) throws IOException
      Throws:
      IOException

    • isTable

      public boolean isTable(org.apache.hadoop.fs.Path path) throws IOException
      Throws:
      IOException

    • isJsonTable

      public boolean isJsonTable(org.apache.hadoop.fs.Path path) throws IOException
      Throws:
      IOException

    • isStream

      public boolean isStream(org.apache.hadoop.fs.Path path) throws IOException
      Throws:
      IOException

    • isChangelog

      public boolean isChangelog(org.apache.hadoop.fs.Path path) throws IOException
      Throws:
      IOException

    • GatewaySourceToString

      public String GatewaySourceToString(int source)

    • getGatewayIps

      public com.mapr.fs.jni.IPPort[] getGatewayIps(String file, String dstCluster, boolean skipCache, com.mapr.fs.jni.GatewaySource source) throws IOException
      Throws:
      IOException

    • getGatewayIps

      public com.mapr.fs.jni.IPPort[] getGatewayIps(String file) throws IOException
      Throws:
      IOException

    • getClusterNameUnique

      public boolean getClusterNameUnique()

    • getClusterList

      public List<ClusterConf.ClusterEntry> getClusterList()

    • enablePrivilegedProcessAccess

      public void enablePrivilegedProcessAccess(boolean enable) throws IOException
      Throws:
      IOException

    • getRAThreads

      public static int getRAThreads()

    • addDelegationTokens

      public org.apache.hadoop.security.token.Token<?>[] addDelegationTokens(String renewer, org.apache.hadoop.security.Credentials credentials)
      Specified by:
      addDelegationTokens in interface org.apache.hadoop.security.token.DelegationTokenIssuer

    • addSecurityPolicy

      public int addSecurityPolicy(org.apache.hadoop.fs.Path path, String securityPolicyTag, boolean recursive) throws IOException
      This method adds a single security policy tag to the list of existing security policy tags (if any) for the file or directory specified in path. The securityPolicyTag parameter is the security policy name.
      Parameters:
      path - The full path name to the file to be tagged
      securityPolicyTag - The security policy tag
      Returns:
      This method returns 0 if successful, or a Unix error code otherwise.
      Throws:
      IOException - if the file cannot be tagged

    • addSecurityPolicy

      public int addSecurityPolicy(org.apache.hadoop.fs.Path path, List<String> securityPolicyTags, boolean recursive) throws IOException
      This method adds one or more security policy tags to the list of existing security policy tags (if any) for the file or directory specified in path. The securityPolicyTags parameter is a list of one or more security policy names.
      Parameters:
      path - The full path name to the file to be tagged
      securityPolicyTags - The list of security policy names
      Returns:
      This method returns 0 if successful, or a Unix error code otherwise.
      Throws:
      IOException - if the file cannot be tagged

    • setSecurityPolicy

      public int setSecurityPolicy(org.apache.hadoop.fs.Path path, String securityPolicyTag, boolean recursive) throws IOException
      This method sets the security policy tag to the file or directory specified in path, replacing all existing tags.
      Parameters:
      path - The full path name to the file to be tagged
      securityPolicyTags - The security policy tag
      Returns:
      This method returns 0 if successful, or a Unix error code otherwise.
      Throws:
      IOException - if the file cannot be tagged

    • setSecurityPolicy

      public int setSecurityPolicy(org.apache.hadoop.fs.Path path, List<String> securityPolicyTags, boolean recursive) throws IOException
      This method sets one or more security policy tags for the file or directory specified in path, replacing any existing security policies. The securityPolicyTags parameter is a list of one or more security policy names.
      Parameters:
      path - The full path name to the file to be tagged
      securityPolicyTags - The security policy tag
      Returns:
      This method returns 0 if successful, or a Unix error code otherwise.
      Throws:
      IOException - if the file cannot be tagged

    • removeSecurityPolicy

      public int removeSecurityPolicy(org.apache.hadoop.fs.Path path, String securityPolicyTag, boolean recursive) throws IOException
      This method removes the security policy named securityPolicy from the list of existing security policies (if any) for the file or directory specified in path.
      Parameters:
      securityPolicyTag - The security policy tag
      Returns:
      This method returns 0 if successful, or a Unix error code otherwise.
      Throws:
      IOException - if the tag cannot be removed

    • removeSecurityPolicy

      public int removeSecurityPolicy(org.apache.hadoop.fs.Path path, List<String> securityPolicyTags, boolean recursive) throws IOException
      This method removes one or more security policy tags from the list of existing security policy tags (if any) for the file or directory specified in path. The securityPolicyTags parameter is a list of one or more security policy names.
      Parameters:
      path - The full path name to the file where the tag is to be removed
      securityPolicyTags - The security policy tags to remove
      Returns:
      This method returns 0 if successful, or a Unix error code otherwise.
      Throws:
      IOException - if the tag cannot be removed

    • removeAllSecurityPolicies

      public int removeAllSecurityPolicies(org.apache.hadoop.fs.Path path, boolean recursive) throws IOException
      This method removes all security policy tags associated to the file or directory specified by path.
      Parameters:
      path - The full path name to the file or directory where all tags are to be removed
      Returns:
      This method returns 0 if successful, or a Unix error code otherwise.
      Throws:
      IOException - if the tags cannot be removed

    • getSecurityPolicy

      public int getSecurityPolicy(org.apache.hadoop.fs.Path path, List<String> securityPolicyTags) throws IOException
      This method returns the security policies associated with the file or directory specified in path. The securityPolicyTags parameter is a list of one or more security policy names.
      Parameters:
      path - The full path name to the file where the tags are to be retrieved
      securityPolicyTags - The caller-supplied list. On return, this will contain the list of security policy tags associated with the file or directory
      Returns:
      This method returns 0 if successful, or a Unix error code otherwise
      Throws:
      IOException - if the tags cannot be retrieved

    • getSecurityPolicy

      public int getSecurityPolicy(List<org.apache.hadoop.fs.Path> paths, List<MapRPathToSecurityPolicyTags> securityPolicyTags) throws IOException
      This method returns the security policies associated with the files or directories specified in list of paths specified in paths. The mappings are returned in the securityPolicyTags parameter as a list of MapRPathToSecurityPolicyTags objects, each of which contains a path with its associated list of one or more security policy names.
      Parameters:
      paths - The full pathnames of the files where the tags are to be retrieved
      mappings - The caller-supplied list of security policy tags to file mappings On return, this will contain the list of security policy tags that are associated with the file or directory.
      Returns:
      This method returns 0 if successful, or a Unix error code otherwise
      Throws:
      IOException - if the tags cannot be retrieved

    • printSecurityPolicies

      public int printSecurityPolicies(org.apache.hadoop.fs.Path path, boolean recursive) throws IOException
      This method prints the security policies associated with the files or directories specified in list of paths specified in paths.
      Parameters:
      path - The full path name of the files where the tags are to be retrieved
      recursive - if path is a directory and set to true, the directory is deleted else throws an exception. In case of a file the recursive can be set to either true or false.
      Returns:
      This method returns 0 if successful, or a Unix error code otherwise
      Throws:
      IOException - if the tags cannot be retrieved

    • getAllDataMasks

      public List<com.mapr.fs.proto.Dbserver.DataMask> getAllDataMasks() throws IOException
      Retrieves all the info for a all data mask
      Returns:
      List of DataMask objects containing all the information
      Throws:
      IOException - if there is an internal error

    • getDataMask

      public com.mapr.fs.proto.Dbserver.DataMask getDataMask(String dmName) throws IOException
      Retrieves all the info for a particular data mask given the name
      Parameters:
      dmName - the name of the datamask to be retrieve
      Returns:
      a DataMask object containing all the information
      Throws:
      IOException - if there is an internal error

    • getDataMaskNameFromId

      public String getDataMaskNameFromId(int id) throws IOException
      Returns the data mask name given the data mask ID. If not found, return null
      Throws:
      IOException

    • s3BucketCreate

      public byte[] s3BucketCreate(String path, String bktName, String domain, int aId, boolean worm, long ownwerUid) throws IOException
      Throws:
      IOException

    • removeS3Bucket

      public byte[] removeS3Bucket(String bucketName, String domainName) throws IOException
      Throws:
      IOException

    • addTableEntryToMetadata

      public boolean addTableEntryToMetadata(String tablePath)

    • addTableEntryToMetadata

      public boolean addTableEntryToMetadata(String tablePath, int retryCount)