Package org.apache.hadoop.hdfs.server.balancer

Class NameNodeConnector

java.lang.Object

org.apache.hadoop.hdfs.server.balancer.NameNodeConnector

All Implemented Interfaces:

java.io.Closeable, java.lang.AutoCloseable

@Private
public class NameNodeConnector
extends java.lang.Object
implements java.io.Closeable

The class provides utilities for accessing a NameNode.

Field Summary

Fields

Modifier and Type	Field	Description
static int	DEFAULT_MAX_IDLE_ITERATIONS

Constructor Summary

Constructors

Constructor	Description
NameNodeConnector(java.lang.String name, java.net.URI nameNodeUri, java.lang.String nsId, org.apache.hadoop.fs.Path idPath, java.util.List<org.apache.hadoop.fs.Path> targetPaths, org.apache.hadoop.conf.Configuration conf, int maxNotChangedIterations)
NameNodeConnector(java.lang.String name, java.net.URI nameNodeUri, org.apache.hadoop.fs.Path idPath, java.util.List<org.apache.hadoop.fs.Path> targetPaths, org.apache.hadoop.conf.Configuration conf, int maxNotChangedIterations)

Method Summary

Modifier and Type	Method	Description
void	addBytesMoved(long numBytes)
static void	checkOtherInstanceRunning(boolean toCheck)
void	close()
java.lang.String	getBlockpoolID()
BlocksWithLocations	getBlocks(org.apache.hadoop.hdfs.protocol.DatanodeInfo datanode, long size, long minBlockSize, long timeInterval, org.apache.hadoop.fs.StorageType storageType)
java.util.concurrent.atomic.AtomicLong	getBlocksFailed()
java.util.concurrent.atomic.AtomicLong	getBlocksMoved()
java.util.concurrent.atomic.AtomicLong	getBytesMoved()
org.apache.hadoop.hdfs.DistributedFileSystem	getDistributedFileSystem()
java.util.concurrent.atomic.AtomicBoolean	getFallbackToSimpleAuth()	Returns fallbackToSimpleAuth.
KeyManager	getKeyManager()
org.apache.hadoop.hdfs.server.protocol.DatanodeStorageReport[]	getLiveDatanodeStorageReport()
java.net.URI	getNameNodeUri()
NamenodeProtocol	getNNProtocolConnection()
java.util.List<org.apache.hadoop.fs.Path>	getTargetPaths()
boolean	isUpgrading()
static java.util.List<NameNodeConnector>	newNameNodeConnectors(java.util.Collection<java.net.URI> namenodes, java.lang.String name, org.apache.hadoop.fs.Path idPath, org.apache.hadoop.conf.Configuration conf, int maxIdleIterations)	Create NameNodeConnector for the given namenodes.
static java.util.List<NameNodeConnector>	newNameNodeConnectors(java.util.Collection<java.net.URI> namenodes, java.util.Collection<java.lang.String> nsIds, java.lang.String name, org.apache.hadoop.fs.Path idPath, org.apache.hadoop.conf.Configuration conf, int maxIdleIterations)
static java.util.List<NameNodeConnector>	newNameNodeConnectors(java.util.Map<java.net.URI,java.util.List<org.apache.hadoop.fs.Path>> namenodes, java.lang.String name, org.apache.hadoop.fs.Path idPath, org.apache.hadoop.conf.Configuration conf, int maxIdleIterations)
static void	setWrite2IdFile(boolean write2IdFile)
boolean	shouldContinue(long dispatchBlockMoveBytes)	Should the instance continue running?
java.lang.String	toString()

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, wait, wait, wait

Field Detail

DEFAULT_MAX_IDLE_ITERATIONS

public static final int DEFAULT_MAX_IDLE_ITERATIONS

See Also:

Constant Field Values

Constructor Detail

NameNodeConnector

public NameNodeConnector(java.lang.String name,
                         java.net.URI nameNodeUri,
                         org.apache.hadoop.fs.Path idPath,
                         java.util.List<org.apache.hadoop.fs.Path> targetPaths,
                         org.apache.hadoop.conf.Configuration conf,
                         int maxNotChangedIterations)
                  throws java.io.IOException

Throws:

java.io.IOException

NameNodeConnector

public NameNodeConnector(java.lang.String name,
                         java.net.URI nameNodeUri,
                         java.lang.String nsId,
                         org.apache.hadoop.fs.Path idPath,
                         java.util.List<org.apache.hadoop.fs.Path> targetPaths,
                         org.apache.hadoop.conf.Configuration conf,
                         int maxNotChangedIterations)
                  throws java.io.IOException

Throws:

java.io.IOException

Method Detail

newNameNodeConnectors

public static java.util.List<NameNodeConnector> newNameNodeConnectors(java.util.Collection<java.net.URI> namenodes,
                                                                      java.lang.String name,
                                                                      org.apache.hadoop.fs.Path idPath,
                                                                      org.apache.hadoop.conf.Configuration conf,
                                                                      int maxIdleIterations)
                                                               throws java.io.IOException

Create NameNodeConnector for the given namenodes.

Throws:

java.io.IOException

newNameNodeConnectors

public static java.util.List<NameNodeConnector> newNameNodeConnectors(java.util.Map<java.net.URI,java.util.List<org.apache.hadoop.fs.Path>> namenodes,
                                                                      java.lang.String name,
                                                                      org.apache.hadoop.fs.Path idPath,
                                                                      org.apache.hadoop.conf.Configuration conf,
                                                                      int maxIdleIterations)
                                                               throws java.io.IOException

Throws:

java.io.IOException

newNameNodeConnectors

public static java.util.List<NameNodeConnector> newNameNodeConnectors(java.util.Collection<java.net.URI> namenodes,
                                                                      java.util.Collection<java.lang.String> nsIds,
                                                                      java.lang.String name,
                                                                      org.apache.hadoop.fs.Path idPath,
                                                                      org.apache.hadoop.conf.Configuration conf,
                                                                      int maxIdleIterations)
                                                               throws java.io.IOException

Throws:

java.io.IOException

setWrite2IdFile

@VisibleForTesting
public static void setWrite2IdFile(boolean write2IdFile)

checkOtherInstanceRunning

@VisibleForTesting
public static void checkOtherInstanceRunning(boolean toCheck)

getDistributedFileSystem

public org.apache.hadoop.hdfs.DistributedFileSystem getDistributedFileSystem()

getBlockpoolID

public java.lang.String getBlockpoolID()

Returns:

the block pool ID

getBytesMoved

public java.util.concurrent.atomic.AtomicLong getBytesMoved()

getBlocksMoved

public java.util.concurrent.atomic.AtomicLong getBlocksMoved()

getBlocksFailed

public java.util.concurrent.atomic.AtomicLong getBlocksFailed()

addBytesMoved

public void addBytesMoved(long numBytes)

getNameNodeUri

public java.net.URI getNameNodeUri()

getBlocks

public BlocksWithLocations getBlocks(org.apache.hadoop.hdfs.protocol.DatanodeInfo datanode,
                                     long size,
                                     long minBlockSize,
                                     long timeInterval,
                                     org.apache.hadoop.fs.StorageType storageType)
                              throws java.io.IOException

Returns:

blocks with locations.

Throws:

java.io.IOException

isUpgrading

public boolean isUpgrading()
                    throws java.io.IOException

Returns:

true if an upgrade is in progress, false if not.

Throws:

java.io.IOException

getLiveDatanodeStorageReport

public org.apache.hadoop.hdfs.server.protocol.DatanodeStorageReport[] getLiveDatanodeStorageReport()
                                                                                            throws java.io.IOException

Returns:

live datanode storage reports.

Throws:

java.io.IOException

getKeyManager

public KeyManager getKeyManager()

Returns:

the key manager

getTargetPaths

public java.util.List<org.apache.hadoop.fs.Path> getTargetPaths()

Returns:

the list of paths to scan/migrate

shouldContinue

public boolean shouldContinue(long dispatchBlockMoveBytes)

Should the instance continue running?

getFallbackToSimpleAuth

public java.util.concurrent.atomic.AtomicBoolean getFallbackToSimpleAuth()

Returns fallbackToSimpleAuth. This will be true or false during calls to indicate if a secure client falls back to simple auth.

close

public void close()

Specified by:

close in interface java.lang.AutoCloseable

Specified by:

close in interface java.io.Closeable

getNNProtocolConnection

public NamenodeProtocol getNNProtocolConnection()

toString

public java.lang.String toString()

Overrides:

toString in class java.lang.Object