com.mapr.hadoop.mapred

Class LocalVolumeAuxService

java.lang.Object

org.apache.hadoop.service.AbstractService

org.apache.hadoop.yarn.server.api.AuxiliaryService

com.mapr.hadoop.mapred.LocalVolumeAuxService

All Implemented Interfaces:

java.io.Closeable, java.lang.AutoCloseable, org.apache.hadoop.service.Service

public class LocalVolumeAuxService
extends org.apache.hadoop.yarn.server.api.AuxiliaryService

Auxiliary service to manage local volume that stores job related data.

Nested Class Summary

Nested classes/interfaces inherited from interface org.apache.hadoop.service.Service

org.apache.hadoop.service.Service.STATE

Field Summary

Fields

Modifier and Type	Field and Description
protected java.util.Map<java.lang.String,MapRDirectShuffleMetaData>	jobMetaData
static int	LOCAL_VOL_SERVICE_SHUTDOWN_HOOK_PRIORITY Priority for the LocalVolumeAuxServiceShutDownHook.
protected MapRDirectShuffleMetaData	metaData

Constructor Summary

Constructors

Modifier	Constructor and Description
protected	LocalVolumeAuxService()

Method Summary

Modifier and Type	Method and Description
java.nio.ByteBuffer	getMetaData()
java.nio.ByteBuffer	getMetaData(org.apache.hadoop.yarn.server.api.ContainerInitializationContext context)
void	initializeApplication(org.apache.hadoop.yarn.server.api.ApplicationInitializationContext context)
protected void	initMapReduceDirs()
protected void	serviceInit(org.apache.hadoop.conf.Configuration conf)
protected void	serviceStart() Actions called during the INITED to STARTED transition.
protected void	serviceStop()
protected void	setConf(org.apache.hadoop.conf.Configuration conf)
protected void	setFS(org.apache.hadoop.fs.FileSystem fs)
void	stopApplication(org.apache.hadoop.yarn.server.api.ApplicationTerminationContext stopAppContext)

Methods inherited from class org.apache.hadoop.yarn.server.api.AuxiliaryService

getRecoveryPath, initializeContainer, setRecoveryPath, stopContainer

Methods inherited from class org.apache.hadoop.service.AbstractService

close, getBlockers, getConfig, getFailureCause, getFailureState, getLifecycleHistory, getName, getServiceState, getStartTime, init, isInState, noteFailure, putBlocker, registerGlobalListener, registerServiceListener, removeBlocker, setConfig, start, stop, toString, unregisterGlobalListener, unregisterServiceListener, waitForServiceToStop

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, wait, wait, wait

Field Detail

LOCAL_VOL_SERVICE_SHUTDOWN_HOOK_PRIORITY

public static final int LOCAL_VOL_SERVICE_SHUTDOWN_HOOK_PRIORITY

Priority for the LocalVolumeAuxServiceShutDownHook. This should be higher than NodeManager.SHUTDOWN_HOOK_PRIORITY so that ShutdownHookManager invokes LocalVolumeAuxServiceShutDownHook before invoking NodeManager.nodeManagerShutdownHook.

See Also:

Constant Field Values

metaData

protected MapRDirectShuffleMetaData metaData

jobMetaData

protected final java.util.Map<java.lang.String,MapRDirectShuffleMetaData> jobMetaData

Constructor Detail

LocalVolumeAuxService

protected LocalVolumeAuxService()

Method Detail

setFS

protected void setFS(org.apache.hadoop.fs.FileSystem fs)

setConf

protected void setConf(org.apache.hadoop.conf.Configuration conf)

serviceInit

protected void serviceInit(org.apache.hadoop.conf.Configuration conf)
                    throws java.lang.Exception

Overrides:

serviceInit in class org.apache.hadoop.service.AbstractService

Throws:

java.lang.Exception

serviceStart

protected void serviceStart()
                     throws java.lang.Exception

Actions called during the INITED to STARTED transition.

This method will only ever be called once during the lifecycle of a specific service instance.

Implementations do not need to be synchronized as the logic in AbstractService.start() prevents re-entrancy. Initializes local volume and starts off a periodic volume health check task with an initial delay equal to the volumeCheckInterval as we don't want the check to happen immediately.

Overrides:

serviceStart in class org.apache.hadoop.service.AbstractService

Throws:

java.lang.Exception - if needed -these will be caught, wrapped, and trigger a service stop

serviceStop

protected void serviceStop()
                    throws java.lang.Exception

Overrides:

serviceStop in class org.apache.hadoop.service.AbstractService

Throws:

java.lang.Exception

initializeApplication

public void initializeApplication(org.apache.hadoop.yarn.server.api.ApplicationInitializationContext context)

Specified by:

initializeApplication in class org.apache.hadoop.yarn.server.api.AuxiliaryService

stopApplication

public void stopApplication(org.apache.hadoop.yarn.server.api.ApplicationTerminationContext stopAppContext)

Specified by:

stopApplication in class org.apache.hadoop.yarn.server.api.AuxiliaryService

getMetaData

public java.nio.ByteBuffer getMetaData()

Specified by:

getMetaData in class org.apache.hadoop.yarn.server.api.AuxiliaryService

getMetaData

public java.nio.ByteBuffer getMetaData(org.apache.hadoop.yarn.server.api.ContainerInitializationContext context)

Overrides:

getMetaData in class org.apache.hadoop.yarn.server.api.AuxiliaryService

initMapReduceDirs

protected void initMapReduceDirs()
                          throws java.io.IOException

Throws:

java.io.IOException