Package org.apache.hadoop.yarn.server.nodemanager.recovery

Class NMLeveldbStateStoreService

java.lang.Object

org.apache.hadoop.service.AbstractService

org.apache.hadoop.yarn.server.nodemanager.recovery.NMStateStoreService

org.apache.hadoop.yarn.server.nodemanager.recovery.NMLeveldbStateStoreService

All Implemented Interfaces:

java.io.Closeable, java.lang.AutoCloseable, org.apache.hadoop.service.Service

public class NMLeveldbStateStoreService
extends NMStateStoreService

Nested Class Summary

Nested classes/interfaces inherited from class org.apache.hadoop.yarn.server.nodemanager.recovery.NMStateStoreService

NMStateStoreService.LocalResourceTrackerState, NMStateStoreService.RecoveredAMRMProxyState, NMStateStoreService.RecoveredApplicationsState, NMStateStoreService.RecoveredContainerState, NMStateStoreService.RecoveredContainerStatus, NMStateStoreService.RecoveredContainerTokensState, NMStateStoreService.RecoveredContainerType, NMStateStoreService.RecoveredDeletionServiceState, NMStateStoreService.RecoveredLocalizationState, NMStateStoreService.RecoveredLogDeleterState, NMStateStoreService.RecoveredNMTokensState, NMStateStoreService.RecoveredUserResources

Nested classes/interfaces inherited from interface org.apache.hadoop.service.Service

org.apache.hadoop.service.Service.STATE

Field Summary

Fields

Modifier and Type	Field	Description
static org.slf4j.Logger	LOG

Constructor Summary

Constructors

Constructor	Description
NMLeveldbStateStoreService()

Method Summary

Modifier and Type	Method	Description
protected void	checkVersion()	1) Versioning scheme: major.minor.
protected void	closeStorage()
void	finishResourceLocalization(java.lang.String user, org.apache.hadoop.yarn.api.records.ApplicationId appId, org.apache.hadoop.yarn.proto.YarnServerNodemanagerRecoveryProtos.LocalizedResourceProto proto)	Record the completion of a resource localization
RecoveryIterator<NMStateStoreService.RecoveredContainerState>	getContainerStateIterator()	get the Recovered Container State Iterator
protected void	initStorage(org.apache.hadoop.conf.Configuration conf)
boolean	isNewlyCreated()
NMStateStoreService.RecoveredAMRMProxyState	loadAMRMProxyState()	Load the state of AMRMProxy.
NMStateStoreService.RecoveredApplicationsState	loadApplicationsState()	Load the state of applications.
NMStateStoreService.RecoveredContainerTokensState	loadContainerTokensState()	Load the state of container tokens
NMStateStoreService.RecoveredDeletionServiceState	loadDeletionServiceState()	Load the state of the deletion service
NMStateStoreService.RecoveredLocalizationState	loadLocalizationState()	Load the state of localized resources
NMStateStoreService.RecoveredLogDeleterState	loadLogDeleterState()	Load the state of log deleters
NMStateStoreService.RecoveredNMTokensState	loadNMTokensState()	Load the state of NM tokens
protected org.iq80.leveldb.DB	openDatabase(org.apache.hadoop.conf.Configuration conf)
void	releaseAssignedResources(org.apache.hadoop.yarn.api.records.ContainerId containerId, java.lang.String resourceType)	Delete the assigned resources of a container of specific resourceType.
void	removeAMRMProxyAppContext(org.apache.hadoop.yarn.api.records.ApplicationAttemptId attempt)	Remove the entire context map for an application attempt in AMRMProxyService.
void	removeAMRMProxyAppContextEntry(org.apache.hadoop.yarn.api.records.ApplicationAttemptId attempt, java.lang.String key)	Remove a context entry for an application attempt in AMRMProxyService.
void	removeApplication(org.apache.hadoop.yarn.api.records.ApplicationId appId)	Remove records corresponding to an application
void	removeContainer(org.apache.hadoop.yarn.api.records.ContainerId containerId)	Remove records corresponding to a container
void	removeContainerPaused(org.apache.hadoop.yarn.api.records.ContainerId containerId)	Record that a container has been resumed at the NM by removing the fact that it has be paused.
void	removeContainerToken(org.apache.hadoop.yarn.api.records.ContainerId containerId)	Remove records for a container token
void	removeDeletionTask(int taskId)	Remove records corresponding to a deletion task
void	removeLocalizedResource(java.lang.String user, org.apache.hadoop.yarn.api.records.ApplicationId appId, org.apache.hadoop.fs.Path localPath)	Remove records related to a resource localization
void	removeLogDeleter(org.apache.hadoop.yarn.api.records.ApplicationId appId)	Remove the state of a log deleter
void	removeNMTokenApplicationMasterKey(org.apache.hadoop.yarn.api.records.ApplicationAttemptId attempt)	Remove a master key corresponding to an application
void	startResourceLocalization(java.lang.String user, org.apache.hadoop.yarn.api.records.ApplicationId appId, org.apache.hadoop.yarn.proto.YarnProtos.LocalResourceProto proto, org.apache.hadoop.fs.Path localPath)	Record the start of localization for a resource
protected void	startStorage()
void	storeAMRMProxyAppContextEntry(org.apache.hadoop.yarn.api.records.ApplicationAttemptId attempt, java.lang.String key, byte[] data)	Add a context entry for an application attempt in AMRMProxyService.
void	storeAMRMProxyCurrentMasterKey(org.apache.hadoop.yarn.server.api.records.MasterKey key)	Record the current AMRMProxyTokenSecretManager master key.
void	storeAMRMProxyNextMasterKey(org.apache.hadoop.yarn.server.api.records.MasterKey key)	Record the next AMRMProxyTokenSecretManager master key.
void	storeApplication(org.apache.hadoop.yarn.api.records.ApplicationId appId, org.apache.hadoop.yarn.proto.YarnServerNodemanagerRecoveryProtos.ContainerManagerApplicationProto p)	Record the start of an application
void	storeAssignedResources(Container container, java.lang.String resourceType, java.util.List<java.io.Serializable> assignedResources)	Store the assigned resources to a container.
void	storeContainer(org.apache.hadoop.yarn.api.records.ContainerId containerId, int containerVersion, long startTime, org.apache.hadoop.yarn.api.protocolrecords.StartContainerRequest startRequest)	Record a container start request
void	storeContainerCompleted(org.apache.hadoop.yarn.api.records.ContainerId containerId, int exitCode)	Record that a container has completed
void	storeContainerDiagnostics(org.apache.hadoop.yarn.api.records.ContainerId containerId, java.lang.StringBuilder diagnostics)	Record diagnostics for a container
void	storeContainerKilled(org.apache.hadoop.yarn.api.records.ContainerId containerId)	Record a request to kill a container
void	storeContainerLaunched(org.apache.hadoop.yarn.api.records.ContainerId containerId)	Record that a container has been launched
void	storeContainerLogDir(org.apache.hadoop.yarn.api.records.ContainerId containerId, java.lang.String logDir)	Record log directory for a container.
void	storeContainerPaused(org.apache.hadoop.yarn.api.records.ContainerId containerId)	Record that a container has been paused at the NM.
void	storeContainerQueued(org.apache.hadoop.yarn.api.records.ContainerId containerId)	Record that a container has been queued at the NM
void	storeContainerRemainingRetryAttempts(org.apache.hadoop.yarn.api.records.ContainerId containerId, int remainingRetryAttempts)	Record remaining retry attempts for a container.
void	storeContainerRestartTimes(org.apache.hadoop.yarn.api.records.ContainerId containerId, java.util.List<java.lang.Long> restartTimes)	Record restart times for a container.
void	storeContainerToken(org.apache.hadoop.yarn.api.records.ContainerId containerId, java.lang.Long expTime)	Record the expiration time for a container token
void	storeContainerTokenCurrentMasterKey(org.apache.hadoop.yarn.server.api.records.MasterKey key)	Record the current container token master key
void	storeContainerTokenPreviousMasterKey(org.apache.hadoop.yarn.server.api.records.MasterKey key)	Record the previous container token master key
void	storeContainerUpdateToken(org.apache.hadoop.yarn.api.records.ContainerId containerId, org.apache.hadoop.yarn.security.ContainerTokenIdentifier containerTokenIdentifier)	Record that a container has been updated
void	storeContainerWorkDir(org.apache.hadoop.yarn.api.records.ContainerId containerId, java.lang.String workDir)	Record working directory for a container.
void	storeDeletionTask(int taskId, org.apache.hadoop.yarn.proto.YarnServerNodemanagerRecoveryProtos.DeletionServiceDeleteTaskProto taskProto)	Record a deletion task
void	storeLogDeleter(org.apache.hadoop.yarn.api.records.ApplicationId appId, org.apache.hadoop.yarn.proto.YarnServerNodemanagerRecoveryProtos.LogDeleterProto proto)	Store the state of a log deleter
void	storeNMTokenApplicationMasterKey(org.apache.hadoop.yarn.api.records.ApplicationAttemptId attempt, org.apache.hadoop.yarn.server.api.records.MasterKey key)	Record a master key corresponding to an application
void	storeNMTokenCurrentMasterKey(org.apache.hadoop.yarn.server.api.records.MasterKey key)	Record the current NM token master key
void	storeNMTokenPreviousMasterKey(org.apache.hadoop.yarn.server.api.records.MasterKey key)	Record the previous NM token master key

Methods inherited from class org.apache.hadoop.yarn.server.nodemanager.recovery.NMStateStoreService

canRecover, getNodeStatusUpdater, serviceInit, serviceStart, serviceStop, setNodeStatusUpdater, updateContainerResourceMapping

Methods inherited from class org.apache.hadoop.service.AbstractService

close, getBlockers, getConfig, getFailureCause, getFailureState, getLifecycleHistory, getName, getServiceState, getStartTime, init, isInState, noteFailure, putBlocker, registerGlobalListener, registerServiceListener, removeBlocker, setConfig, start, stop, toString, unregisterGlobalListener, unregisterServiceListener, waitForServiceToStop

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, wait, wait, wait

Field Detail

LOG

public static final org.slf4j.Logger LOG

Constructor Detail

NMLeveldbStateStoreService

public NMLeveldbStateStoreService()

Method Detail

startStorage

protected void startStorage()
                     throws java.io.IOException

Specified by:

startStorage in class NMStateStoreService

Throws:

java.io.IOException

closeStorage

protected void closeStorage()
                     throws java.io.IOException

Specified by:

closeStorage in class NMStateStoreService

Throws:

java.io.IOException

isNewlyCreated

public boolean isNewlyCreated()

Overrides:

isNewlyCreated in class NMStateStoreService

getContainerStateIterator

public RecoveryIterator<NMStateStoreService.RecoveredContainerState> getContainerStateIterator()
                                                                                        throws java.io.IOException

Description copied from class: NMStateStoreService

get the Recovered Container State Iterator

Specified by:

getContainerStateIterator in class NMStateStoreService

Returns:

recovery iterator

Throws:

java.io.IOException

storeContainer

public void storeContainer(org.apache.hadoop.yarn.api.records.ContainerId containerId,
                           int containerVersion,
                           long startTime,
                           org.apache.hadoop.yarn.api.protocolrecords.StartContainerRequest startRequest)
                    throws java.io.IOException

Description copied from class: NMStateStoreService

Record a container start request

Specified by:

storeContainer in class NMStateStoreService

Parameters:

containerId - the container ID

containerVersion - the container Version

startTime - container start time

startRequest - the container start request

Throws:

java.io.IOException

storeContainerQueued

public void storeContainerQueued(org.apache.hadoop.yarn.api.records.ContainerId containerId)
                          throws java.io.IOException

Description copied from class: NMStateStoreService

Record that a container has been queued at the NM

Specified by:

storeContainerQueued in class NMStateStoreService

Parameters:

containerId - the container ID

Throws:

java.io.IOException

storeContainerPaused

public void storeContainerPaused(org.apache.hadoop.yarn.api.records.ContainerId containerId)
                          throws java.io.IOException

Description copied from class: NMStateStoreService

Record that a container has been paused at the NM.

Specified by:

storeContainerPaused in class NMStateStoreService

Parameters:

containerId - the container ID.

Throws:

java.io.IOException - IO Exception.

removeContainerPaused

public void removeContainerPaused(org.apache.hadoop.yarn.api.records.ContainerId containerId)
                           throws java.io.IOException

Description copied from class: NMStateStoreService

Record that a container has been resumed at the NM by removing the fact that it has be paused.

Specified by:

removeContainerPaused in class NMStateStoreService

Parameters:

containerId - the container ID.

Throws:

java.io.IOException - IO Exception.

storeContainerDiagnostics

public void storeContainerDiagnostics(org.apache.hadoop.yarn.api.records.ContainerId containerId,
                                      java.lang.StringBuilder diagnostics)
                               throws java.io.IOException

Description copied from class: NMStateStoreService

Record diagnostics for a container

Specified by:

storeContainerDiagnostics in class NMStateStoreService

Parameters:

containerId - the container ID

diagnostics - the container diagnostics

Throws:

java.io.IOException

storeContainerLaunched

public void storeContainerLaunched(org.apache.hadoop.yarn.api.records.ContainerId containerId)
                            throws java.io.IOException

Description copied from class: NMStateStoreService

Record that a container has been launched

Specified by:

storeContainerLaunched in class NMStateStoreService

Parameters:

containerId - the container ID

Throws:

java.io.IOException

storeContainerUpdateToken

public void storeContainerUpdateToken(org.apache.hadoop.yarn.api.records.ContainerId containerId,
                                      org.apache.hadoop.yarn.security.ContainerTokenIdentifier containerTokenIdentifier)
                               throws java.io.IOException

Description copied from class: NMStateStoreService

Record that a container has been updated

Specified by:

storeContainerUpdateToken in class NMStateStoreService

Parameters:

containerId - the container ID

containerTokenIdentifier - container token identifier

Throws:

java.io.IOException

storeContainerKilled

public void storeContainerKilled(org.apache.hadoop.yarn.api.records.ContainerId containerId)
                          throws java.io.IOException

Description copied from class: NMStateStoreService

Record a request to kill a container

Specified by:

storeContainerKilled in class NMStateStoreService

Parameters:

containerId - the container ID

Throws:

java.io.IOException

storeContainerCompleted

public void storeContainerCompleted(org.apache.hadoop.yarn.api.records.ContainerId containerId,
                                    int exitCode)
                             throws java.io.IOException

Description copied from class: NMStateStoreService

Record that a container has completed

Specified by:

storeContainerCompleted in class NMStateStoreService

Parameters:

containerId - the container ID

exitCode - the exit code from the container

Throws:

java.io.IOException

storeContainerRemainingRetryAttempts

public void storeContainerRemainingRetryAttempts(org.apache.hadoop.yarn.api.records.ContainerId containerId,
                                                 int remainingRetryAttempts)
                                          throws java.io.IOException

Description copied from class: NMStateStoreService

Record remaining retry attempts for a container.

Specified by:

storeContainerRemainingRetryAttempts in class NMStateStoreService

Parameters:

containerId - the container ID

remainingRetryAttempts - the remain retry times when container fails to run

Throws:

java.io.IOException

storeContainerRestartTimes

public void storeContainerRestartTimes(org.apache.hadoop.yarn.api.records.ContainerId containerId,
                                       java.util.List<java.lang.Long> restartTimes)
                                throws java.io.IOException

Description copied from class: NMStateStoreService

Record restart times for a container.

Specified by:

storeContainerRestartTimes in class NMStateStoreService

Throws:

java.io.IOException

storeContainerWorkDir

public void storeContainerWorkDir(org.apache.hadoop.yarn.api.records.ContainerId containerId,
                                  java.lang.String workDir)
                           throws java.io.IOException

Description copied from class: NMStateStoreService

Record working directory for a container.

Specified by:

storeContainerWorkDir in class NMStateStoreService

Parameters:

containerId - the container ID

workDir - the working directory

Throws:

java.io.IOException

storeContainerLogDir

public void storeContainerLogDir(org.apache.hadoop.yarn.api.records.ContainerId containerId,
                                 java.lang.String logDir)
                          throws java.io.IOException

Description copied from class: NMStateStoreService

Record log directory for a container.

Specified by:

storeContainerLogDir in class NMStateStoreService

Parameters:

containerId - the container ID

logDir - the log directory

Throws:

java.io.IOException

removeContainer

public void removeContainer(org.apache.hadoop.yarn.api.records.ContainerId containerId)
                     throws java.io.IOException

Description copied from class: NMStateStoreService

Remove records corresponding to a container

Specified by:

removeContainer in class NMStateStoreService

Parameters:

containerId - the container ID

Throws:

java.io.IOException

loadApplicationsState

public NMStateStoreService.RecoveredApplicationsState loadApplicationsState()
                                                                     throws java.io.IOException

Description copied from class: NMStateStoreService

Load the state of applications.

Specified by:

loadApplicationsState in class NMStateStoreService

Returns:

recovered state for applications.

Throws:

java.io.IOException - IO Exception.

storeApplication

public void storeApplication(org.apache.hadoop.yarn.api.records.ApplicationId appId,
                             org.apache.hadoop.yarn.proto.YarnServerNodemanagerRecoveryProtos.ContainerManagerApplicationProto p)
                      throws java.io.IOException

Description copied from class: NMStateStoreService

Record the start of an application

Specified by:

storeApplication in class NMStateStoreService

Parameters:

appId - the application ID

p - state to store for the application

Throws:

java.io.IOException

removeApplication

public void removeApplication(org.apache.hadoop.yarn.api.records.ApplicationId appId)
                       throws java.io.IOException

Description copied from class: NMStateStoreService

Remove records corresponding to an application

Specified by:

removeApplication in class NMStateStoreService

Parameters:

appId - the application ID

Throws:

java.io.IOException

loadLocalizationState

public NMStateStoreService.RecoveredLocalizationState loadLocalizationState()
                                                                     throws java.io.IOException

Description copied from class: NMStateStoreService

Load the state of localized resources

Specified by:

loadLocalizationState in class NMStateStoreService

Returns:

recovered localized resource state

Throws:

java.io.IOException

startResourceLocalization

public void startResourceLocalization(java.lang.String user,
                                      org.apache.hadoop.yarn.api.records.ApplicationId appId,
                                      org.apache.hadoop.yarn.proto.YarnProtos.LocalResourceProto proto,
                                      org.apache.hadoop.fs.Path localPath)
                               throws java.io.IOException

Description copied from class: NMStateStoreService

Record the start of localization for a resource

Specified by:

startResourceLocalization in class NMStateStoreService

Parameters:

user - the username or null if the resource is public

appId - the application ID if the resource is app-specific or null

proto - the resource request

localPath - local filesystem path where the resource will be stored

Throws:

java.io.IOException

finishResourceLocalization

public void finishResourceLocalization(java.lang.String user,
                                       org.apache.hadoop.yarn.api.records.ApplicationId appId,
                                       org.apache.hadoop.yarn.proto.YarnServerNodemanagerRecoveryProtos.LocalizedResourceProto proto)
                                throws java.io.IOException

Description copied from class: NMStateStoreService

Record the completion of a resource localization

Specified by:

finishResourceLocalization in class NMStateStoreService

Parameters:

user - the username or null if the resource is public

appId - the application ID if the resource is app-specific or null

proto - the serialized localized resource

Throws:

java.io.IOException

removeLocalizedResource

public void removeLocalizedResource(java.lang.String user,
                                    org.apache.hadoop.yarn.api.records.ApplicationId appId,
                                    org.apache.hadoop.fs.Path localPath)
                             throws java.io.IOException

Description copied from class: NMStateStoreService

Remove records related to a resource localization

Specified by:

removeLocalizedResource in class NMStateStoreService

Parameters:

user - the username or null if the resource is public

appId - the application ID if the resource is app-specific or null

localPath - local filesystem path where the resource will be stored

Throws:

java.io.IOException

loadDeletionServiceState

public NMStateStoreService.RecoveredDeletionServiceState loadDeletionServiceState()
                                                                           throws java.io.IOException

Description copied from class: NMStateStoreService

Load the state of the deletion service

Specified by:

loadDeletionServiceState in class NMStateStoreService

Returns:

recovered deletion service state

Throws:

java.io.IOException

storeDeletionTask

public void storeDeletionTask(int taskId,
                              org.apache.hadoop.yarn.proto.YarnServerNodemanagerRecoveryProtos.DeletionServiceDeleteTaskProto taskProto)
                       throws java.io.IOException

Description copied from class: NMStateStoreService

Record a deletion task

Specified by:

storeDeletionTask in class NMStateStoreService

Parameters:

taskId - the deletion task ID

taskProto - the deletion task protobuf

Throws:

java.io.IOException

removeDeletionTask

public void removeDeletionTask(int taskId)
                        throws java.io.IOException

Description copied from class: NMStateStoreService

Remove records corresponding to a deletion task

Specified by:

removeDeletionTask in class NMStateStoreService

Parameters:

taskId - the deletion task ID

Throws:

java.io.IOException

loadNMTokensState

public NMStateStoreService.RecoveredNMTokensState loadNMTokensState()
                                                             throws java.io.IOException

Description copied from class: NMStateStoreService

Load the state of NM tokens

Specified by:

loadNMTokensState in class NMStateStoreService

Returns:

recovered state of NM tokens

Throws:

java.io.IOException

storeNMTokenCurrentMasterKey

public void storeNMTokenCurrentMasterKey(org.apache.hadoop.yarn.server.api.records.MasterKey key)
                                  throws java.io.IOException

Description copied from class: NMStateStoreService

Record the current NM token master key

Specified by:

storeNMTokenCurrentMasterKey in class NMStateStoreService

Parameters:

key - the master key

Throws:

java.io.IOException

storeNMTokenPreviousMasterKey

public void storeNMTokenPreviousMasterKey(org.apache.hadoop.yarn.server.api.records.MasterKey key)
                                   throws java.io.IOException

Description copied from class: NMStateStoreService

Record the previous NM token master key

Specified by:

storeNMTokenPreviousMasterKey in class NMStateStoreService

Parameters:

key - the previous master key

Throws:

java.io.IOException

storeNMTokenApplicationMasterKey

public void storeNMTokenApplicationMasterKey(org.apache.hadoop.yarn.api.records.ApplicationAttemptId attempt,
                                             org.apache.hadoop.yarn.server.api.records.MasterKey key)
                                      throws java.io.IOException

Description copied from class: NMStateStoreService

Record a master key corresponding to an application

Specified by:

storeNMTokenApplicationMasterKey in class NMStateStoreService

Parameters:

attempt - the application attempt ID

key - the master key

Throws:

java.io.IOException

removeNMTokenApplicationMasterKey

public void removeNMTokenApplicationMasterKey(org.apache.hadoop.yarn.api.records.ApplicationAttemptId attempt)
                                       throws java.io.IOException

Description copied from class: NMStateStoreService

Remove a master key corresponding to an application

Specified by:

removeNMTokenApplicationMasterKey in class NMStateStoreService

Parameters:

attempt - the application attempt ID

Throws:

java.io.IOException

loadContainerTokensState

public NMStateStoreService.RecoveredContainerTokensState loadContainerTokensState()
                                                                           throws java.io.IOException

Description copied from class: NMStateStoreService

Load the state of container tokens

Specified by:

loadContainerTokensState in class NMStateStoreService

Returns:

recovered state of container tokens

Throws:

java.io.IOException

storeContainerTokenCurrentMasterKey

public void storeContainerTokenCurrentMasterKey(org.apache.hadoop.yarn.server.api.records.MasterKey key)
                                         throws java.io.IOException

Description copied from class: NMStateStoreService

Record the current container token master key

Specified by:

storeContainerTokenCurrentMasterKey in class NMStateStoreService

Parameters:

key - the master key

Throws:

java.io.IOException

storeContainerTokenPreviousMasterKey

public void storeContainerTokenPreviousMasterKey(org.apache.hadoop.yarn.server.api.records.MasterKey key)
                                          throws java.io.IOException

Description copied from class: NMStateStoreService

Record the previous container token master key

Specified by:

storeContainerTokenPreviousMasterKey in class NMStateStoreService

Parameters:

key - the previous master key

Throws:

java.io.IOException

storeContainerToken

public void storeContainerToken(org.apache.hadoop.yarn.api.records.ContainerId containerId,
                                java.lang.Long expTime)
                         throws java.io.IOException

Description copied from class: NMStateStoreService

Record the expiration time for a container token

Specified by:

storeContainerToken in class NMStateStoreService

Parameters:

containerId - the container ID

expTime - the container token expiration time

Throws:

java.io.IOException

removeContainerToken

public void removeContainerToken(org.apache.hadoop.yarn.api.records.ContainerId containerId)
                          throws java.io.IOException

Description copied from class: NMStateStoreService

Remove records for a container token

Specified by:

removeContainerToken in class NMStateStoreService

Parameters:

containerId - the container ID

Throws:

java.io.IOException

loadLogDeleterState

public NMStateStoreService.RecoveredLogDeleterState loadLogDeleterState()
                                                                 throws java.io.IOException

Description copied from class: NMStateStoreService

Load the state of log deleters

Specified by:

loadLogDeleterState in class NMStateStoreService

Returns:

recovered log deleter state

Throws:

java.io.IOException

storeLogDeleter

public void storeLogDeleter(org.apache.hadoop.yarn.api.records.ApplicationId appId,
                            org.apache.hadoop.yarn.proto.YarnServerNodemanagerRecoveryProtos.LogDeleterProto proto)
                     throws java.io.IOException

Description copied from class: NMStateStoreService

Store the state of a log deleter

Specified by:

storeLogDeleter in class NMStateStoreService

Parameters:

appId - the application ID for the log deleter

proto - the serialized state of the log deleter

Throws:

java.io.IOException

removeLogDeleter

public void removeLogDeleter(org.apache.hadoop.yarn.api.records.ApplicationId appId)
                      throws java.io.IOException

Description copied from class: NMStateStoreService

Remove the state of a log deleter

Specified by:

removeLogDeleter in class NMStateStoreService

Parameters:

appId - the application ID for the log deleter

Throws:

java.io.IOException

storeAssignedResources

public void storeAssignedResources(Container container,
                                   java.lang.String resourceType,
                                   java.util.List<java.io.Serializable> assignedResources)
                            throws java.io.IOException

Description copied from class: NMStateStoreService

Store the assigned resources to a container.

Specified by:

storeAssignedResources in class NMStateStoreService

Parameters:

container - NMContainer

resourceType - Resource Type

assignedResources - Assigned resources

Throws:

java.io.IOException - if fails

loadAMRMProxyState

public NMStateStoreService.RecoveredAMRMProxyState loadAMRMProxyState()
                                                               throws java.io.IOException

Description copied from class: NMStateStoreService

Load the state of AMRMProxy.

Specified by:

loadAMRMProxyState in class NMStateStoreService

Returns:

recovered state of AMRMProxy

Throws:

java.io.IOException - if fails

storeAMRMProxyCurrentMasterKey

public void storeAMRMProxyCurrentMasterKey(org.apache.hadoop.yarn.server.api.records.MasterKey key)
                                    throws java.io.IOException

Description copied from class: NMStateStoreService

Record the current AMRMProxyTokenSecretManager master key.

Specified by:

storeAMRMProxyCurrentMasterKey in class NMStateStoreService

Parameters:

key - the current master key

Throws:

java.io.IOException - if fails

storeAMRMProxyNextMasterKey

public void storeAMRMProxyNextMasterKey(org.apache.hadoop.yarn.server.api.records.MasterKey key)
                                 throws java.io.IOException

Description copied from class: NMStateStoreService

Record the next AMRMProxyTokenSecretManager master key.

Specified by:

storeAMRMProxyNextMasterKey in class NMStateStoreService

Parameters:

key - the next master key

Throws:

java.io.IOException - if fails

storeAMRMProxyAppContextEntry

public void storeAMRMProxyAppContextEntry(org.apache.hadoop.yarn.api.records.ApplicationAttemptId attempt,
                                          java.lang.String key,
                                          byte[] data)
                                   throws java.io.IOException

Description copied from class: NMStateStoreService

Add a context entry for an application attempt in AMRMProxyService.

Specified by:

storeAMRMProxyAppContextEntry in class NMStateStoreService

Parameters:

attempt - app attempt ID

key - key string

data - state data to store

Throws:

java.io.IOException - if fails

removeAMRMProxyAppContextEntry

public void removeAMRMProxyAppContextEntry(org.apache.hadoop.yarn.api.records.ApplicationAttemptId attempt,
                                           java.lang.String key)
                                    throws java.io.IOException

Description copied from class: NMStateStoreService

Remove a context entry for an application attempt in AMRMProxyService.

Specified by:

removeAMRMProxyAppContextEntry in class NMStateStoreService

Parameters:

attempt - attempt ID

key - key string

Throws:

java.io.IOException - if fails

removeAMRMProxyAppContext

public void removeAMRMProxyAppContext(org.apache.hadoop.yarn.api.records.ApplicationAttemptId attempt)
                               throws java.io.IOException

Description copied from class: NMStateStoreService

Remove the entire context map for an application attempt in AMRMProxyService.

Specified by:

removeAMRMProxyAppContext in class NMStateStoreService

Parameters:

attempt - attempt ID

Throws:

java.io.IOException - if fails

initStorage

protected void initStorage(org.apache.hadoop.conf.Configuration conf)
                    throws java.io.IOException

Specified by:

initStorage in class NMStateStoreService

Throws:

java.io.IOException

openDatabase

protected org.iq80.leveldb.DB openDatabase(org.apache.hadoop.conf.Configuration conf)
                                    throws java.io.IOException

Throws:

java.io.IOException

checkVersion

protected void checkVersion()
                     throws java.io.IOException

1) Versioning scheme: major.minor. For e.g. 1.0, 1.1, 1.2...1.25, 2.0 etc. 2) Any incompatible change of state-store is a major upgrade, and any compatible change of state-store is a minor upgrade. 3) Within a minor upgrade, say 1.1 to 1.2: overwrite the version info and proceed as normal. 4) Within a major upgrade, say 1.2 to 2.0: throw exception and indicate user to use a separate upgrade tool to upgrade NM state or remove incompatible old state.

Throws:

java.io.IOException

releaseAssignedResources

public void releaseAssignedResources(org.apache.hadoop.yarn.api.records.ContainerId containerId,
                                     java.lang.String resourceType)
                              throws java.io.IOException

Description copied from class: NMStateStoreService

Delete the assigned resources of a container of specific resourceType.

Overrides:

releaseAssignedResources in class NMStateStoreService

Parameters:

containerId - Container Id

resourceType - resource Type

Throws:

java.io.IOException - while releasing resources