Package org.apache.hadoop.yarn.server.timeline

Class LevelDBCacheTimelineStore

java.lang.Object

org.apache.hadoop.service.AbstractService

org.apache.hadoop.yarn.server.timeline.LevelDBCacheTimelineStore

All Implemented Interfaces:

java.io.Closeable, java.lang.AutoCloseable, org.apache.hadoop.service.Service, org.apache.hadoop.yarn.server.timeline.TimelineReader, org.apache.hadoop.yarn.server.timeline.TimelineStore, org.apache.hadoop.yarn.server.timeline.TimelineWriter

@Private
@Unstable
public class LevelDBCacheTimelineStore
extends org.apache.hadoop.service.AbstractService

LevelDB implementation of KeyValueBasedTimelineStore. This implementation stores the entity hash map into a LevelDB instance. There are two partitions of the key space. One partition is to store a entity id to start time mapping: i!ENTITY_ID!ENTITY_TYPE to ENTITY_START_TIME The other partition is to store the actual data: e!START_TIME!ENTITY_ID!ENTITY_TYPE to ENTITY_BYTES This storage does not have any garbage collection mechanism, and is designed mainly for caching usages.

Nested Class Summary

Nested classes/interfaces inherited from interface org.apache.hadoop.service.Service

org.apache.hadoop.service.Service.STATE

Nested classes/interfaces inherited from interface org.apache.hadoop.yarn.server.timeline.TimelineReader

org.apache.hadoop.yarn.server.timeline.TimelineReader.Field

Nested classes/interfaces inherited from interface org.apache.hadoop.yarn.server.timeline.TimelineStore

org.apache.hadoop.yarn.server.timeline.TimelineStore.SystemFilter

Field Summary

Fields

Modifier and Type	Field	Description
protected org.apache.hadoop.yarn.server.timeline.TimelineStoreMapAdapter<java.lang.String,org.apache.hadoop.yarn.api.records.timeline.TimelineDomain>	domainById
protected org.apache.hadoop.yarn.server.timeline.TimelineStoreMapAdapter<java.lang.String,java.util.Set<org.apache.hadoop.yarn.api.records.timeline.TimelineDomain>>	domainsByOwner
protected org.apache.hadoop.yarn.server.timeline.TimelineStoreMapAdapter<org.apache.hadoop.yarn.server.timeline.EntityIdentifier,org.apache.hadoop.yarn.api.records.timeline.TimelineEntity>	entities
protected org.apache.hadoop.yarn.server.timeline.TimelineStoreMapAdapter<org.apache.hadoop.yarn.server.timeline.EntityIdentifier,java.lang.Long>	entityInsertTimes

Fields inherited from interface org.apache.hadoop.yarn.server.timeline.TimelineReader

DEFAULT_LIMIT

Constructor Summary

Constructors

Constructor	Description
LevelDBCacheTimelineStore()
LevelDBCacheTimelineStore(java.lang.String id)
LevelDBCacheTimelineStore(java.lang.String id, java.lang.String name)

Method Summary

Modifier and Type	Method	Description
org.apache.hadoop.yarn.api.records.timeline.TimelineDomain	getDomain(java.lang.String arg0)
org.apache.hadoop.yarn.api.records.timeline.TimelineDomains	getDomains(java.lang.String arg0)
org.apache.hadoop.yarn.api.records.timeline.TimelineEntities	getEntities(java.lang.String arg0, java.lang.Long arg1, java.lang.Long arg2, java.lang.Long arg3, java.lang.String arg4, java.lang.Long arg5, org.apache.hadoop.yarn.server.timeline.NameValuePair arg6, java.util.Collection<org.apache.hadoop.yarn.server.timeline.NameValuePair> arg7, java.util.EnumSet<org.apache.hadoop.yarn.server.timeline.TimelineReader.Field> arg8, org.apache.hadoop.yarn.server.timeline.TimelineDataManager.CheckAcl arg9)
org.apache.hadoop.yarn.api.records.timeline.TimelineEntity	getEntity(java.lang.String arg0, java.lang.String arg1, java.util.EnumSet<org.apache.hadoop.yarn.server.timeline.TimelineReader.Field> arg2)
org.apache.hadoop.yarn.api.records.timeline.TimelineEvents	getEntityTimelines(java.lang.String arg0, java.util.SortedSet<java.lang.String> arg1, java.lang.Long arg2, java.lang.Long arg3, java.lang.Long arg4, java.util.Set<java.lang.String> arg5)
boolean	getServiceStopped()
void	put(org.apache.hadoop.yarn.api.records.timeline.TimelineDomain arg0)
org.apache.hadoop.yarn.api.records.timeline.TimelinePutResponse	put(org.apache.hadoop.yarn.api.records.timeline.TimelineEntities arg0)
protected void	serviceInit(org.apache.hadoop.conf.Configuration conf)
protected void	serviceStop()

Methods inherited from class org.apache.hadoop.service.AbstractService

close, getBlockers, getConfig, getFailureCause, getFailureState, getLifecycleHistory, getName, getServiceState, getStartTime, init, isInState, noteFailure, putBlocker, registerGlobalListener, registerServiceListener, removeBlocker, serviceStart, setConfig, start, stop, toString, unregisterGlobalListener, unregisterServiceListener, waitForServiceToStop

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, wait, wait, wait

Methods inherited from interface org.apache.hadoop.service.Service

close, getBlockers, getConfig, getFailureCause, getFailureState, getLifecycleHistory, getName, getServiceState, getStartTime, init, isInState, registerServiceListener, start, stop, unregisterServiceListener, waitForServiceToStop

Field Detail

entities

protected org.apache.hadoop.yarn.server.timeline.TimelineStoreMapAdapter<org.apache.hadoop.yarn.server.timeline.EntityIdentifier,org.apache.hadoop.yarn.api.records.timeline.TimelineEntity> entities

entityInsertTimes

protected org.apache.hadoop.yarn.server.timeline.TimelineStoreMapAdapter<org.apache.hadoop.yarn.server.timeline.EntityIdentifier,java.lang.Long> entityInsertTimes

domainById

protected org.apache.hadoop.yarn.server.timeline.TimelineStoreMapAdapter<java.lang.String,org.apache.hadoop.yarn.api.records.timeline.TimelineDomain> domainById

domainsByOwner

protected org.apache.hadoop.yarn.server.timeline.TimelineStoreMapAdapter<java.lang.String,java.util.Set<org.apache.hadoop.yarn.api.records.timeline.TimelineDomain>> domainsByOwner

Constructor Detail

LevelDBCacheTimelineStore

public LevelDBCacheTimelineStore(java.lang.String id,
                                 java.lang.String name)

LevelDBCacheTimelineStore

public LevelDBCacheTimelineStore(java.lang.String id)

LevelDBCacheTimelineStore

public LevelDBCacheTimelineStore()

Method Detail

serviceInit

protected void serviceInit(org.apache.hadoop.conf.Configuration conf)
                    throws java.lang.Exception

Overrides:

serviceInit in class org.apache.hadoop.service.AbstractService

Throws:

java.lang.Exception

serviceStop

protected void serviceStop()
                    throws java.lang.Exception

Throws:

java.lang.Exception

getServiceStopped

public boolean getServiceStopped()

getEntities

public org.apache.hadoop.yarn.api.records.timeline.TimelineEntities getEntities(java.lang.String arg0,
                                                                                java.lang.Long arg1,
                                                                                java.lang.Long arg2,
                                                                                java.lang.Long arg3,
                                                                                java.lang.String arg4,
                                                                                java.lang.Long arg5,
                                                                                org.apache.hadoop.yarn.server.timeline.NameValuePair arg6,
                                                                                java.util.Collection<org.apache.hadoop.yarn.server.timeline.NameValuePair> arg7,
                                                                                java.util.EnumSet<org.apache.hadoop.yarn.server.timeline.TimelineReader.Field> arg8,
                                                                                org.apache.hadoop.yarn.server.timeline.TimelineDataManager.CheckAcl arg9)
                                                                         throws java.io.IOException

Specified by:

getEntities in interface org.apache.hadoop.yarn.server.timeline.TimelineReader

Throws:

java.io.IOException

getEntity

public org.apache.hadoop.yarn.api.records.timeline.TimelineEntity getEntity(java.lang.String arg0,
                                                                            java.lang.String arg1,
                                                                            java.util.EnumSet<org.apache.hadoop.yarn.server.timeline.TimelineReader.Field> arg2)

Specified by:

getEntity in interface org.apache.hadoop.yarn.server.timeline.TimelineReader

getEntityTimelines

public org.apache.hadoop.yarn.api.records.timeline.TimelineEvents getEntityTimelines(java.lang.String arg0,
                                                                                     java.util.SortedSet<java.lang.String> arg1,
                                                                                     java.lang.Long arg2,
                                                                                     java.lang.Long arg3,
                                                                                     java.lang.Long arg4,
                                                                                     java.util.Set<java.lang.String> arg5)

Specified by:

getEntityTimelines in interface org.apache.hadoop.yarn.server.timeline.TimelineReader

getDomain

public org.apache.hadoop.yarn.api.records.timeline.TimelineDomain getDomain(java.lang.String arg0)
                                                                     throws java.io.IOException

Specified by:

getDomain in interface org.apache.hadoop.yarn.server.timeline.TimelineReader

Throws:

java.io.IOException

getDomains

public org.apache.hadoop.yarn.api.records.timeline.TimelineDomains getDomains(java.lang.String arg0)
                                                                       throws java.io.IOException

Specified by:

getDomains in interface org.apache.hadoop.yarn.server.timeline.TimelineReader

Throws:

java.io.IOException

put

public org.apache.hadoop.yarn.api.records.timeline.TimelinePutResponse put(org.apache.hadoop.yarn.api.records.timeline.TimelineEntities arg0)

Specified by:

put in interface org.apache.hadoop.yarn.server.timeline.TimelineWriter

put

public void put(org.apache.hadoop.yarn.api.records.timeline.TimelineDomain arg0)
         throws java.io.IOException

Specified by:

put in interface org.apache.hadoop.yarn.server.timeline.TimelineWriter

Throws:

java.io.IOException