io.ray.streaming.state.strategy

Class AbstractStateStoreManager<V>

java.lang.Object

io.ray.streaming.state.strategy.AbstractStateStoreManager<V>

All Implemented Interfaces:

StateStoreManager

Direct Known Subclasses:

DualStateStoreManager, MVStateStoreManager

public abstract class AbstractStateStoreManager<V>
extends Object
implements StateStoreManager

This class defines the StoreManager Abstract class. We use three layer to store the state, frontStore, middleStore and keyValueStore(remote).

Field Summary

Fields

Modifier and Type	Field and Description
protected Map<String,StorageRecord<V>>	frontStore read-write
protected int	keyGroupIndex
protected KeyValueStore<String,Map<Long,byte[]>>	kvStore remote-storage
protected Map<Long,Map<String,byte[]>>	middleStore read-only

Constructor Summary

Constructors

Constructor and Description
AbstractStateStoreManager(KeyValueStore<String,Map<Long,byte[]>> backStore)

Method Summary

Modifier and Type	Method and Description
abstract void	ackCommit(long checkpointId)
void	ackCommit(long checkpointId, long timeStamp) The ackCommit method is used for cleaning the last checkpoint, and must be called after commit in the same thread.
void	close()
abstract V	get(long checkpointId, String key)
void	put(long checkpointId, String k, V v)
void	setKeyGroupIndex(int keyGroupIndex)
byte[]	toBytes(StorageRecord storageRecord)
StorageRecord<V>	toStorageRecord(byte[] data)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface io.ray.streaming.state.StateStoreManager

commit, finish, rollBack

Field Detail

frontStore

protected Map<String,StorageRecord<V>> frontStore

read-write

kvStore

protected KeyValueStore<String,Map<Long,byte[]>> kvStore

remote-storage

middleStore

protected Map<Long,Map<String,byte[]>> middleStore

read-only

keyGroupIndex

protected int keyGroupIndex

Constructor Detail

AbstractStateStoreManager

public AbstractStateStoreManager(KeyValueStore<String,Map<Long,byte[]>> backStore)

Method Detail

toBytes

public byte[] toBytes(StorageRecord storageRecord)

toStorageRecord

public StorageRecord<V> toStorageRecord(byte[] data)

get

public abstract V get(long checkpointId,
                      String key)

put

public void put(long checkpointId,
                String k,
                V v)

ackCommit

public void ackCommit(long checkpointId,
                      long timeStamp)

Description copied from interface: StateStoreManager

The ackCommit method is used for cleaning the last checkpoint, and must be called after commit in the same thread.

Specified by:

ackCommit in interface StateStoreManager

ackCommit

public abstract void ackCommit(long checkpointId)

setKeyGroupIndex

public void setKeyGroupIndex(int keyGroupIndex)

close

public void close()