pub struct RangeKvStateStore<R: RangeKv> {
inner: R,
tables: Arc<Mutex<HashMap<TableId, TableState>>>,
vectors: Arc<RwLock<HashMap<TableId, Vec<(Vector, Bytes, u64)>>>>,
}Expand description
An in-memory state store
The in-memory state store is a BTreeMap, which maps [FullKey] to value. It
never does GC, so the memory usage will be high. Therefore, in-memory state store should never
be used in production.
Fields§
§inner: RStores (key, epoch) -> user value.
tables: Arc<Mutex<HashMap<TableId, TableState>>>table_id -> prev_epoch -> curr_epoch
vectors: Arc<RwLock<HashMap<TableId, Vec<(Vector, Bytes, u64)>>>>Implementations§
Source§impl<R: RangeKv> RangeKvStateStore<R>
impl<R: RangeKv> RangeKvStateStore<R>
Source§impl<R: RangeKv> RangeKvStateStore<R>
impl<R: RangeKv> RangeKvStateStore<R>
fn get_keyed_row_impl( &self, key: TableKey<Bytes>, epoch: u64, table_id: TableId, ) -> StorageResult<Option<StateStoreKeyedRow>>
fn iter_impl( &self, key_range: TableKeyRange, epoch: u64, table_id: TableId, ) -> StorageResult<RangeKvStateStoreIter<R>>
fn rev_iter_impl( &self, key_range: TableKeyRange, epoch: u64, table_id: TableId, ) -> StorageResult<RangeKvStateStoreRevIter<R>>
Source§impl<R: RangeKv> RangeKvStateStore<R>
impl<R: RangeKv> RangeKvStateStore<R>
fn new_read_snapshot_impl( &self, epoch: u64, table_id: TableId, ) -> RangeKvStateStoreReadSnapshot<R>
pub(crate) fn ingest_batch( &self, kv_pairs: Vec<(TableKey<Bytes>, StorageValue)>, delete_ranges: Vec<(Bound<Bytes>, Bound<Bytes>)>, epoch: u64, table_id: TableId, ) -> StorageResult<usize>
fn ingest_vectors( &self, table_id: TableId, epoch: u64, vecs: Vec<(Vector, Bytes)>, )
Trait Implementations§
Source§impl<R: Clone + RangeKv> Clone for RangeKvStateStore<R>
impl<R: Clone + RangeKv> Clone for RangeKvStateStore<R>
Source§fn clone(&self) -> RangeKvStateStore<R>
fn clone(&self) -> RangeKvStateStore<R>
Returns a duplicate of the value. Read more
1.0.0 · Source§fn clone_from(&mut self, source: &Self)
fn clone_from(&mut self, source: &Self)
Performs copy-assignment from
source. Read moreSource§impl<R: Default + RangeKv> Default for RangeKvStateStore<R>
impl<R: Default + RangeKv> Default for RangeKvStateStore<R>
Source§fn default() -> RangeKvStateStore<R>
fn default() -> RangeKvStateStore<R>
Returns the “default value” for a type. Read more
Source§impl<R: RangeKv> StateStore for RangeKvStateStore<R>
impl<R: RangeKv> StateStore for RangeKvStateStore<R>
type Local = RangeKvLocalStateStore<R>
type ReadSnapshot = RangeKvStateStoreReadSnapshot<R>
type VectorWriter = RangeKvLocalStateStore<R>
Source§async fn try_wait_epoch(
&self,
_epoch: HummockReadEpoch,
_options: TryWaitEpochOptions,
) -> StorageResult<()>
async fn try_wait_epoch( &self, _epoch: HummockReadEpoch, _options: TryWaitEpochOptions, ) -> StorageResult<()>
If epoch is
Committed, we will wait until the epoch is committed and its data is ready to
read. If epoch is Current, we will only check if the data can be read with this epoch.async fn new_local(&self, option: NewLocalOptions) -> Self::Local
async fn new_read_snapshot( &self, epoch: HummockReadEpoch, options: NewReadSnapshotOptions, ) -> StorageResult<Self::ReadSnapshot>
async fn new_vector_writer( &self, options: NewVectorWriterOptions, ) -> Self::VectorWriter
Source§fn monitored(
self,
storage_metrics: Arc<MonitoredStorageMetrics>,
) -> MonitoredStateStore<Self>
fn monitored( self, storage_metrics: Arc<MonitoredStorageMetrics>, ) -> MonitoredStateStore<Self>
Creates a
MonitoredStateStore from this state store, with given stats.Source§impl<R: RangeKv> StateStoreReadLog for RangeKvStateStore<R>
impl<R: RangeKv> StateStoreReadLog for RangeKvStateStore<R>
type ChangeLogIter = RangeKvStateStoreChangeLogIter<R>
async fn next_epoch( &self, epoch: u64, options: NextEpochOptions, ) -> StorageResult<u64>
async fn iter_log( &self, __arg1: (u64, u64), key_range: TableKeyRange, options: ReadLogOptions, ) -> StorageResult<Self::ChangeLogIter>
Auto Trait Implementations§
impl<R> Freeze for RangeKvStateStore<R>where
R: Freeze,
impl<R> !RefUnwindSafe for RangeKvStateStore<R>
impl<R> Send for RangeKvStateStore<R>
impl<R> Sync for RangeKvStateStore<R>
impl<R> Unpin for RangeKvStateStore<R>where
R: Unpin,
impl<R> !UnwindSafe for RangeKvStateStore<R>
Blanket Implementations§
§impl<T> AsAny for T
impl<T> AsAny for T
§fn any_ref(&self) -> &(dyn Any + Sync + Send + 'static)
fn any_ref(&self) -> &(dyn Any + Sync + Send + 'static)
Obtains a
dyn Any reference to the object: Read more§fn as_any(self: Arc<T>) -> Arc<dyn Any + Sync + Send>
fn as_any(self: Arc<T>) -> Arc<dyn Any + Sync + Send>
Obtains an
Arc<dyn Any> reference to the object: Read more§fn into_any(self: Box<T>) -> Box<dyn Any + Sync + Send>
fn into_any(self: Box<T>) -> Box<dyn Any + Sync + Send>
Converts the object to
Box<dyn Any>: Read more§fn type_name(&self) -> &'static str
fn type_name(&self) -> &'static str
Convenient wrapper for
std::any::type_name, since Any does not provide it and
Any::type_id is useless as a debugging aid (its Debug is just a mess of hex digits).Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more
Source§impl<T> CloneToUninit for Twhere
T: Clone,
impl<T> CloneToUninit for Twhere
T: Clone,
§impl<T> Conv for T
impl<T> Conv for T
§impl<T> Downcast for Twhere
T: Any,
impl<T> Downcast for Twhere
T: Any,
§fn into_any(self: Box<T>) -> Box<dyn Any>
fn into_any(self: Box<T>) -> Box<dyn Any>
Converts
Box<dyn Trait> (where Trait: Downcast) to Box<dyn Any>, which can then be
downcast into Box<dyn ConcreteType> where ConcreteType implements Trait.§fn into_any_rc(self: Rc<T>) -> Rc<dyn Any>
fn into_any_rc(self: Rc<T>) -> Rc<dyn Any>
Converts
Rc<Trait> (where Trait: Downcast) to Rc<Any>, which can then be further
downcast into Rc<ConcreteType> where ConcreteType implements Trait.§fn as_any(&self) -> &(dyn Any + 'static)
fn as_any(&self) -> &(dyn Any + 'static)
Converts
&Trait (where Trait: Downcast) to &Any. This is needed since Rust cannot
generate &Any’s vtable from &Trait’s.§fn as_any_mut(&mut self) -> &mut (dyn Any + 'static)
fn as_any_mut(&mut self) -> &mut (dyn Any + 'static)
Converts
&mut Trait (where Trait: Downcast) to &Any. This is needed since Rust cannot
generate &mut Any’s vtable from &mut Trait’s.§impl<T> DowncastSend for T
impl<T> DowncastSend for T
§impl<T> DowncastSync for T
impl<T> DowncastSync for T
§impl<T> FmtForward for T
impl<T> FmtForward for T
§fn fmt_binary(self) -> FmtBinary<Self>where
Self: Binary,
fn fmt_binary(self) -> FmtBinary<Self>where
Self: Binary,
Causes
self to use its Binary implementation when Debug-formatted.§fn fmt_display(self) -> FmtDisplay<Self>where
Self: Display,
fn fmt_display(self) -> FmtDisplay<Self>where
Self: Display,
Causes
self to use its Display implementation when
Debug-formatted.§fn fmt_lower_exp(self) -> FmtLowerExp<Self>where
Self: LowerExp,
fn fmt_lower_exp(self) -> FmtLowerExp<Self>where
Self: LowerExp,
Causes
self to use its LowerExp implementation when
Debug-formatted.§fn fmt_lower_hex(self) -> FmtLowerHex<Self>where
Self: LowerHex,
fn fmt_lower_hex(self) -> FmtLowerHex<Self>where
Self: LowerHex,
Causes
self to use its LowerHex implementation when
Debug-formatted.§fn fmt_octal(self) -> FmtOctal<Self>where
Self: Octal,
fn fmt_octal(self) -> FmtOctal<Self>where
Self: Octal,
Causes
self to use its Octal implementation when Debug-formatted.§fn fmt_pointer(self) -> FmtPointer<Self>where
Self: Pointer,
fn fmt_pointer(self) -> FmtPointer<Self>where
Self: Pointer,
Causes
self to use its Pointer implementation when
Debug-formatted.§fn fmt_upper_exp(self) -> FmtUpperExp<Self>where
Self: UpperExp,
fn fmt_upper_exp(self) -> FmtUpperExp<Self>where
Self: UpperExp,
Causes
self to use its UpperExp implementation when
Debug-formatted.§fn fmt_upper_hex(self) -> FmtUpperHex<Self>where
Self: UpperHex,
fn fmt_upper_hex(self) -> FmtUpperHex<Self>where
Self: UpperHex,
Causes
self to use its UpperHex implementation when
Debug-formatted.§fn fmt_list(self) -> FmtList<Self>where
&'a Self: for<'a> IntoIterator,
fn fmt_list(self) -> FmtList<Self>where
&'a Self: for<'a> IntoIterator,
Formats each item in a sequence. Read more
§impl<T> FutureExt for T
impl<T> FutureExt for T
§fn with_context(self, otel_cx: Context) -> WithContext<Self>
fn with_context(self, otel_cx: Context) -> WithContext<Self>
§fn with_current_context(self) -> WithContext<Self>
fn with_current_context(self) -> WithContext<Self>
§impl<T> Instrument for T
impl<T> Instrument for T
§fn instrument(self, span: Span) -> Instrumented<Self>
fn instrument(self, span: Span) -> Instrumented<Self>
§fn in_current_span(self) -> Instrumented<Self>
fn in_current_span(self) -> Instrumented<Self>
Source§impl<T> Instrument for T
impl<T> Instrument for T
Source§fn instrument(self, span: Span) -> Instrumented<Self>
fn instrument(self, span: Span) -> Instrumented<Self>
Source§fn in_current_span(self) -> Instrumented<Self>
fn in_current_span(self) -> Instrumented<Self>
Source§impl<T> IntoEither for T
impl<T> IntoEither for T
Source§fn into_either(self, into_left: bool) -> Either<Self, Self>
fn into_either(self, into_left: bool) -> Either<Self, Self>
Converts
self into a Left variant of Either<Self, Self>
if into_left is true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read moreSource§fn into_either_with<F>(self, into_left: F) -> Either<Self, Self>
fn into_either_with<F>(self, into_left: F) -> Either<Self, Self>
Converts
self into a Left variant of Either<Self, Self>
if into_left(&self) returns true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read moreSource§impl<T> IntoRequest<T> for T
impl<T> IntoRequest<T> for T
Source§fn into_request(self) -> Request<T>
fn into_request(self) -> Request<T>
Wrap the input message
T in a tonic::Request§impl<T> IntoResult<T> for T
impl<T> IntoResult<T> for T
type Err = Infallible
fn into_result(self) -> Result<T, <T as IntoResult<T>>::Err>
Creates a shared type from an unshared type.
Source§impl<M> MetricVecRelabelExt for M
impl<M> MetricVecRelabelExt for M
Source§fn relabel(
self,
metric_level: MetricLevel,
relabel_threshold: MetricLevel,
) -> RelabeledMetricVec<M>
fn relabel( self, metric_level: MetricLevel, relabel_threshold: MetricLevel, ) -> RelabeledMetricVec<M>
Equivalent to
RelabeledMetricVec::with_metric_level.Source§fn relabel_n(
self,
metric_level: MetricLevel,
relabel_threshold: MetricLevel,
relabel_num: usize,
) -> RelabeledMetricVec<M>
fn relabel_n( self, metric_level: MetricLevel, relabel_threshold: MetricLevel, relabel_num: usize, ) -> RelabeledMetricVec<M>
Equivalent to
RelabeledMetricVec::with_metric_level_relabel_n.Source§fn relabel_debug_1(
self,
relabel_threshold: MetricLevel,
) -> RelabeledMetricVec<M>
fn relabel_debug_1( self, relabel_threshold: MetricLevel, ) -> RelabeledMetricVec<M>
Equivalent to
RelabeledMetricVec::with_metric_level_relabel_n with metric_level set to
MetricLevel::Debug and relabel_num set to 1.§impl<T> Pipe for Twhere
T: ?Sized,
impl<T> Pipe for Twhere
T: ?Sized,
§fn pipe<R>(self, func: impl FnOnce(Self) -> R) -> Rwhere
Self: Sized,
fn pipe<R>(self, func: impl FnOnce(Self) -> R) -> Rwhere
Self: Sized,
Pipes by value. This is generally the method you want to use. Read more
§fn pipe_ref<'a, R>(&'a self, func: impl FnOnce(&'a Self) -> R) -> Rwhere
R: 'a,
fn pipe_ref<'a, R>(&'a self, func: impl FnOnce(&'a Self) -> R) -> Rwhere
R: 'a,
Borrows
self and passes that borrow into the pipe function. Read more§fn pipe_ref_mut<'a, R>(&'a mut self, func: impl FnOnce(&'a mut Self) -> R) -> Rwhere
R: 'a,
fn pipe_ref_mut<'a, R>(&'a mut self, func: impl FnOnce(&'a mut Self) -> R) -> Rwhere
R: 'a,
Mutably borrows
self and passes that borrow into the pipe function. Read more§fn pipe_borrow<'a, B, R>(&'a self, func: impl FnOnce(&'a B) -> R) -> R
fn pipe_borrow<'a, B, R>(&'a self, func: impl FnOnce(&'a B) -> R) -> R
§fn pipe_borrow_mut<'a, B, R>(
&'a mut self,
func: impl FnOnce(&'a mut B) -> R,
) -> R
fn pipe_borrow_mut<'a, B, R>( &'a mut self, func: impl FnOnce(&'a mut B) -> R, ) -> R
§fn pipe_as_ref<'a, U, R>(&'a self, func: impl FnOnce(&'a U) -> R) -> R
fn pipe_as_ref<'a, U, R>(&'a self, func: impl FnOnce(&'a U) -> R) -> R
Borrows
self, then passes self.as_ref() into the pipe function.§fn pipe_as_mut<'a, U, R>(&'a mut self, func: impl FnOnce(&'a mut U) -> R) -> R
fn pipe_as_mut<'a, U, R>(&'a mut self, func: impl FnOnce(&'a mut U) -> R) -> R
Mutably borrows
self, then passes self.as_mut() into the pipe
function.§fn pipe_deref<'a, T, R>(&'a self, func: impl FnOnce(&'a T) -> R) -> R
fn pipe_deref<'a, T, R>(&'a self, func: impl FnOnce(&'a T) -> R) -> R
Borrows
self, then passes self.deref() into the pipe function.§impl<T> Pointable for T
impl<T> Pointable for T
§impl<T> Scope for T
impl<T> Scope for T
Source§impl<S> StateStoreReadTestExt for Swhere
S: StateStore,
impl<S> StateStoreReadTestExt for Swhere
S: StateStore,
Source§async fn get_keyed_row(
&self,
key: TableKey<Bytes>,
epoch: u64,
read_options: StateStoreTestReadOptions,
) -> Result<Option<(FullKey<Bytes>, Bytes)>, StorageError>
async fn get_keyed_row( &self, key: TableKey<Bytes>, epoch: u64, read_options: StateStoreTestReadOptions, ) -> Result<Option<(FullKey<Bytes>, Bytes)>, StorageError>
Point gets a value from the state store.
The result is based on a snapshot corresponding to the given
epoch.
Both full key and the value are returned.Source§async fn iter(
&self,
key_range: (Bound<TableKey<Bytes>>, Bound<TableKey<Bytes>>),
epoch: u64,
read_options: StateStoreTestReadOptions,
) -> Result<<<S as StateStore>::ReadSnapshot as StateStoreRead>::Iter, StorageError>
async fn iter( &self, key_range: (Bound<TableKey<Bytes>>, Bound<TableKey<Bytes>>), epoch: u64, read_options: StateStoreTestReadOptions, ) -> Result<<<S as StateStore>::ReadSnapshot as StateStoreRead>::Iter, StorageError>
Opens and returns an iterator for given
prefix_hint and full_key_range
Internally, prefix_hint will be used to for checking bloom_filter and
full_key_range used for iter. (if the prefix_hint not None, it should be be included
in key_range) The returned iterator will iterate data based on a snapshot
corresponding to the given epoch.async fn rev_iter( &self, key_range: (Bound<TableKey<Bytes>>, Bound<TableKey<Bytes>>), epoch: u64, read_options: StateStoreTestReadOptions, ) -> Result<<<S as StateStore>::ReadSnapshot as StateStoreRead>::RevIter, StorageError>
async fn scan( &self, key_range: (Bound<TableKey<Bytes>>, Bound<TableKey<Bytes>>), epoch: u64, limit: Option<usize>, read_options: StateStoreTestReadOptions, ) -> Result<Vec<(FullKey<Bytes>, Bytes)>, StorageError>
Source§fn get(
&self,
key: TableKey<Bytes>,
epoch: u64,
read_options: ReadOptions,
) -> impl StorageFuture<'_, Option<Bytes>>
fn get( &self, key: TableKey<Bytes>, epoch: u64, read_options: ReadOptions, ) -> impl StorageFuture<'_, Option<Bytes>>
Point gets a value from the state store.
The result is based on a snapshot corresponding to the given
epoch.
Only the value is returned.§impl<T> Tap for T
impl<T> Tap for T
§fn tap_borrow<B>(self, func: impl FnOnce(&B)) -> Self
fn tap_borrow<B>(self, func: impl FnOnce(&B)) -> Self
Immutable access to the
Borrow<B> of a value. Read more§fn tap_borrow_mut<B>(self, func: impl FnOnce(&mut B)) -> Self
fn tap_borrow_mut<B>(self, func: impl FnOnce(&mut B)) -> Self
Mutable access to the
BorrowMut<B> of a value. Read more§fn tap_ref<R>(self, func: impl FnOnce(&R)) -> Self
fn tap_ref<R>(self, func: impl FnOnce(&R)) -> Self
Immutable access to the
AsRef<R> view of a value. Read more§fn tap_ref_mut<R>(self, func: impl FnOnce(&mut R)) -> Self
fn tap_ref_mut<R>(self, func: impl FnOnce(&mut R)) -> Self
Mutable access to the
AsMut<R> view of a value. Read more§fn tap_deref<T>(self, func: impl FnOnce(&T)) -> Self
fn tap_deref<T>(self, func: impl FnOnce(&T)) -> Self
Immutable access to the
Deref::Target of a value. Read more§fn tap_deref_mut<T>(self, func: impl FnOnce(&mut T)) -> Self
fn tap_deref_mut<T>(self, func: impl FnOnce(&mut T)) -> Self
Mutable access to the
Deref::Target of a value. Read more§fn tap_dbg(self, func: impl FnOnce(&Self)) -> Self
fn tap_dbg(self, func: impl FnOnce(&Self)) -> Self
Calls
.tap() only in debug builds, and is erased in release builds.§fn tap_mut_dbg(self, func: impl FnOnce(&mut Self)) -> Self
fn tap_mut_dbg(self, func: impl FnOnce(&mut Self)) -> Self
Calls
.tap_mut() only in debug builds, and is erased in release
builds.§fn tap_borrow_dbg<B>(self, func: impl FnOnce(&B)) -> Self
fn tap_borrow_dbg<B>(self, func: impl FnOnce(&B)) -> Self
Calls
.tap_borrow() only in debug builds, and is erased in release
builds.§fn tap_borrow_mut_dbg<B>(self, func: impl FnOnce(&mut B)) -> Self
fn tap_borrow_mut_dbg<B>(self, func: impl FnOnce(&mut B)) -> Self
Calls
.tap_borrow_mut() only in debug builds, and is erased in release
builds.§fn tap_ref_dbg<R>(self, func: impl FnOnce(&R)) -> Self
fn tap_ref_dbg<R>(self, func: impl FnOnce(&R)) -> Self
Calls
.tap_ref() only in debug builds, and is erased in release
builds.§fn tap_ref_mut_dbg<R>(self, func: impl FnOnce(&mut R)) -> Self
fn tap_ref_mut_dbg<R>(self, func: impl FnOnce(&mut R)) -> Self
Calls
.tap_ref_mut() only in debug builds, and is erased in release
builds.§fn tap_deref_dbg<T>(self, func: impl FnOnce(&T)) -> Self
fn tap_deref_dbg<T>(self, func: impl FnOnce(&T)) -> Self
Calls
.tap_deref() only in debug builds, and is erased in release
builds.