Struct BoundedInMemLogStoreWriter

pub struct BoundedInMemLogStoreWriter {
    curr_epoch: Option<u64>,
    init_epoch_tx: Option<Sender<u64>>,
    item_tx: Sender<InMemLogStoreItem>,
    truncated_epoch_rx: UnboundedReceiver<u64>,
}

An in-memory log store that can buffer a bounded amount of stream chunk in memory via bounded mpsc channel.

Since it is in-memory, when flush_current_epoch with checkpoint epoch, it should wait for the reader to finish consuming all the data in current checkpoint epoch.

Fields

curr_epoch: Option<u64>

Current epoch. Should be Some after init

init_epoch_tx: Option<Sender<u64>>

Holder of oneshot channel to send the initial epoch to the associated log reader.

item_tx: Sender<InMemLogStoreItem>

Sending log store item to log reader

truncated_epoch_rx: UnboundedReceiver<u64>

Receiver for the epoch consumed by log reader.

Trait Implementations

impl LogWriter for BoundedInMemLogStoreWriter

async fn init( &mut self, epoch: EpochPair, _pause_read_on_bootstrap: bool, ) -> LogStoreResult<()>

Initialize the log writer with an epoch

async fn write_chunk(&mut self, chunk: StreamChunk) -> LogStoreResult<()>

Write a stream chunk to the log writer

async fn flush_current_epoch( &mut self, next_epoch: u64, is_checkpoint: bool, ) -> LogStoreResult<()>

Mark current epoch as finished and sealed, and flush the unconsumed log data.

async fn update_vnode_bitmap( &mut self, new_vnodes: Arc<Bitmap>, ) -> LogStoreResult<()>

Update the vnode bitmap of the log writer

fn pause(&mut self) -> LogStoreResult<()>

fn resume(&mut self) -> LogStoreResult<()>