Struct StreamChunkBuilder

pub struct StreamChunkBuilder {
    ops: Vec<Op>,
    column_builders: Vec<ArrayBuilderImpl>,
    vis_builder: BitmapBuilder,
    data_types: Vec<DataType>,
    max_chunk_size: Option<usize>,
    initial_capacity: usize,
    size: usize,
}

Build stream chunks with fixed chunk size from rows or records.

Fields

ops: Vec<Op>

column_builders: Vec<ArrayBuilderImpl>

vis_builder: BitmapBuilder

data_types: Vec<DataType>

max_chunk_size: Option<usize>

initial_capacity: usize

size: usize

Implementations

impl StreamChunkBuilder

pub fn new( max_chunk_size: usize, data_types: Vec<DataType>, ) -> StreamChunkBuilder

Create a new StreamChunkBuilder with a fixed max chunk size. Note that in the case of ending with Update, the builder may yield a chunk with size max_chunk_size + 1.

pub fn unlimited( data_types: Vec<DataType>, initial_capacity: Option<usize>, ) -> StreamChunkBuilder

Create a new StreamChunkBuilder with unlimited chunk size. The builder will only yield chunks when take is called.

pub fn size(&self) -> usize

Get the current number of rows in the builder.

pub fn append_iter<'a>( &mut self, op: Op, iter: impl IntoIterator<Item = (usize, Option<ScalarRefImpl<'a>>)>, ) -> Option<StreamChunk>

Append an iterator of output index and datum to the builder, return a chunk if the builder is full.

Note: the caller must ensure that each column occurs exactly once in iter.

pub fn append_row(&mut self, op: Op, row: impl Row) -> Option<StreamChunk>

Append a row to the builder, return a chunk if the builder is full.

pub fn append_row_invisible( &mut self, op: Op, row: impl Row, ) -> Option<StreamChunk>

Append an invisible row to the builder, return a chunk if the builder is full.

pub fn append_record(&mut self, record: Record<impl Row>) -> Option<StreamChunk>

Append a record to the builder, return a chunk if the builder is full.

pub fn take(&mut self) -> Option<StreamChunk>

Take all the pending data and return a chunk. If there is no pending data, return None. Note that if this is an unlimited chunk builder, the only way to get a chunk is to call take.

Trait Implementations

impl Drop for StreamChunkBuilder

fn drop(&mut self)

Executes the destructor for this type.