Struct StreamChunkBuilder

pub struct StreamChunkBuilder {
    ops: Vec<Op>,
    column_builders: Vec<ArrayBuilderImpl>,
    vis_builder: BitmapBuilder,
    data_types: Vec<DataType>,
    max_chunk_size: Option<usize>,
    initial_capacity: usize,
    size: usize,
}

Build stream chunks with fixed chunk size from rows or records.

Fields

ops: Vec<Op>

operations in the data chunk to build

column_builders: Vec<ArrayBuilderImpl>

arrays in the data chunk to build

vis_builder: BitmapBuilder

Visibility

data_types: Vec<DataType>

Data types of columns

max_chunk_size: Option<usize>

Max number of rows in a chunk. When it’s Some(n), the chunk builder will, if necessary, yield a chunk of which the size is strictly less than or equal to n when appending records. When it’s None, the chunk builder will yield chunks only when take is called.

initial_capacity: usize

The initial capacity of ops and ArrayBuilders.

size: usize

Number of currently pending rows.

Implementations

impl StreamChunkBuilder

pub fn new(max_chunk_size: usize, data_types: Vec<DataType>) -> Self

Create a new StreamChunkBuilder with a fixed max chunk size. Note that in the case of ending with Update, the builder may yield a chunk with size max_chunk_size + 1.

pub fn unlimited( data_types: Vec<DataType>, initial_capacity: Option<usize>, ) -> Self

Create a new StreamChunkBuilder with unlimited chunk size. The builder will only yield chunks when take is called.

pub fn size(&self) -> usize

Get the current number of rows in the builder.

pub fn append_iter<'a>( &mut self, op: Op, iter: impl IntoIterator<Item = (usize, DatumRef<'a>)>, ) -> Option<StreamChunk>

Append an iterator of output index and datum to the builder, return a chunk if the builder is full.

Note: the caller must ensure that each column occurs exactly once in iter.

pub fn append_row(&mut self, op: Op, row: impl Row) -> Option<StreamChunk>

Append a row to the builder, return a chunk if the builder is full.

pub fn append_row_invisible( &mut self, op: Op, row: impl Row, ) -> Option<StreamChunk>

Append an invisible row to the builder, return a chunk if the builder is full.

pub fn append_record(&mut self, record: Record<impl Row>) -> Option<StreamChunk>

Append a record to the builder, return a chunk if the builder is full.

pub fn take(&mut self) -> Option<StreamChunk>

Take all the pending data and return a chunk. If there is no pending data, return None. Note that if this is an unlimited chunk builder, the only way to get a chunk is to call take.

fn append_iter_inner<'a, const VIS: bool>( &mut self, op: Op, iter: impl IntoIterator<Item = (usize, DatumRef<'a>)>, ) -> Option<StreamChunk>

Trait Implementations

impl Drop for StreamChunkBuilder

fn drop(&mut self)

Executes the destructor for this type.