risingwave_connector::source::data_gen_util

Function spawn_data_generation_stream

source
pub fn spawn_data_generation_stream<T: Send + 'static>(
    stream: impl Stream<Item = T> + Send + 'static,
    buffer_size: usize,
) -> impl Stream<Item = T> + Send + 'static
Expand description

Spawn the data generator to a dedicated runtime, returns a channel receiver for acquiring the generated data. This is used for the DatagenSplitReader and NexmarkSplitReader in case that they are CPU intensive and may block the streaming actors.