Module fragment

Structs§

BuildingFragment 🔒: The fragment in the building phase, including the StreamFragment from the frontend and several additional helper fields.
CompleteStreamFragmentGraph: A wrapper of StreamFragmentGraph that contains the additional information of pre-existing fragments, which are connected to the graph’s top-most or bottom-most fragments.
DownstreamExternalEdgeId 🔒
FragmentBackfillOrder: Adjacency list (G) of backfill orders. G[10] -> [1, 2, 11] means for the backfill node in fragment 10 should be backfilled before the backfill nodes in fragment 1, 2 and 11.
FragmentGraphDownstreamContext
FragmentGraphUpstreamContext
ScanRewriteResult 🔒: Output mapping info after rewriting a StreamScan node.
StreamFragmentEdge 🔒: The edge in the fragment graph.
StreamFragmentGraph: In-memory representation of a Fragment Graph, built from the StreamFragmentGraphProto from the frontend.

EdgeId 🔒: The ID of an edge in the fragment graph. For different types of edges, the ID will be in different variants.
EitherFragment 🔒: A fragment that is either being built or already exists. Used for generalize the logic of crate::stream::ActorGraphBuilder.

build_new_sink_columns 🔒: Build sink column list after removing and appending columns.
check_sink_fragments_support_refresh_schema
clone_fragment 🔒
extend_sink_columns 🔒: Append new columns to a sink/log-store column list with updated names/ids.
fill_snapshot_backfill_epoch: Fill snapshot epoch for StreamScanNode of SnapshotBackfill. Return true when has change applied.
gen_output_mapping 🔒: Generate the output_mapping for DispatchStrategy from given columns.
mv_on_mv_dispatch_strategy 🔒
rewrite_log_store_table 🔒: Rewrite log store table columns for schema change.
rewrite_project_node 🔒: Rewrite Project node input refs and extend with newly added columns.
rewrite_refresh_schema_sink_fragment
rewrite_stream_scan_and_merge 🔒: Rewrite StreamScan + Merge to match the new upstream schema.