Module stream Copy item path Source pub use source_manager ::*;cdc 🔒 refresh_manager 🔒 scale 🔒 sink 🔒 source_manager state_match This module contains the logic for matching the internal state tables of two streaming jobs,
used for replacing a streaming job (typically ALTER MV) while preserving the existing state. stream_graph 🔒 stream_manager 🔒 ActorGraphBuildResult The result of a built actor graph. Will be further embedded into the Context for building
actors on the compute nodes. ActorGraphBuilder ActorGraphBuilderAssigner Core assigner with configurable strategies. AssignerBuilder Builder for Assigner AutoRefreshSchemaSinkContext CompleteStreamFragmentGraph A wrapper of StreamFragmentGraph CreateStreamingJobContext CreateStreamingJobContextCreateStreamingJobOption FragmentGraphDownstreamContext FragmentGraphUpstreamContext GlobalRefreshTableProgressTracker GlobalStreamManager GlobalStreamManager manages all the streams in the system.Locations LocationsParallelismPolicy RefreshManager High level design for refresh table ReplaceStreamJobContext ReplaceStreamJobContextResourceGroupPolicy ScaleController ScaleFactor A validated, non-negative, finite scale factor. SingleTableRefreshProgressTracker StreamFragmentGraph In-memory representation of a Fragment Graph, built from the [StreamFragmentGraphProto]
from the frontend. UpstreamSinkInfo WorkerReschedule BalancedBy Defines the vnode distribution strategy for hierarchical assignment. CapacityMode Defines the capacity assignment strategy for containers. ReschedulePolicy VnodeChunkingStrategy Defines the VNode chunking strategy for assignment. REFRESH_TABLE_PROGRESS_TRACKER Global, per-table refresh progress tracker. assign_hierarchical Hierarchically distributes virtual nodes to actors in two weighted stages with deterministic tie-breaking. assign_items_weighted_with_scale_fn Assign items to weighted containers with optional capacity scaling and deterministic tie-breaking. check_sink_fragments_support_refresh_schema fill_snapshot_backfill_epoch Fill snapshot epoch for StreamScanNode of SnapshotBackfill.
Return true when has change applied. rewrite_refresh_schema_sink_fragment unbounded_scale A no-op capacity scaling function: always returns None. validate_sink weighted_scale A unit capacity scaling function: always returns Some(1.0). FragmentBackfillOrder Adjacency list (G) of backfill orders.
G[10] -> [1, 2, 11]
means for the backfill node in fragment 10
should be backfilled before the backfill nodes in fragment 1, 2 and 11. GlobalStreamManagerRef ScaleControllerRef