Module stream_plan Copy item path Source agg_call_state Nested message and enum types in AggCallState. barrier Nested message and enum types in Barrier. barrier_mutation Nested message and enum types in BarrierMutation. connector_props_change_mutation Nested message and enum types in ConnectorPropsChangeMutation. expand_node Nested message and enum types in ExpandNode. lookup_node Nested message and enum types in LookupNode. now_node Nested message and enum types in NowNode. stream_fragment_graph Nested message and enum types in StreamFragmentGraph. stream_message Nested message and enum types in StreamMessage. stream_message_batch Nested message and enum types in StreamMessageBatch. stream_node Nested message and enum types in StreamNode. throttle_mutation Nested message and enum types in ThrottleMutation. update_mutation Nested message and enum types in UpdateMutation. values_node Nested message and enum types in ValuesNode. ActorMapping Hash mapping for compute node. Stores mapping from virtual node to actor id. AddMutation AggCallState ArrangeNode Special node for shared state, which will only be produced in fragmenter. ArrangeNode will
produce a special Materialize executor, which materializes data for downstream to query. ArrangementInfo AsOfJoinNode BackfillOrder Barrier BarrierMutation BarrierRecvNode The executor only for receiving barrier from the meta service. It always resides in the leaves
of the streaming graph. BatchPlanNode BatchPlanNode is used for mv on mv snapshot read.
BatchPlanNode is supposed to carry a batch plan that can be optimized with the streaming plan_common.
Currently, streaming to batch push down is not yet supported, BatchPlanNode is simply a table scan. CdcFilterNode ChangeLogNode CombinedMutation ConnectorPropsChangeMutation DedupNode DeltaExpression DeltaIndexJoinNode Delta join with two indexes. This is a pseudo plan node generated on frontend. On meta
service, it will be rewritten into lookup joins. DispatchStrategy The property of an edge in the fragment graph.
This is essientially a “logical” version of Dispatcher. See the doc of Dispatcher for more details. Dispatcher A dispatcher redistribute messages.
We encode both the type and other usage information in the proto. Dispatchers DmlNode Merges two streams from streaming and batch for data manipulation. DropSubscriptionsMutation DynamicFilterNode EowcOverWindowNode ExchangeNode passed from frontend to meta, used by fragmenter to generate MergeNode
and maybe DispatcherNode later. ExpandNode FilterNode GlobalApproxPercentileNode GroupTopNNode HashAggNode HashJoinNode HopWindowNode InequalityPair LocalApproxPercentileNode LookupNode Special node for shared state. LookupNode will join an arrangement with a stream. LookupUnionNode Special node for shared state. Merge and align barrier from upstreams. Pipe inputs in order. MaterializeNode A materialized view is regarded as a table.
In addition, we also specify primary key to MV for efficient point lookup during update and deletion. MaterializedExprsNode MergeNode NoOpNode NowModeGenerateSeries NowModeUpdateCurrent NowNode OverWindowNode PauseMutation ProjectNode ProjectSetNode ResumeMutation RowIdGenNode RowMergeNode SimpleAggNode SinkDesc SinkNode SortNode Sorts inputs and outputs ordered data based on watermark. SourceBackfillNode / It’s input must be a MergeNode, which connects to the upstream source job.
/ See StreamSourceScan::adhoc_to_stream_prost for the plan. SourceChangeSplitMutation SourceNode StartFragmentBackfillMutation StopMutation StreamActor A StreamActor is a running fragment of the overall stream graph, StreamCdcScanNode StreamCdcScanOptions Config options for CDC backfill StreamContext The streaming context associated with a stream plan StreamFragmentGraph Representation of a graph of stream fragments.
Generated by the fragmenter in the frontend, only used in DDL requests and never persisted. StreamFsFetch copy contents from StreamSource to prevent compatibility issues in the future StreamFsFetchNode StreamMessage StreamMessageBatch StreamNode StreamScanNode StreamScanNode reads data from upstream table first, and then pass all events to downstream.
It always these 2 inputs in the following order: StreamSource SubscriptionUpstreamInfo SyncLogStoreNode TemporalJoinNode ThrottleMutation TopNNode UnionNode Acts like a merger, but on different inputs. UpdateMutation ValuesNode Watermark WatermarkFilterNode WatermarkFilter needs to filter the upstream data by the water mark. AggNodeVersion DispatcherType FragmentTypeFlag Indicates whether the fragment contains some special kind of nodes. OverWindowCachePolicy SinkLogStoreType StreamScanType Decides which kind of Executor will be used PbActorMapping PbAddMutation PbAggCallState PbAggNodeVersion PbArrangeNode PbArrangementInfo PbAsOfJoinNode PbBackfillOrder PbBarrier PbBarrierMutation PbBarrierRecvNode PbBatchPlanNode PbCdcFilterNode PbChangeLogNode PbCombinedMutation PbConnectorPropsChangeMutation PbDedupNode PbDeltaExpression PbDeltaIndexJoinNode PbDispatchStrategy PbDispatcher PbDispatcherType PbDispatchers PbDmlNode PbDropSubscriptionsMutation PbDynamicFilterNode PbEowcOverWindowNode PbExchangeNode PbExpandNode PbFilterNode PbFragmentTypeFlag PbGlobalApproxPercentileNode PbGroupTopNNode PbHashAggNode PbHashJoinNode PbHopWindowNode PbInequalityPair PbLocalApproxPercentileNode PbLookupNode PbLookupUnionNode PbMaterializeNode PbMaterializedExprsNode PbMergeNode PbNoOpNode PbNowModeGenerateSeries PbNowModeUpdateCurrent PbNowNode PbOverWindowCachePolicy PbOverWindowNode PbPauseMutation PbProjectNode PbProjectSetNode PbResumeMutation PbRowIdGenNode PbRowMergeNode PbSimpleAggNode PbSinkDesc PbSinkLogStoreType PbSinkNode PbSortNode PbSourceBackfillNode PbSourceChangeSplitMutation PbSourceNode PbStartFragmentBackfillMutation PbStopMutation PbStreamActor PbStreamCdcScanNode PbStreamCdcScanOptions PbStreamContext PbStreamFragmentGraph PbStreamFsFetch PbStreamFsFetchNode PbStreamMessage PbStreamMessageBatch PbStreamNode PbStreamScanNode PbStreamScanType PbStreamSource PbSubscriptionUpstreamInfo PbSyncLogStoreNode PbTemporalJoinNode PbThrottleMutation PbTopNNode PbUnionNode PbUpdateMutation PbValuesNode PbWatermark PbWatermarkFilterNode