Skip to main content

Module stream_fragmenter

Module stream_fragmenter 

Source

Modulesยง

graph ๐Ÿ”’
parallelism ๐Ÿ”’
rewrite ๐Ÿ”’

Structsยง

BuildFragmentGraphState
The mutable state when building fragment graph.

Enumsยง

GraphJobType

Functionsยง

build_and_add_fragment ๐Ÿ”’
Use the given stream_node to create a fragment and add it to graph.
build_fragment ๐Ÿ”’
Build new fragment and link dependencies by visiting children recursively, update requires_singleton and fragment_type properties for current fragment.
build_graph
build_graph_with_strategy
generate_fragment_graph ๐Ÿ”’
Generate fragment DAG from input streaming plan by their dependency.
reject_variant_in_internal_storage_key ๐Ÿ”’
Rejects VARIANT (including nested) in the storage pk of any internal state table. Internal tables only materialize when the plan is lowered to protobuf, so this is the single point that backstops operators whose state keys no logical checker visits.