Module source_manager

Modules

split_assignment 🔒

worker 🔒

Structs

SourceManager

SourceManager keeps fetching the latest split metadata from the external source services (worker::ConnectorSourceWorker::tick), and sends a split assignment command if split changes detected (Self::tick).

SourceManagerCore

SourceManagerRunningInfo

SplitDiffOptions

SplitState

Enums

SourceChange

Constants

DEFAULT_SOURCE_TICK_TIMEOUT 🔒

Functions

build_actor_connector_splits

build_actor_split_impls

create_source_worker

Used to create a new ConnectorSourceWorkerHandle for a new source.

reassign_splits

Reassigns splits if there are new splits or dropped splits, i.e., actor_splits and discovered_splits differ, or actors are rescheduled.

Type Aliases

ConnectorPropsChange

DiscoveredSourceSplits

SourceManagerRef

SplitAssignment

ThrottleConfig