Structsยง
- Connector
Source Worker ConnectorSourceWorkerkeeps fetching the latest split metadata from the external source service (Self::tick), and maintains it incurrent_splits.- Connector
Source Worker Handle - Handle for a running
ConnectorSourceWorker. - Shared
Split Map
Enumsยง
Constantsยง
- DEBUG_
SPLITS_ ๐KEY - DEFAULT_
SOURCE_ ๐WORKER_ TICK_ INTERVAL - MAX_
FAIL_ ๐CNT - TICK_
INFLIGHT_ ๐WARN_ INTERVAL - Interval at which a still-running (in-flight) source worker tick emits a progressive warning.
Functionsยง
- create_
source_ worker - Used to create a new
ConnectorSourceWorkerHandlefor a new source. - create_
source_ worker_ async - Used on startup (
SourceManager::new). Failed sources will not block meta startup. - extract_
prop_ ๐from_ existing_ source - extract_
prop_ ๐from_ new_ source - run_
tick_ ๐with_ progressive_ warn - Drive a source worker
tickfuture to completion, recording its duration intick_durationand emitting awarn!everyTICK_INFLIGHT_WARN_INTERVALwhile it is still pending. The future is never cancelled or timed out, sotick()semantics are unchanged.
Type Aliasesยง
- Shared
Split ๐MapRef