Module worker

Source

Structsยง

ConnectorSourceWorker
ConnectorSourceWorker keeps fetching the latest split metadata from the external source service (Self::tick), and maintains it in current_splits.
ConnectorSourceWorkerHandle
Handle for a running ConnectorSourceWorker.
SharedSplitMap

Enumsยง

SourceWorkerCommand

Constantsยง

DEBUG_SPLITS_KEY ๐Ÿ”’
DEFAULT_SOURCE_TICK_TIMEOUT ๐Ÿ”’
DEFAULT_SOURCE_WORKER_TICK_INTERVAL ๐Ÿ”’
MAX_FAIL_CNT ๐Ÿ”’

Functionsยง

create_source_worker
Used to create a new ConnectorSourceWorkerHandle for a new source.
create_source_worker_async
Used on startup (SourceManager::new). Failed sources will not block meta startup.
extract_prop_from_existing_source ๐Ÿ”’
extract_prop_from_new_source ๐Ÿ”’

Type Aliasesยง

SharedSplitMapRef ๐Ÿ”’