Module source

Re-exports

• pub use state_table_handler::*;

Modules

• executor_core 🔒
• fetch_executor 🔒
• fs_source_executor 🔒 Deprecated
• list_executor 🔒
• source_backfill_executor 🔒
• source_backfill_state_table 🔒
• source_executor 🔒
• state_table_handler

Structs

• BackfillStateTableHandler
• BackfillStateWithProgress
  Only state field is the real state for fail-over. Other fields are for observability (but we still need to persist them).
• FsFetchExecutor
• FsListExecutor
• FsSourceExecutorDeprecated
  FsSourceExecutor is a streaming source, fir external file systems such as s3.
• SourceBackfillExecutor
• SourceBackfillExecutorInner
• SourceExecutor
• StreamSourceCore
  StreamSourceCore stores the necessary information for the source executor to execute on the external connector.

Enums

• BackfillState

Constants

• WAIT_BARRIER_MULTIPLE_TIMES
  A constant to multiply when calculating the maximum time to wait for a barrier. This is due to some latencies in network and cost in meta.

Functions

• apply_rate_limit
• barrier_to_message_stream
  Receive barriers from barrier manager with the channel, error on channel close.
• get_split_offset_col_idx
• get_split_offset_mapping_from_chunk
• prune_additional_cols

Type Aliases

• BackfillStates