Re-exports§
pub use state_table_handler::*;
Modules§
- executor_
core 🔒 - fs_
fetch_ 🔒executor - fs_
list_ 🔒executor - iceberg_
fetch_ 🔒executor - iceberg_
list_ 🔒executor - reader_
stream 🔒 - source_
backfill_ 🔒executor - source_
backfill_ 🔒state_ table - source_
executor 🔒 - state_
table_ handler
Structs§
- Backfill
State With Progress - Only
statefield is the real state for fail-over. Other fields are for observability (but we still need to persist them). - FsFetch
Executor - FsList
Executor - Iceberg
Fetch Executor - An executor that fetches data from Iceberg tables.
- Iceberg
List Executor - Source
Backfill Executor - Source
Backfill Executor Inner - Source
Executor - Stream
Source Core StreamSourceCorestores the necessary information for the source executor to execute on the external connector.
Enums§
Constants§
- WAIT_
BARRIER_ MULTIPLE_ TIMES - A constant to multiply when calculating the maximum time to wait for a barrier. This is due to some latencies in network and cost in meta.
Functions§
- apply_
rate_ limit - apply_
rate_ limit_ with_ for_ streaming_ file_ source_ reader - barrier_
to_ message_ stream - Receive barriers from barrier manager with the channel, error on channel close.
- get_
infinite_ backoff_ strategy - get_
split_ offset_ col_ idx - get_
split_ offset_ mapping_ from_ chunk - process_
chunk 🔒 - prune_
additional_ cols