Skip to main content

Module iceberg

Module iceberg 

Source

Re-exports§

pub use planner::IcebergIncrementalScan;
pub use planner::IcebergScanMetricsLabels;
pub use planner::IcebergScanPlan;
pub use planner::IcebergScanPlanner;
pub use planner::IcebergScanProjection;
pub use planner::IcebergScanTaskBatchMode;
pub use planner::IcebergScanTaskPlanner;
pub use planner::PersistedFileScanTask;
pub use self::metrics::GLOBAL_ICEBERG_SCAN_METRICS;
pub use self::metrics::IcebergFileScanMetrics;
pub use self::metrics::IcebergScanMetrics;
pub use parquet_file_handler::*;

Modules§

metrics
parquet_file_handler
planner
update_planner
Metadata-only planning of Insert and Delete updates. Each plan covers a range of pending snapshots as one net change from a base snapshot to a target snapshot. Plans do not advance ingestion progress: the caller must order Delete before Insert, then acknowledge the target. This is deliberately separate from the legacy append-only planner and List/Fetch protocol.
update_reader
Per-file updates (Insert and Delete) for PK-index sink output. The planner, not the reader’s local history, determines whether a file is new or retained. This does not schedule phases or commit progress: callers must checkpoint cursors with output and enforce Delete-before-Insert.
update_state
Durable List/Fetch handoff for Insert/Delete updates.

Structs§

IcebergDeleteParameters
IcebergFileReader
IcebergListResult
IcebergProperties
IcebergScanOpts
IcebergSplit
IcebergSplitEnumerator

Enums§

IcebergFileScanTask
IcebergTimeTravelInfo

Constants§

ICEBERG_CONNECTOR
STREAMING_UPDATES_KEY

Functions§

is_shredded_variant_rejection 🔒
Whether the error is the reader’s per-file rejection of shredded variant columns.
pad_null_variant_columns 🔒
Insert all-NULL variant columns at the given projected positions.
projected_variant_columns 🔒
The projected VARIANT columns of a task: their field ids, their positions in the projected column order, and their names.
scan_task_to_chunk_with_deletes
Scan a data file. Delete files are handled by the iceberg-rust reader.read implementation.
validate_update_projection 🔒