Module iceberg_with_pk_index 

Iceberg V3 Sink with Primary Key Index

This module implements three core executors for the Iceberg V3 sink that uses Deletion Vectors (DVs) instead of Equality Delete files:

1. Writer Executor (Stateful): Maintains a PK index mapping primary keys to (file_path, position). Writes data files for inserts and emits (file_path, position) messages for deletes.

2. DV Merger Executor (Stateless): Consumes the Writer’s (file_path, position) messages, merges delete positions with historical DVs, and reports the resulting DV files to meta.

Re-exports

pub use dv_handler_impl::DvHandlerImpl;

pub use dv_merger::DvMergerExecutor;

pub use writer::WriterExecutor;

pub use writer_impl::IcebergWriterImpl;

Modules

dv_handler_impl 🔒

dv_merger 🔒

writer 🔒

writer_impl 🔒