Module iceberg_with_pk_index 

pk-index sink (V2/V3)

This module implements three core executors for the Iceberg pk-index sink that uses Deletion Vectors (DVs) instead of Equality Delete files:

1. Writer Executor (Stateful): Maintains a PK index mapping primary keys to (file_path, position). Writes data files for inserts and emits (file_path, position) messages for deletes.

2. Position-delete merger executor (Stateless): Consumes the Writer’s (file_path, position) messages, merges delete positions with historical deletes, and reports the resulting delete files to meta.

Re-exports

pub use position_delete_handler_impl::PositionDeleteHandlerImpl;

pub use position_delete_merger::PositionDeleteMergerExecutor;

pub use writer::WriterExecutor;

pub use writer_impl::IcebergWriterImpl;

Modules

position_delete_handler_impl 🔒

position_delete_merger 🔒

writer 🔒

writer_impl 🔒