Skip to main content

Module position_delete

Module position_delete 

Source
Expand description

Shared iceberg position-delete (Puffin deletion vector) helpers.

Constantsยง

DELETION_VECTOR_PROPERTY_CARDINALITY ๐Ÿ”’
Puffin blob property for deletion vector cardinality.
DELETION_VECTOR_PROPERTY_REFERENCED_DATA_FILE ๐Ÿ”’
Puffin blob property for referenced data file path.
POSITION_DELETE_WRITE_CHUNK_SIZE ๐Ÿ”’
How many positions to buffer before flushing one (file_path, pos) batch to the writer.

Functionsยง

read_dv_positions_from_data_file
Reads the deletion-vector positions of a single Puffin DV DataFile.
read_parquet_position_deletes_from_file
Reads the positions stored in a V2 Parquet position-delete file into a [DeleteVector].
read_position_deletes_from_file
Reads the deleted positions of a single position-delete DataFile regardless of on-disk format,
write_dv_puffin_file
Writes delete_vector as a single Puffin deletion-vector blob referencing data_file_path, and returns its [DataFile] metadata (content PositionDeletes, format Puffin) with referenced_data_file set.
write_parquet_position_delete_file
Writes delete_vector as a single file-scoped Parquet position-delete file referencing data_file_path, and returns its [DataFile] metadata (content PositionDeletes, format Parquet) with referenced_data_file set.
write_position_delete_chunk ๐Ÿ”’
Writes one chunk of positions as a (file_path, pos) batch into writer. Every row shares data_file_path because the delete file is file-scoped.