Expand description
Shared Iceberg position-delete (Parquet and Puffin deletion vector) helpers.
StructsΒ§
- Cached
Puffin πReader - Position
Delete File Name Generators - File-name generators shared by all Iceberg position-delete writers.
- Position
Delete Reader - Shared decoder with at most one cached Puffin reader/footer. Callers may reuse it across sequential tasks for the same table/FileIO. Decoded bitmaps are never cached by path. Puffin paths must identify immutable files; drop the reader to release its cache.
- Position
Delete πValidation - Checks required at the source boundary, but not by trusted sink read-modify-write calls.
ConstantsΒ§
- DELETION_
VECTOR_ πPROPERTY_ CARDINALITY - Puffin blob property for deletion vector cardinality.
- DELETION_
VECTOR_ πPROPERTY_ REFERENCED_ DATA_ FILE - Puffin blob property for referenced data file path.
- POSITION_
DELETE_ πWRITE_ CHUNK_ SIZE - How many positions to buffer before flushing one
(file_path, pos)batch to the writer.
FunctionsΒ§
- read_
dv_ positions_ from_ data_ file - Reads the deletion-vector positions of a single Puffin DV
DataFile. - read_
parquet_ position_ deletes_ from_ file - Reads the positions stored in a V2 Parquet position-delete file into a [
DeleteVector]. - read_
position_ deletes_ from_ file - Reads the deleted positions of a single position-delete
DataFileregardless of on-disk format, - validate_
position_ πdelete_ descriptor - Metadata-only source checks, shared by planning (including compaction) and replay reads.
Returns the validated blob range for Puffin, or
Nonefor Parquet. - write_
dv_ puffin_ file - Writes
delete_vectoras a single Puffin deletion-vector blob referencingdata_file_path, and returns its [DataFile] metadata (contentPositionDeletes, formatPuffin) withreferenced_data_fileset. - write_
parquet_ position_ delete_ file - Writes
delete_vectoras a single file-scoped Parquet position-delete file referencingdata_file_path, and returns its [DataFile] metadata (contentPositionDeletes, formatParquet) withreferenced_data_fileset. - write_
position_ πdelete_ chunk - Writes one chunk of
positionsas a(file_path, pos)batch intowriter. Every row sharesdata_file_pathbecause the delete file is file-scoped. - write_
position_ delete_ file - Write one file-scoped position-delete artifact using the tableβs configured on-disk format.