Expand description
Shared iceberg position-delete (Puffin deletion vector) helpers.
Constantsยง
- DELETION_
VECTOR_ ๐PROPERTY_ CARDINALITY - Puffin blob property for deletion vector cardinality.
- DELETION_
VECTOR_ ๐PROPERTY_ REFERENCED_ DATA_ FILE - Puffin blob property for referenced data file path.
- POSITION_
DELETE_ ๐WRITE_ CHUNK_ SIZE - How many positions to buffer before flushing one
(file_path, pos)batch to the writer.
Functionsยง
- read_
dv_ positions_ from_ data_ file - Reads the deletion-vector positions of a single Puffin DV
DataFile. - read_
parquet_ position_ deletes_ from_ file - Reads the positions stored in a V2 Parquet position-delete file into a [
DeleteVector]. - read_
position_ deletes_ from_ file - Reads the deleted positions of a single position-delete
DataFileregardless of on-disk format, - write_
dv_ puffin_ file - Writes
delete_vectoras a single Puffin deletion-vector blob referencingdata_file_path, and returns its [DataFile] metadata (contentPositionDeletes, formatPuffin) withreferenced_data_fileset. - write_
parquet_ position_ delete_ file - Writes
delete_vectoras a single file-scoped Parquet position-delete file referencingdata_file_path, and returns its [DataFile] metadata (contentPositionDeletes, formatParquet) withreferenced_data_fileset. - write_
position_ ๐delete_ chunk - Writes one chunk of
positionsas a(file_path, pos)batch intowriter. Every row sharesdata_file_pathbecause the delete file is file-scoped.