Module writer

Module writer 

Source

Structsยง

IcebergSinkWriterArgs
IcebergSinkWriterInner
IcebergWriterMetrics
SharedIcebergWriterBuilder ๐Ÿ”’
TaskWriterBuilderWrapper ๐Ÿ”’

Enumsยง

IcebergSinkWriter
IcebergWriterDispatch ๐Ÿ”’
PositionDeleteWriterBuilderType ๐Ÿ”’
PositionDeleteWriterType ๐Ÿ”’
ProjectIdxVec ๐Ÿ”’
None means no project. Prepare represent the extra partition column idx. Done represents the project idx vec.

Constantsยง

MAX_COLUMN_STAT_SIZE ๐Ÿ”’
Maximum size for column statistics (min/max values) in bytes. Column statistics larger than this will be truncated to avoid metadata bloat. This is especially important for large fields like JSONB, TEXT, BINARY, etc.

Functionsยง

truncate_datafile ๐Ÿ”’
Truncate large column statistics from DataFile BEFORE serialization.

Type Aliasesยง

DataFileWriterBuilderType ๐Ÿ”’
DeletionVectorWriterBuilderType ๐Ÿ”’
DeletionVectorWriterType ๐Ÿ”’
EqualityDeleteFileWriterBuilderType ๐Ÿ”’
PositionDeleteFileWriterBuilderType ๐Ÿ”’
PositionDeleteFileWriterType ๐Ÿ”’