truncate_datafile

risingwave_connector::sink::iceberg

Function truncate_datafile 

Source 
fn truncate_datafile(data_file: DataFile) -> DataFile
Expand description

Truncate large column statistics from DataFile BEFORE serialization.

This function directly modifies DataFile’s lower_bounds and upper_bounds to remove entries that exceed MAX_COLUMN_STAT_SIZE.

§Arguments

  • data_file - A DataFile to process

§Returns

The modified DataFile with large statistics truncated