const MAX_COLUMN_STAT_SIZE: usize = 10240;Expand description
Maximum size for column statistics (min/max values) in bytes. Column statistics larger than this will be truncated to avoid metadata bloat. This is especially important for large fields like JSONB, TEXT, BINARY, etc.
Fix for large column statistics in DataFile metadata that can cause OOM errors.
We truncate at the DataFile level (before serialization) by directly modifying
the public lower_bounds and upper_bounds fields.
This prevents metadata from ballooning to gigabytes when dealing with large JSONB, TEXT, or BINARY fields, while still preserving statistics for small fields that benefit from query optimization.