Module column_aware_row_encoding

Column-aware row encoding is an encoding format which converts row into a binary form that remains explanable after schema changes Current design of flag just contains 1 meaningful information: the 2 LSBs represents the size of offsets: u8/u16/u32 We have a Serializer and a Deserializer for each schema of Row, which can be reused until schema changes

Structs

• ColumnAwareSerde
  Combined column-aware Serializer and Deserializer given the same column_ids and schema
• Deserializer
  Column-Aware Deserializer holds needed ColumnIds and their corresponding schema Should non-null default values be specified, a new field could be added to Deserializer
• Flag 🔒
• RowEncoding 🔒
  RowEncoding holds row-specific information for Column-Aware Encoding
• Serializer
  Column-Aware Serializer holds schema related information, and shall be created again once the schema changes

Functions

• deserialize_width 🔒
• try_drop_invalid_columns
  Deserializes row encoded_bytes, drops columns not in valid_column_ids, serializes and returns. If no column is dropped, returns None.