Module arrow_impl

Converts between arrays and Apache Arrow arrays.

This file acts as a template file for conversion code between arrays and different version of Apache Arrow.

The conversion logic will be implemented for the arrow version specified in the outer mod by super::arrow_xxx, such as super::arrow_array.

When we want to implement the conversion logic for an arrow version, we first create a new mod file, and rename the corresponding arrow package name to arrow_xxx using the use clause, and then declare a sub-mod and set its file path with attribute #[path = "./arrow_impl.rs"] so that the code in this template file can be embedded to the new mod file, and the conversion logic can be implemented for the corresponding arrow version.

Example can be seen in arrow_default.rs, which is also as followed:

use {arrow_array, arrow_buffer, arrow_cast, arrow_schema};

#[allow(clippy::duplicate_mod)]
#[path = "./arrow_impl.rs"]
mod arrow_impl;

Macros

converts 🔒

Implement bi-directional From between concrete array types.

converts_with_timeunit 🔒

converts_with_type 🔒

Used to convert different types.

Traits

FromArrow

Defines how to convert Arrow arrays to RisingWave arrays.

FromIntoArrow 🔒

Converts RisingWave value from and into Arrow value.

FromIntoArrowWithUnit 🔒

Converts RisingWave value from and into Arrow value. Specifically used for converting timestamp types according to timeunit.

ToArrow

Defines how to convert RisingWave arrays to Arrow arrays.

Functions

is_parquet_schema_match_source_schema

This function checks whether the schema of a Parquet file matches the user defined schema. It handles the following special cases: