Re-exports§
pub use parquet_parser::ParquetParser;
Modules§
- avro 🔒
- canal 🔒
- common 🔒
- debezium 🔒
- maxwell 🔒
- mysql 🔒
- postgres 🔒
- protobuf 🔒
- unified 🔒Unified parsers for both normal events or CDC events of multiple message formats
- util 🔒
Structs§
- The meta data of the original message for a row writer.
- Note: this is created in
SourceReader::build_stream - A builder for building a
StreamChunkfromSourceColumnDesc. SourceStreamChunkRowWriteris responsible to write one or more records to theStreamChunk, where each contains either one row (Insert/Delete) or two rows (Update) that can be written atomically.
Enums§
- The entrypoint of parsing. It parses
SourceMessagestream (byte stream) intoStreamChunkstream. Used bycrate::source::into_chunk_stream. - The result of parsing a message.
- WIP: may cover protobuf and json schema later.
- Transaction control message. Currently only used by Debezium messages.
Constants§
- Maximum number of rows in a transaction. If a transaction is larger than this, it will be force committed to avoid potential OOM.
Traits§
- Access to a field in the data structure. Created by
AccessBuilder. - Parses raw bytes into a specific format (avro, json, protobuf, …), and then builds an
Accessfrom the parsed data. ByteStreamSourceParseris the entrypoint abstraction for parsing messages. It consumes bytes of one individual message and produces parsed records.- OpAction 🔒
Functions§
- The decoding result can be interpreted as follows: Ok(value) => The value was found and successfully decoded. Err(error) => The value was found but could not be decoded, either because it was not supported, or there was an error during conversion.