Modules§
Structs§
- Iceberg
Commit 🔒Result - Iceberg
Config - Iceberg
Sink - Iceberg
Sink Committer - Iceberg
Sink Writer Args - Iceberg
Sink Writer Inner - Iceberg
Writer Metrics
Enums§
- Compaction
Type - Compaction type for Iceberg sink
- Iceberg
Sink Writer - Iceberg
Write Mode - Iceberg
Writer 🔒Dispatch - Project
IdxVec 🔒 - None means no project. Prepare represent the extra partition column idx. Done represents the project idx vec.
Constants§
- COMPACTION_
DELETE_ FILES_ COUNT_ THRESHOLD - COMPACTION_
INTERVAL_ SEC - COMPACTION_
MAX_ SNAPSHOTS_ NUM - COMPACTION_
SMALL_ FILES_ THRESHOLD_ MB - COMPACTION_
TARGET_ FILE_ SIZE_ MB - COMPACTION_
TRIGGER_ SNAPSHOT_ COUNT - COMPACTION_
TYPE - DATA_
FILES 🔒 - ENABLE_
COMPACTION - ENABLE_
SNAPSHOT_ EXPIRATION - ICEBERG_
COMPACTION_ TYPE_ FILES_ WITH_ DELETE - ICEBERG_
COMPACTION_ TYPE_ FULL - ICEBERG_
COMPACTION_ TYPE_ SMALL_ FILES - ICEBERG_
COW_ BRANCH - ICEBERG_
SINK - ICEBERG_
WRITE_ MODE_ COPY_ ON_ WRITE - ICEBERG_
WRITE_ MODE_ MERGE_ ON_ READ - MAP_KEY 🔒
- MAP_
VALUE 🔒 - PARTITION_
SPEC_ 🔒ID - SCHEMA_
ID 🔒 - SNAPSHOT_
EXPIRATION_ CLEAR_ EXPIRED_ FILES - SNAPSHOT_
EXPIRATION_ CLEAR_ EXPIRED_ META_ DATA - SNAPSHOT_
EXPIRATION_ MAX_ AGE_ MILLIS - SNAPSHOT_
EXPIRATION_ RETAIN_ LAST - WRITE_
MODE
Functions§
- check_
compatibility 🔒 - commit_
branch - create_
and_ 🔒validate_ table_ impl - create_
table_ 🔒if_ not_ exists_ impl - default_
commit_ 🔒retry_ num - default_
iceberg_ 🔒write_ mode - default_
some_ 🔒true - default_
true 🔒 - deserialize_
metadata - get_
fields 🔒 - parse_
partition_ by_ exprs - serialize_
metadata - should_
enable_ iceberg_ cow - try_
matches_ arrow_ schema - Try to match our schema with iceberg schema.