Module iceberg

risingwave_connector::sink

Module iceberg 

Source

Modules§

prometheus 🔒

Structs§

IcebergCommitResult 🔒
IcebergConfig
IcebergSink
IcebergSinkCommitter
IcebergSinkWriterArgs
IcebergSinkWriterInner
IcebergWriterMetrics
TaskWriterBuilderWrapper 🔒

Enums§

CompactionType
Compaction type for Iceberg sink
IcebergSinkWriter
IcebergWriteMode
IcebergWriterDispatch 🔒
ProjectIdxVec 🔒
None means no project. Prepare represent the extra partition column idx. Done represents the project idx vec.

Constants§

COMPACTION_DELETE_FILES_COUNT_THRESHOLD
COMPACTION_INTERVAL_SEC
COMPACTION_MAX_SNAPSHOTS_NUM
COMPACTION_SMALL_FILES_THRESHOLD_MB
COMPACTION_TARGET_FILE_SIZE_MB
COMPACTION_TRIGGER_SNAPSHOT_COUNT
COMPACTION_TYPE
DATA_FILES 🔒
ENABLE_COMPACTION
ENABLE_SNAPSHOT_EXPIRATION
ICEBERG_COMPACTION_TYPE_FILES_WITH_DELETE
ICEBERG_COMPACTION_TYPE_FULL
ICEBERG_COMPACTION_TYPE_SMALL_FILES
ICEBERG_COW_BRANCH
ICEBERG_SINK
ICEBERG_WRITE_MODE_COPY_ON_WRITE
ICEBERG_WRITE_MODE_MERGE_ON_READ
MAP_KEY 🔒
MAP_VALUE 🔒
MAX_COLUMN_STAT_SIZE 🔒
Maximum size for column statistics (min/max values) in bytes. Column statistics larger than this will be truncated to avoid metadata bloat. This is especially important for large fields like JSONB, TEXT, BINARY, etc.
PARTITION_DATA_ID_START
PARTITION_SPEC_ID 🔒
SCHEMA_ID 🔒
SNAPSHOT_EXPIRATION_CLEAR_EXPIRED_FILES
SNAPSHOT_EXPIRATION_CLEAR_EXPIRED_META_DATA
SNAPSHOT_EXPIRATION_MAX_AGE_MILLIS
SNAPSHOT_EXPIRATION_RETAIN_LAST
WRITE_MODE

Functions§

check_compatibility 🔒
commit_branch
create_and_validate_table_impl 🔒
create_table_if_not_exists_impl 🔒
default_commit_retry_num 🔒
default_iceberg_write_mode 🔒
default_some_true 🔒
default_true 🔒
deserialize_metadata 🔒
get_fields 🔒
parse_partition_by_exprs
serialize_metadata 🔒
should_enable_iceberg_cow
truncate_datafile 🔒
Truncate large column statistics from DataFile BEFORE serialization.
try_matches_arrow_schema
Try to match our schema with iceberg schema.

Type Aliases§

DataFileWriterBuilderType 🔒
EqualityDeleteFileWriterBuilderType 🔒
PositionDeleteFileWriterBuilderType 🔒