Module kafka

Modules

opaque_type 🔒

Structs

KafkaConfig

KafkaPayloadWriter 🔒

KafkaSink

KafkaSinkWriter

RdKafkaPropertiesProducer

See https://github.com/confluentinc/librdkafka/blob/master/CONFIGURATION.md for the detailed meaning of these librdkafka producer properties

Enums

CompressionCodec

Constants

KAFKA_SINK

KAFKA_WRITER_MAX_QUEUE_SIZE 🔒

The default queue size used to enforce a commit in kafka producer if queue.buffering.max.messages is not specified. This default value is determined based on the librdkafka default. See the following doc for more details: https://github.com/confluentinc/librdkafka/blob/1cb80090dfc75f5a36eae3f4f8844b14885c045e/CONFIGURATION.md

KAFKA_WRITER_MAX_QUEUE_SIZE_RATIO 🔒

When the DeliveryFuture the current future_delivery_buffer is buffering is greater than queue_buffering_max_messages * KAFKA_WRITER_MAX_QUEUE_SIZE_RATIO, then enforcing commit once

Functions

_default_max_in_flight_requests_per_connection 🔒

_default_max_retries 🔒

_default_retry_backoff 🔒

Type Aliases

KafkaSinkDeliveryFuture