Module config

Constants

COMPACTOR_MEMORY_PROPORTION 🔒

COMPUTE_BATCH_MEMORY_PROPORTION_FOR_SERVING 🔒

COMPUTE_BATCH_MEMORY_PROPORTION_FOR_STREAMING 🔒

The proportion of compute memory used for batch processing.

MIN_COMPUTE_MEMORY_MB

The minimal memory requirement of computing tasks in megabytes.

MIN_SYSTEM_RESERVED_MEMORY_MB

The memory reserved for system usage (stack and code segment of processes, allocation overhead, network buffer, etc.) in megabytes.

RESERVED_MEMORY_LEVELS 🔒

RESERVED_MEMORY_PROPORTIONS 🔒

STORAGE_BLOCK_CACHE_MEMORY_PROPORTION 🔒

STORAGE_MEMORY_PROPORTION 🔒

STORAGE_META_CACHE_MEMORY_PROPORTION 🔒

STORAGE_SHARED_BUFFER_MAX_MEMORY_MB 🔒

STORAGE_SHARED_BUFFER_MEMORY_PROPORTION 🔒

Functions

batch_mem_limit

gradient_reserve_memory_bytes

Calculate the reserved memory based on the total memory size. The reserved memory size is calculated based on the following gradient:

reserve_memory_bytes

Each compute node reserves some memory for stack and code segment of processes, allocation overhead, network buffer, etc. based on gradient reserve memory proportion. The reserve memory size must be larger than MIN_SYSTEM_RESERVED_MEMORY_MB

storage_memory_config

Decide the memory limit for each storage cache. If not specified in StorageConfig, memory limits are calculated based on the proportions to total non_reserved_memory_bytes.