Struct CompactorManagerInner 

pub struct CompactorManagerInner {
    pub task_expired_seconds: u64,
    pub heartbeat_expired_seconds: u64,
    task_heartbeats: HashMap<HummockCompactionTaskId, TaskHeartbeat>,
    pub compactor_map: HashMap<HummockContextId, Arc<Compactor>>,
}

CompactorManagerInner maintains compactors which can process compact task. A compact task is tracked in HummockManager::Compaction via both CompactStatus and CompactTaskAssignment.

A compact task can be in one of these states:

1. Success: an assigned task is reported as success via CompactStatus::report_compact_task. It’s the final state.
2. Failed: an Failed task is reported as success via CompactStatus::report_compact_task. It’s the final state.
3. Cancelled: a task is reported as cancelled via CompactStatus::report_compact_task. It’s the final state.

Fields

task_expired_seconds: u64

heartbeat_expired_seconds: u64

task_heartbeats: HashMap<HummockCompactionTaskId, TaskHeartbeat>

compactor_map: HashMap<HummockContextId, Arc<Compactor>>

The outer lock is a RwLock, so we should still be able to modify each compactor

Implementations

impl CompactorManagerInner

pub async fn with_meta(env: MetaSrvEnv) -> MetaResult<Self>

pub fn for_test() -> Self

Only used for unit test.

pub fn next_compactor(&self) -> Option<Arc<Compactor>>

pub fn add_compactor( &mut self, context_id: HummockContextId, ) -> UnboundedReceiver<MetaResult<SubscribeCompactionEventResponse>>

Retrieve a receiver of tasks for the compactor identified by context_id. The sender should be obtained by calling one of the compactor getters.

If add_compactor is called with the same context_id more than once, the only cause would be compactor re-subscription, as context_id is a monotonically increasing sequence.

pub fn abort_all_compactors(&mut self)

Used when meta exiting to support graceful shutdown.

pub fn remove_compactor(&mut self, context_id: HummockContextId)

pub fn get_compactor( &self, context_id: HummockContextId, ) -> Option<Arc<Compactor>>

pub fn check_tasks_status( &self, tasks: &[HummockCompactionTaskId], slow_task_duration: Duration, ) -> HashMap<HummockCompactionTaskId, (Duration, &'static str)>

pub fn get_heartbeat_expired_tasks(&self) -> Vec<CompactTask>

fn get_heartbeat_expired_tasks_impl( task_heartbeats: &HashMap<HummockCompactionTaskId, TaskHeartbeat>, heartbeat_expired_ts: u64, ) -> Vec<CompactTask>

pub fn initiate_task_heartbeat(&mut self, task: CompactTask)

pub fn remove_task_heartbeat(&mut self, task_id: u64)

pub fn update_task_heartbeats( &mut self, progress_list: &Vec<CompactTaskProgress>, ) -> (Vec<HummockCompactionTaskId>, Vec<HummockCompactionTaskId>)

Returns expired tracked task IDs and untracked task IDs to stop on the compactor.

pub fn compactor_num(&self) -> usize

pub fn get_progress(&self) -> Vec<CompactTaskProgress>