Struct Compactor

pub struct Compactor {
    context: CompactorContext,
    object_id_getter: Box<dyn GetObjectId>,
    task_config: TaskConfig,
    options: SstableBuilderOptions,
    get_id_time: Arc<AtomicU64>,
}

Implementation of Hummock compaction.

Fields

context: CompactorContext

The context of the compactor.

object_id_getter: Box<dyn GetObjectId>

task_config: TaskConfig

options: SstableBuilderOptions

get_id_time: Arc<AtomicU64>

Implementations

impl Compactor

pub fn new( context: CompactorContext, options: SstableBuilderOptions, task_config: TaskConfig, object_id_getter: Box<dyn GetObjectId>, ) -> Self

Create a new compactor.

async fn compact_key_range( &self, iter: impl HummockIterator<Direction = Forward>, compaction_filter: impl CompactionFilter, compaction_catalog_agent_ref: CompactionCatalogAgentRef, task_progress: Option<Arc<TaskProgress>>, task_id: Option<HummockCompactionTaskId>, split_index: Option<usize>, ) -> HummockResult<(Vec<LocalSstableInfo>, CompactionStatistics)>

Compact the given key range and merge iterator. Upon a successful return, the built SSTs are already uploaded to object store.

task_progress is only used for tasks on the compactor.

pub fn report_progress( metrics: Arc<CompactorMetrics>, task_progress: Option<Arc<TaskProgress>>, ssts: &Vec<LocalSstableInfo>, is_share_buffer_compact: bool, )

async fn compact_key_range_impl<F: SstableWriterFactory, B: FilterBuilder>( &self, writer_factory: F, iter: impl HummockIterator<Direction = Forward>, compaction_filter: impl CompactionFilter, compaction_catalog_agent_ref: CompactionCatalogAgentRef, task_progress: Option<Arc<TaskProgress>>, object_id_getter: Box<dyn GetObjectId>, ) -> HummockResult<(Vec<LocalSstableInfo>, CompactionStatistics)>