Struct WorkerNodeManager

pub struct WorkerNodeManager {
    inner: RwLock<WorkerNodeManagerInner>,
    worker_node_mask: Arc<RwLock<HashSet<u32>>>,
}

WorkerNodeManager manages live worker nodes and table vnode mapping information.

Fields

inner: RwLock<WorkerNodeManagerInner>

worker_node_mask: Arc<RwLock<HashSet<u32>>>

Temporarily make worker invisible from serving cluster.

Implementations

impl WorkerNodeManager

pub fn new() -> Self

pub fn mock(worker_nodes: Vec<WorkerNode>) -> Self

Used in tests.

pub fn list_worker_nodes(&self) -> Vec<WorkerNode>

fn list_serving_worker_nodes(&self) -> Vec<WorkerNode>

fn list_streaming_worker_nodes(&self) -> Vec<WorkerNode>

pub fn add_worker_node(&self, node: WorkerNode)

pub fn remove_worker_node(&self, node: WorkerNode)

pub fn refresh( &self, nodes: Vec<WorkerNode>, streaming_mapping: HashMap<u32, WorkerSlotMapping>, serving_mapping: HashMap<u32, WorkerSlotMapping>, )

pub fn get_workers_by_worker_slot_ids( &self, worker_slot_ids: &[WorkerSlotId], ) -> Result<Vec<WorkerNode>>

If worker slot ids is empty, the scheduler may fail to schedule any task and stuck at schedule next stage. If we do not return error in this case, needs more complex control logic above. Report in this function makes the schedule root fail reason more clear.

pub fn get_streaming_fragment_mapping( &self, fragment_id: &u32, ) -> Result<WorkerSlotMapping>

pub fn insert_streaming_fragment_mapping( &self, fragment_id: u32, vnode_mapping: WorkerSlotMapping, )

pub fn update_streaming_fragment_mapping( &self, fragment_id: u32, vnode_mapping: WorkerSlotMapping, )

pub fn remove_streaming_fragment_mapping(&self, fragment_id: &u32)

fn serving_fragment_mapping( &self, fragment_id: u32, ) -> Result<WorkerSlotMapping>

Returns fragment’s vnode mapping for serving.

pub fn set_serving_fragment_mapping( &self, mappings: HashMap<u32, WorkerSlotMapping>, )

pub fn upsert_serving_fragment_mapping( &self, mappings: HashMap<u32, WorkerSlotMapping>, )

pub fn remove_serving_fragment_mapping(&self, fragment_ids: &[u32])

fn worker_node_mask(&self) -> RwLockReadGuard<'_, HashSet<u32>>

pub fn mask_worker_node(&self, worker_node_id: u32, duration: Duration)

Trait Implementations

impl Default for WorkerNodeManager

fn default() -> Self

Returns the “default value” for a type.