Struct TableFragments

pub struct TableFragments {
    pub table_id: u32,
    pub state: i32,
    pub fragments: HashMap<u32, Fragment>,
    pub actor_status: HashMap<u32, ActorStatus>,
    pub actor_splits: HashMap<u32, ConnectorSplits>,
    pub ctx: Option<StreamContext>,
    pub parallelism: Option<TableParallelism>,
    pub max_parallelism: Option<u32>,
    pub node_label: String,
    pub backfill_done: bool,
}

Fragments of a Streaming Job. It’s for all kinds of streaming jobs, and ideally should be called StreamingJobFragments. It’s not the same as a storage table correlated with a TableCatalog.

Fields

table_id: u32

The id of the streaming job.

state: i32

fragments: HashMap<u32, Fragment>

actor_status: HashMap<u32, ActorStatus>

actor_splits: HashMap<u32, ConnectorSplits>

Source and SourceBackfill are handled together here.

ctx: Option<StreamContext>

parallelism: Option<TableParallelism>

max_parallelism: Option<u32>

The max parallelism specified when the streaming job was created, i.e., expected vnode count.

The reason for persisting this value is mainly to check if a parallelism change (via ALTER .. SET PARALLELISM) is valid, so that the behavior can be consistent with the creation of the streaming job.

Note that the actual vnode count, denoted by vnode_count in fragments, may be different from this value (see StreamFragmentGraph.max_parallelism for more details.). As a result, checking the parallelism change with this value can be inaccurate in some cases. However, when generating resizing plans, we still take the vnode_count of each fragment into account.

Can be unset if the fragment is created in older versions where variable vnode count is not supported, in which case a default value of 256 should be used.

node_label: String

Actors of a materialize view, sink, or table can only be scheduled on nodes with matching node_label.

backfill_done: bool

If this is a materialized view: True if backfill is done, else false. If this is a regular table: Always true.

Implementations

impl TableFragments

pub fn state(&self) -> State

Returns the enum value of state, or the default if the field is set to an invalid enum value.

pub fn set_state(&mut self, value: State)

Sets state to the provided enum value.

pub fn max_parallelism(&self) -> u32

Returns the value of max_parallelism, or the default value if max_parallelism is unset.

impl TableFragments

pub fn get_table_id(&self) -> u32

pub fn get_state(&self) -> Result<State, PbFieldNotFound>

pub fn get_fragments(&self) -> &HashMap<u32, Fragment>

pub fn get_actor_status(&self) -> &HashMap<u32, ActorStatus>

pub fn get_actor_splits(&self) -> &HashMap<u32, ConnectorSplits>

pub fn get_ctx(&self) -> Result<&StreamContext, PbFieldNotFound>

pub fn get_parallelism(&self) -> Result<&TableParallelism, PbFieldNotFound>

pub fn get_max_parallelism(&self) -> Result<&u32, PbFieldNotFound>

pub fn get_node_label(&self) -> &String

pub fn get_backfill_done(&self) -> bool

Trait Implementations

impl Clone for TableFragments

fn clone(&self) -> TableFragments

Returns a copy of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for TableFragments

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Default for TableFragments

fn default() -> Self

Returns the “default value” for a type.

impl<'de> Deserialize<'de> for TableFragments

fn deserialize<D>(deserializer: D) -> Result<Self, D::Error>

where D: Deserializer<'de>,

Deserialize this value from the given Serde deserializer.

impl Message for TableFragments

fn encoded_len(&self) -> usize

Returns the encoded length of the message without a length delimiter.

fn clear(&mut self)

Clears the message, resetting all fields to their default.

fn encode(&self, buf: &mut impl BufMut) -> Result<(), EncodeError>

where Self: Sized,

Encodes the message to a buffer.

fn encode_to_vec(&self) -> Vec<u8>

where Self: Sized,

Encodes the message to a newly allocated buffer.

fn encode_length_delimited( &self, buf: &mut impl BufMut, ) -> Result<(), EncodeError>

where Self: Sized,

Encodes the message with a length-delimiter to a buffer.

fn encode_length_delimited_to_vec(&self) -> Vec<u8>

where Self: Sized,

Encodes the message with a length-delimiter to a newly allocated buffer.

fn decode(buf: impl Buf) -> Result<Self, DecodeError>

where Self: Default,

Decodes an instance of the message from a buffer.

fn decode_length_delimited(buf: impl Buf) -> Result<Self, DecodeError>

where Self: Default,

Decodes a length-delimited instance of the message from the buffer.

fn merge(&mut self, buf: impl Buf) -> Result<(), DecodeError>

where Self: Sized,

Decodes an instance of the message from a buffer, and merges it into self.

fn merge_length_delimited(&mut self, buf: impl Buf) -> Result<(), DecodeError>

where Self: Sized,

Decodes a length-delimited instance of the message from buffer, and merges it into self.

impl PartialEq for TableFragments

fn eq(&self, other: &TableFragments) -> bool

Tests for self and other values to be equal, and is used by ==.

fn ne(&self, other: &Rhs) -> bool

Tests for !=. The default implementation is almost always sufficient, and should not be overridden without very good reason.

impl Serialize for TableFragments

fn serialize<S>(&self, serializer: S) -> Result<S::Ok, S::Error>

where S: Serializer,

Serialize this value into the given Serde serializer.

impl StructuralPartialEq for TableFragments