pub struct LogicalMultiJoin {
pub base: PlanBase<Logical>,
inputs: Vec<LogicalPlanRef>,
on: Condition,
output_indices: Vec<usize>,
inner2output: ColIndexMapping,
inner_o2i_mapping: Vec<(usize, usize)>,
inner_i2o_mappings: Vec<ColIndexMapping>,
}Expand description
LogicalMultiJoin combines two or more relations according to some condition.
Each output row has fields from one the inputs. The set of output rows is a subset
of the cartesian product of all the inputs; The LogicalMultiInnerJoin is only supported
for inner joins as it implicitly assumes commutativity. Non-inner joins should be
expressed as 2-way LogicalJoins.
Fields§
§base: PlanBase<Logical>§inputs: Vec<LogicalPlanRef>§on: Condition§output_indices: Vec<usize>§inner2output: ColIndexMapping§inner_o2i_mapping: Vec<(usize, usize)>the mapping output_col_idx -> (input_idx, input_col_idx), “output_col_idx” is internal,
not consider output_indices
inner_i2o_mappings: Vec<ColIndexMapping>Implementations§
Source§impl LogicalMultiJoin
impl LogicalMultiJoin
pub(crate) fn new( inputs: Vec<PlanRef>, on: Condition, output_indices: Vec<usize>, ) -> Self
fn derive_stream_key( inputs: &[PlanRef], inner_i2o_mappings: &[ColIndexMapping], inner2output: &ColIndexMapping, ) -> Option<Vec<usize>>
Sourcepub fn clone_with_cond(&self, cond: Condition) -> Self
pub fn clone_with_cond(&self, cond: Condition) -> Self
Clone with new on condition
Source§impl LogicalMultiJoin
impl LogicalMultiJoin
pub fn as_reordered_left_deep_join(&self, join_ordering: &[usize]) -> PlanRef
Sourcepub(crate) fn heuristic_ordering(&self) -> Result<Vec<usize>>
pub(crate) fn heuristic_ordering(&self) -> Result<Vec<usize>>
Our heuristic join reordering algorithm will try to perform a left-deep join. It will try to do the following:
-
First, split the join graph, with eq join conditions as graph edges, into their connected components. Repeat the procedure in 2. with the largest connected components down to the smallest.
-
For each connected component, add joins to the chain, prioritizing adding those joins to the bottom of the chain if their join conditions have:
a. eq joins between primary keys on both sides b. eq joins with primary keys on one side c. more equijoin conditions
in that order. This forms our selectivity heuristic.
-
Thirdly, we will emit a left-deep cross-join of each of the left-deep joins of the connected components. Depending on the type of plan, this may result in a planner failure (e.g. for streaming). No cross-join will be emitted for a single connected component.
-
Finally, we will emit, above the left-deep join tree: a. a filter with the non eq conditions b. a projection which reorders the output column ordering to agree with the original ordering of the joins. The filter will then be pushed down by another filter pushdown pass.
Sourcepub fn as_bushy_tree_join(&self) -> Result<PlanRef>
pub fn as_bushy_tree_join(&self) -> Result<PlanRef>
transform multijoin into bushy tree join.
- First, use equivalent condition derivation to get derive join relation.
- Second, for every isolated node will create connection to every other nodes.
- Third, select and merge one node for a iteration, and use a bfs policy for which node the selected node merged with. i. The select node mentioned above is the node with least number of relations and the lowest join tree. ii. nodes with a join tree higher than the temporal optimal join tree will be pruned.
pub(crate) fn input_col_nums(&self) -> Vec<usize>
Sourcefn get_join_graph(&self) -> Result<(BTreeMap<usize, GraphNode>, Condition)>
fn get_join_graph(&self) -> Result<(BTreeMap<usize, GraphNode>, Condition)>
get join graph from self.on, return the join graph and the new join condition.
Sourcefn eq_condition_derivation(&self, condition: Condition) -> Result<Condition>
fn eq_condition_derivation(&self, condition: Condition) -> Result<Condition>
equivalent condition derivation by a = b && a = c ==> b = c
Sourcefn create_logical_join(
&self,
join_tree: JoinTreeNode,
join_ordering: &mut Vec<usize>,
) -> Result<PlanRef>
fn create_logical_join( &self, join_tree: JoinTreeNode, join_ordering: &mut Vec<usize>, ) -> Result<PlanRef>
create logical plan by recursively travase JoinTreeNode
Methods from Deref<Target = PlanBase<Logical>>§
pub fn clone_with_new_plan_id(&self) -> Self
Sourcepub fn clone_with_new_distribution(&self, dist: Distribution) -> Self
pub fn clone_with_new_distribution(&self, dist: Distribution) -> Self
Clone the plan node with a new distribution.
Panics if the plan node is not physical.
Trait Implementations§
Source§impl Clone for LogicalMultiJoin
impl Clone for LogicalMultiJoin
Source§fn clone(&self) -> LogicalMultiJoin
fn clone(&self) -> LogicalMultiJoin
1.0.0 · Source§fn clone_from(&mut self, source: &Self)
fn clone_from(&mut self, source: &Self)
source. Read moreSource§impl ColPrunable for LogicalMultiJoin
impl ColPrunable for LogicalMultiJoin
Source§impl Debug for LogicalMultiJoin
impl Debug for LogicalMultiJoin
Source§impl Deref for LogicalMultiJoin
impl Deref for LogicalMultiJoin
Source§impl Distill for LogicalMultiJoin
impl Distill for LogicalMultiJoin
Source§impl ExprRewritable<Logical> for LogicalMultiJoin
impl ExprRewritable<Logical> for LogicalMultiJoin
fn rewrite_exprs(&self, _r: &mut dyn ExprRewriter) -> PlanRef
fn has_rewritable_expr(&self) -> bool
Source§impl ExprVisitable for LogicalMultiJoin
impl ExprVisitable for LogicalMultiJoin
fn visit_exprs(&self, _v: &mut dyn ExprVisitor)
Source§impl Hash for LogicalMultiJoin
impl Hash for LogicalMultiJoin
Source§impl PartialEq for LogicalMultiJoin
impl PartialEq for LogicalMultiJoin
Source§impl PlanNodeMeta for LogicalMultiJoin
impl PlanNodeMeta for LogicalMultiJoin
Source§impl PlanTreeNode<Logical> for LogicalMultiJoin
impl PlanTreeNode<Logical> for LogicalMultiJoin
Source§impl PredicatePushdown for LogicalMultiJoin
impl PredicatePushdown for LogicalMultiJoin
Source§fn predicate_pushdown(
&self,
_predicate: Condition,
_ctx: &mut PredicatePushdownContext,
) -> PlanRef
fn predicate_pushdown( &self, _predicate: Condition, _ctx: &mut PredicatePushdownContext, ) -> PlanRef
Source§impl ToBatch for LogicalMultiJoin
impl ToBatch for LogicalMultiJoin
Source§fn to_batch(&self) -> Result<BatchPlanRef>
fn to_batch(&self) -> Result<BatchPlanRef>
to_batch is equivalent to to_batch_with_order_required(&Order::any())Source§fn to_batch_with_order_required(
&self,
required_order: &Order,
) -> Result<BatchPlanRef>
fn to_batch_with_order_required( &self, required_order: &Order, ) -> Result<BatchPlanRef>
Source§impl ToStream for LogicalMultiJoin
impl ToStream for LogicalMultiJoin
Source§fn logical_rewrite_for_stream(
&self,
_ctx: &mut RewriteStreamContext,
) -> Result<(PlanRef, ColIndexMapping)>
fn logical_rewrite_for_stream( &self, _ctx: &mut RewriteStreamContext, ) -> Result<(PlanRef, ColIndexMapping)>
logical_rewrite_for_stream will rewrite the logical node, and return (new_plan_node,
col_mapping), the col_mapping is for original columns have been changed into some other
position. Read moreSource§fn to_stream(&self, _ctx: &mut ToStreamContext) -> Result<StreamPlanRef>
fn to_stream(&self, _ctx: &mut ToStreamContext) -> Result<StreamPlanRef>
to_stream is equivalent to to_stream_with_dist_required(RequiredDist::Any)Source§fn to_stream_with_dist_required(
&self,
required_dist: &RequiredDist,
ctx: &mut ToStreamContext,
) -> Result<StreamPlanRef>
fn to_stream_with_dist_required( &self, required_dist: &RequiredDist, ctx: &mut ToStreamContext, ) -> Result<StreamPlanRef>
fn try_better_locality(&self, _columns: &[usize]) -> Option<LogicalPlanRef>
impl Eq for LogicalMultiJoin
impl LogicalPlanNode for LogicalMultiJoin
impl StructuralPartialEq for LogicalMultiJoin
Auto Trait Implementations§
impl Freeze for LogicalMultiJoin
impl !RefUnwindSafe for LogicalMultiJoin
impl !Send for LogicalMultiJoin
impl !Sync for LogicalMultiJoin
impl Unpin for LogicalMultiJoin
impl !UnwindSafe for LogicalMultiJoin
Blanket Implementations§
Source§impl<P> AnyPlanNodeMeta<<P as PlanNodeMeta>::Convention> for Pwhere
P: PlanNodeMeta,
impl<P> AnyPlanNodeMeta<<P as PlanNodeMeta>::Convention> for Pwhere
P: PlanNodeMeta,
fn node_type( &self, ) -> <<P as PlanNodeMeta>::Convention as ConventionMarker>::PlanNodeType
fn plan_base(&self) -> &PlanBase<<P as PlanNodeMeta>::Convention>
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Source§impl<T> CloneToUninit for Twhere
T: Clone,
impl<T> CloneToUninit for Twhere
T: Clone,
§impl<T> Conv for T
impl<T> Conv for T
§impl<T> Downcast for Twhere
T: Any,
impl<T> Downcast for Twhere
T: Any,
§fn into_any(self: Box<T>) -> Box<dyn Any>
fn into_any(self: Box<T>) -> Box<dyn Any>
Box<dyn Trait> (where Trait: Downcast) to Box<dyn Any>, which can then be
downcast into Box<dyn ConcreteType> where ConcreteType implements Trait.§fn into_any_rc(self: Rc<T>) -> Rc<dyn Any>
fn into_any_rc(self: Rc<T>) -> Rc<dyn Any>
Rc<Trait> (where Trait: Downcast) to Rc<Any>, which can then be further
downcast into Rc<ConcreteType> where ConcreteType implements Trait.§fn as_any(&self) -> &(dyn Any + 'static)
fn as_any(&self) -> &(dyn Any + 'static)
&Trait (where Trait: Downcast) to &Any. This is needed since Rust cannot
generate &Any’s vtable from &Trait’s.§fn as_any_mut(&mut self) -> &mut (dyn Any + 'static)
fn as_any_mut(&mut self) -> &mut (dyn Any + 'static)
&mut Trait (where Trait: Downcast) to &Any. This is needed since Rust cannot
generate &mut Any’s vtable from &mut Trait’s.§impl<Q, K> Equivalent<K> for Q
impl<Q, K> Equivalent<K> for Q
§fn equivalent(&self, key: &K) -> bool
fn equivalent(&self, key: &K) -> bool
key and return true if they are equal.Source§impl<Q, K> Equivalent<K> for Q
impl<Q, K> Equivalent<K> for Q
Source§fn equivalent(&self, key: &K) -> bool
fn equivalent(&self, key: &K) -> bool
key and return true if they are equal.§impl<Q, K> Equivalent<K> for Q
impl<Q, K> Equivalent<K> for Q
§fn equivalent(&self, key: &K) -> bool
fn equivalent(&self, key: &K) -> bool
§impl<T> FmtForward for T
impl<T> FmtForward for T
§fn fmt_binary(self) -> FmtBinary<Self>where
Self: Binary,
fn fmt_binary(self) -> FmtBinary<Self>where
Self: Binary,
self to use its Binary implementation when Debug-formatted.§fn fmt_display(self) -> FmtDisplay<Self>where
Self: Display,
fn fmt_display(self) -> FmtDisplay<Self>where
Self: Display,
self to use its Display implementation when
Debug-formatted.§fn fmt_lower_exp(self) -> FmtLowerExp<Self>where
Self: LowerExp,
fn fmt_lower_exp(self) -> FmtLowerExp<Self>where
Self: LowerExp,
self to use its LowerExp implementation when
Debug-formatted.§fn fmt_lower_hex(self) -> FmtLowerHex<Self>where
Self: LowerHex,
fn fmt_lower_hex(self) -> FmtLowerHex<Self>where
Self: LowerHex,
self to use its LowerHex implementation when
Debug-formatted.§fn fmt_octal(self) -> FmtOctal<Self>where
Self: Octal,
fn fmt_octal(self) -> FmtOctal<Self>where
Self: Octal,
self to use its Octal implementation when Debug-formatted.§fn fmt_pointer(self) -> FmtPointer<Self>where
Self: Pointer,
fn fmt_pointer(self) -> FmtPointer<Self>where
Self: Pointer,
self to use its Pointer implementation when
Debug-formatted.§fn fmt_upper_exp(self) -> FmtUpperExp<Self>where
Self: UpperExp,
fn fmt_upper_exp(self) -> FmtUpperExp<Self>where
Self: UpperExp,
self to use its UpperExp implementation when
Debug-formatted.§fn fmt_upper_hex(self) -> FmtUpperHex<Self>where
Self: UpperHex,
fn fmt_upper_hex(self) -> FmtUpperHex<Self>where
Self: UpperHex,
self to use its UpperHex implementation when
Debug-formatted.§fn fmt_list(self) -> FmtList<Self>where
&'a Self: for<'a> IntoIterator,
fn fmt_list(self) -> FmtList<Self>where
&'a Self: for<'a> IntoIterator,
§impl<T> FutureExt for T
impl<T> FutureExt for T
§fn with_context(self, otel_cx: Context) -> WithContext<Self>
fn with_context(self, otel_cx: Context) -> WithContext<Self>
§fn with_current_context(self) -> WithContext<Self>
fn with_current_context(self) -> WithContext<Self>
§impl<T> Instrument for T
impl<T> Instrument for T
§fn instrument(self, span: Span) -> Instrumented<Self>
fn instrument(self, span: Span) -> Instrumented<Self>
§fn in_current_span(self) -> Instrumented<Self>
fn in_current_span(self) -> Instrumented<Self>
Source§impl<T> Instrument for T
impl<T> Instrument for T
Source§fn instrument(self, span: Span) -> Instrumented<Self>
fn instrument(self, span: Span) -> Instrumented<Self>
Source§fn in_current_span(self) -> Instrumented<Self>
fn in_current_span(self) -> Instrumented<Self>
Source§impl<T> IntoEither for T
impl<T> IntoEither for T
Source§fn into_either(self, into_left: bool) -> Either<Self, Self>
fn into_either(self, into_left: bool) -> Either<Self, Self>
self into a Left variant of Either<Self, Self>
if into_left is true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read moreSource§fn into_either_with<F>(self, into_left: F) -> Either<Self, Self>
fn into_either_with<F>(self, into_left: F) -> Either<Self, Self>
self into a Left variant of Either<Self, Self>
if into_left(&self) returns true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read moreSource§impl<T> IntoRequest<T> for T
impl<T> IntoRequest<T> for T
Source§fn into_request(self) -> Request<T>
fn into_request(self) -> Request<T>
T in a tonic::Request§impl<T> IntoResult<T> for T
impl<T> IntoResult<T> for T
type Err = Infallible
fn into_result(self) -> Result<T, <T as IntoResult<T>>::Err>
§impl<M> MetricVecRelabelExt for M
impl<M> MetricVecRelabelExt for M
§fn relabel(
self,
metric_level: MetricLevel,
relabel_threshold: MetricLevel,
) -> RelabeledMetricVec<M>
fn relabel( self, metric_level: MetricLevel, relabel_threshold: MetricLevel, ) -> RelabeledMetricVec<M>
RelabeledMetricVec::with_metric_level].§fn relabel_n(
self,
metric_level: MetricLevel,
relabel_threshold: MetricLevel,
relabel_num: usize,
) -> RelabeledMetricVec<M>
fn relabel_n( self, metric_level: MetricLevel, relabel_threshold: MetricLevel, relabel_num: usize, ) -> RelabeledMetricVec<M>
RelabeledMetricVec::with_metric_level_relabel_n].§fn relabel_debug_1(
self,
relabel_threshold: MetricLevel,
) -> RelabeledMetricVec<M>
fn relabel_debug_1( self, relabel_threshold: MetricLevel, ) -> RelabeledMetricVec<M>
RelabeledMetricVec::with_metric_level_relabel_n] with metric_level set to
MetricLevel::Debug and relabel_num set to 1.§impl<T> Pipe for Twhere
T: ?Sized,
impl<T> Pipe for Twhere
T: ?Sized,
§fn pipe<R>(self, func: impl FnOnce(Self) -> R) -> Rwhere
Self: Sized,
fn pipe<R>(self, func: impl FnOnce(Self) -> R) -> Rwhere
Self: Sized,
§fn pipe_ref<'a, R>(&'a self, func: impl FnOnce(&'a Self) -> R) -> Rwhere
R: 'a,
fn pipe_ref<'a, R>(&'a self, func: impl FnOnce(&'a Self) -> R) -> Rwhere
R: 'a,
self and passes that borrow into the pipe function. Read more§fn pipe_ref_mut<'a, R>(&'a mut self, func: impl FnOnce(&'a mut Self) -> R) -> Rwhere
R: 'a,
fn pipe_ref_mut<'a, R>(&'a mut self, func: impl FnOnce(&'a mut Self) -> R) -> Rwhere
R: 'a,
self and passes that borrow into the pipe function. Read more§fn pipe_borrow<'a, B, R>(&'a self, func: impl FnOnce(&'a B) -> R) -> R
fn pipe_borrow<'a, B, R>(&'a self, func: impl FnOnce(&'a B) -> R) -> R
§fn pipe_borrow_mut<'a, B, R>(
&'a mut self,
func: impl FnOnce(&'a mut B) -> R,
) -> R
fn pipe_borrow_mut<'a, B, R>( &'a mut self, func: impl FnOnce(&'a mut B) -> R, ) -> R
§fn pipe_as_ref<'a, U, R>(&'a self, func: impl FnOnce(&'a U) -> R) -> R
fn pipe_as_ref<'a, U, R>(&'a self, func: impl FnOnce(&'a U) -> R) -> R
self, then passes self.as_ref() into the pipe function.§fn pipe_as_mut<'a, U, R>(&'a mut self, func: impl FnOnce(&'a mut U) -> R) -> R
fn pipe_as_mut<'a, U, R>(&'a mut self, func: impl FnOnce(&'a mut U) -> R) -> R
self, then passes self.as_mut() into the pipe
function.§fn pipe_deref<'a, T, R>(&'a self, func: impl FnOnce(&'a T) -> R) -> R
fn pipe_deref<'a, T, R>(&'a self, func: impl FnOnce(&'a T) -> R) -> R
self, then passes self.deref() into the pipe function.§impl<T> Pointable for T
impl<T> Pointable for T
§impl<T> SameOrElseExt for Twhere
T: Eq,
impl<T> SameOrElseExt for Twhere
T: Eq,
§fn same_or_else(self, other: T, f: impl FnOnce() -> T) -> T
fn same_or_else(self, other: T, f: impl FnOnce() -> T) -> T
self and other are equal, if so, return self, otherwise return the result of f().§impl<T> Scope for T
impl<T> Scope for T
§impl<T> Tap for T
impl<T> Tap for T
§fn tap_borrow<B>(self, func: impl FnOnce(&B)) -> Self
fn tap_borrow<B>(self, func: impl FnOnce(&B)) -> Self
Borrow<B> of a value. Read more§fn tap_borrow_mut<B>(self, func: impl FnOnce(&mut B)) -> Self
fn tap_borrow_mut<B>(self, func: impl FnOnce(&mut B)) -> Self
BorrowMut<B> of a value. Read more§fn tap_ref<R>(self, func: impl FnOnce(&R)) -> Self
fn tap_ref<R>(self, func: impl FnOnce(&R)) -> Self
AsRef<R> view of a value. Read more§fn tap_ref_mut<R>(self, func: impl FnOnce(&mut R)) -> Self
fn tap_ref_mut<R>(self, func: impl FnOnce(&mut R)) -> Self
AsMut<R> view of a value. Read more§fn tap_deref<T>(self, func: impl FnOnce(&T)) -> Self
fn tap_deref<T>(self, func: impl FnOnce(&T)) -> Self
Deref::Target of a value. Read more§fn tap_deref_mut<T>(self, func: impl FnOnce(&mut T)) -> Self
fn tap_deref_mut<T>(self, func: impl FnOnce(&mut T)) -> Self
Deref::Target of a value. Read more§fn tap_dbg(self, func: impl FnOnce(&Self)) -> Self
fn tap_dbg(self, func: impl FnOnce(&Self)) -> Self
.tap() only in debug builds, and is erased in release builds.§fn tap_mut_dbg(self, func: impl FnOnce(&mut Self)) -> Self
fn tap_mut_dbg(self, func: impl FnOnce(&mut Self)) -> Self
.tap_mut() only in debug builds, and is erased in release
builds.§fn tap_borrow_dbg<B>(self, func: impl FnOnce(&B)) -> Self
fn tap_borrow_dbg<B>(self, func: impl FnOnce(&B)) -> Self
.tap_borrow() only in debug builds, and is erased in release
builds.§fn tap_borrow_mut_dbg<B>(self, func: impl FnOnce(&mut B)) -> Self
fn tap_borrow_mut_dbg<B>(self, func: impl FnOnce(&mut B)) -> Self
.tap_borrow_mut() only in debug builds, and is erased in release
builds.§fn tap_ref_dbg<R>(self, func: impl FnOnce(&R)) -> Self
fn tap_ref_dbg<R>(self, func: impl FnOnce(&R)) -> Self
.tap_ref() only in debug builds, and is erased in release
builds.§fn tap_ref_mut_dbg<R>(self, func: impl FnOnce(&mut R)) -> Self
fn tap_ref_mut_dbg<R>(self, func: impl FnOnce(&mut R)) -> Self
.tap_ref_mut() only in debug builds, and is erased in release
builds.§fn tap_deref_dbg<T>(self, func: impl FnOnce(&T)) -> Self
fn tap_deref_dbg<T>(self, func: impl FnOnce(&T)) -> Self
.tap_deref() only in debug builds, and is erased in release
builds.