pub struct LogicalAgg {
pub base: PlanBase<Logical>,
core: Agg<LogicalPlanRef>,
}Expand description
LogicalAgg groups input data by their group key and computes aggregation functions.
It corresponds to the GROUP BY operator in a SQL query statement together with the aggregate
functions in the SELECT clause.
The output schema will first include the group key and then the aggregation calls.
Fields§
§base: PlanBase<Logical>§core: Agg<LogicalPlanRef>Implementations§
Source§impl LogicalAgg
impl LogicalAgg
Sourcefn gen_stateless_two_phase_streaming_agg_plan(
&self,
stream_input: StreamPlanRef,
) -> Result<StreamPlanRef>
fn gen_stateless_two_phase_streaming_agg_plan( &self, stream_input: StreamPlanRef, ) -> Result<StreamPlanRef>
Generate plan for stateless 2-phase streaming agg. Should only be used iff input is distributed. Input must be converted to stream form.
Sourcefn gen_vnode_two_phase_streaming_agg_plan(
&self,
stream_input: StreamPlanRef,
dist_key: &[usize],
) -> Result<StreamPlanRef>
fn gen_vnode_two_phase_streaming_agg_plan( &self, stream_input: StreamPlanRef, dist_key: &[usize], ) -> Result<StreamPlanRef>
Generate plan for stateless/stateful 2-phase streaming agg. Should only be used iff input is distributed. Input must be converted to stream form.
fn gen_single_plan(&self, stream_input: StreamPlanRef) -> Result<StreamPlanRef>
fn gen_shuffle_plan(&self, stream_input: StreamPlanRef) -> Result<StreamPlanRef>
Sourcefn gen_dist_stream_agg_plan(
&self,
stream_input: StreamPlanRef,
) -> Result<StreamPlanRef>
fn gen_dist_stream_agg_plan( &self, stream_input: StreamPlanRef, ) -> Result<StreamPlanRef>
Generates distributed stream plan.
Sourcefn prepare_approx_percentile(
&self,
stream_input: StreamPlanRef,
) -> Result<(ColIndexMapping, ColIndexMapping, Option<StreamPlanRef>, Agg<StreamPlanRef>)>
fn prepare_approx_percentile( &self, stream_input: StreamPlanRef, ) -> Result<(ColIndexMapping, ColIndexMapping, Option<StreamPlanRef>, Agg<StreamPlanRef>)>
Prepares metadata and the approx_percentile plan, if there’s one present.
It may modify core.agg_calls to separate normal agg and approx percentile agg,
and core.input to share the input via StreamShare,
to both approx percentile agg and normal agg.
fn need_row_merge(approx_percentile: &Option<StreamPlanRef>) -> bool
Sourcefn add_row_merge_if_needed(
approx_percentile: Option<StreamPlanRef>,
global_agg: StreamPlanRef,
approx_percentile_col_mapping: ColIndexMapping,
non_approx_percentile_col_mapping: ColIndexMapping,
) -> Result<StreamPlanRef>
fn add_row_merge_if_needed( approx_percentile: Option<StreamPlanRef>, global_agg: StreamPlanRef, approx_percentile_col_mapping: ColIndexMapping, non_approx_percentile_col_mapping: ColIndexMapping, ) -> Result<StreamPlanRef>
Add RowMerge if needed
fn separate_normal_and_special_agg(&self) -> SeparatedAggInfo
fn build_approx_percentile_agg( &self, input: StreamPlanRef, approx_percentile_agg_call: &PlanAggCall, ) -> Result<StreamPlanRef>
Sourcefn build_approx_percentile_aggs(
&self,
input: StreamPlanRef,
approx_percentile_agg_call: &[PlanAggCall],
) -> Result<Option<StreamPlanRef>>
fn build_approx_percentile_aggs( &self, input: StreamPlanRef, approx_percentile_agg_call: &[PlanAggCall], ) -> Result<Option<StreamPlanRef>>
If only 1 approx percentile, just return it.
Otherwise build a tree of approx percentile with MergeProject.
e.g.
ApproxPercentile(col1, 0.5) as x,
ApproxPercentile(col2, 0.5) as y,
ApproxPercentile(col3, 0.5) as z
will be built as
MergeProject
/
MergeProject z
/
x y
pub fn core(&self) -> &Agg<PlanRef>
Source§impl LogicalAgg
impl LogicalAgg
Sourcepub fn i2o_col_mapping(&self) -> ColIndexMapping
pub fn i2o_col_mapping(&self) -> ColIndexMapping
get the Mapping of columnIndex from input column index to out column index
Sourcepub fn create(
select_exprs: Vec<ExprImpl>,
group_by: GroupBy,
having: Option<ExprImpl>,
input: PlanRef,
) -> Result<(PlanRef, Vec<ExprImpl>, Option<ExprImpl>)>
pub fn create( select_exprs: Vec<ExprImpl>, group_by: GroupBy, having: Option<ExprImpl>, input: PlanRef, ) -> Result<(PlanRef, Vec<ExprImpl>, Option<ExprImpl>)>
create will analyze select exprs, group exprs and having, and construct a plan like
LogicalAgg -> LogicalProject -> inputIt also returns the rewritten select exprs and having that reference into the aggregated results.
Sourcepub fn agg_calls(&self) -> &Vec<PlanAggCall>
pub fn agg_calls(&self) -> &Vec<PlanAggCall>
Get a reference to the logical agg’s agg calls.
pub fn grouping_sets(&self) -> &Vec<IndexSet>
pub fn decompose( self, ) -> (Vec<PlanAggCall>, IndexSet, Vec<IndexSet>, PlanRef, bool)
pub fn rewrite_with_input_agg( &self, input: PlanRef, agg_calls: &[PlanAggCall], input_col_change: ColIndexMapping, ) -> (Self, ColIndexMapping)
Methods from Deref<Target = PlanBase<Logical>>§
pub fn clone_with_new_plan_id(&self) -> Self
Sourcepub fn clone_with_new_distribution(&self, dist: Distribution) -> Self
pub fn clone_with_new_distribution(&self, dist: Distribution) -> Self
Clone the plan node with a new distribution.
Panics if the plan node is not physical.
Trait Implementations§
Source§impl Clone for LogicalAgg
impl Clone for LogicalAgg
Source§fn clone(&self) -> LogicalAgg
fn clone(&self) -> LogicalAgg
1.0.0 · Source§fn clone_from(&mut self, source: &Self)
fn clone_from(&mut self, source: &Self)
source. Read moreSource§impl ColPrunable for LogicalAgg
impl ColPrunable for LogicalAgg
Source§impl Debug for LogicalAgg
impl Debug for LogicalAgg
Source§impl Deref for LogicalAgg
impl Deref for LogicalAgg
Source§impl Distill for LogicalAgg
impl Distill for LogicalAgg
Source§impl ExprRewritable<Logical> for LogicalAgg
impl ExprRewritable<Logical> for LogicalAgg
fn has_rewritable_expr(&self) -> bool
fn rewrite_exprs(&self, r: &mut dyn ExprRewriter) -> PlanRef
Source§impl ExprVisitable for LogicalAgg
impl ExprVisitable for LogicalAgg
fn visit_exprs(&self, v: &mut dyn ExprVisitor)
Source§impl Hash for LogicalAgg
impl Hash for LogicalAgg
Source§impl PartialEq for LogicalAgg
impl PartialEq for LogicalAgg
Source§impl PlanNodeMeta for LogicalAgg
impl PlanNodeMeta for LogicalAgg
Source§impl PlanTreeNode<Logical> for LogicalAgg
impl PlanTreeNode<Logical> for LogicalAgg
Source§impl PlanTreeNodeUnary<Logical> for LogicalAgg
impl PlanTreeNodeUnary<Logical> for LogicalAgg
fn input(&self) -> PlanRef
fn clone_with_input(&self, input: PlanRef) -> Self
Source§fn rewrite_with_input(
&self,
input: PlanRef,
input_col_change: ColIndexMapping,
) -> (Self, ColIndexMapping)
fn rewrite_with_input( &self, input: PlanRef, input_col_change: ColIndexMapping, ) -> (Self, ColIndexMapping)
Source§impl PredicatePushdown for LogicalAgg
impl PredicatePushdown for LogicalAgg
Source§fn predicate_pushdown(
&self,
predicate: Condition,
ctx: &mut PredicatePushdownContext,
) -> PlanRef
fn predicate_pushdown( &self, predicate: Condition, ctx: &mut PredicatePushdownContext, ) -> PlanRef
Source§impl ToBatch for LogicalAgg
impl ToBatch for LogicalAgg
Source§fn to_batch(&self) -> Result<BatchPlanRef>
fn to_batch(&self) -> Result<BatchPlanRef>
to_batch is equivalent to to_batch_with_order_required(&Order::any())Source§fn to_batch_with_order_required(
&self,
required_order: &Order,
) -> Result<BatchPlanRef>
fn to_batch_with_order_required( &self, required_order: &Order, ) -> Result<BatchPlanRef>
Source§impl ToStream for LogicalAgg
impl ToStream for LogicalAgg
Source§fn to_stream(&self, ctx: &mut ToStreamContext) -> Result<StreamPlanRef>
fn to_stream(&self, ctx: &mut ToStreamContext) -> Result<StreamPlanRef>
to_stream is equivalent to to_stream_with_dist_required(RequiredDist::Any)Source§fn logical_rewrite_for_stream(
&self,
ctx: &mut RewriteStreamContext,
) -> Result<(PlanRef, ColIndexMapping)>
fn logical_rewrite_for_stream( &self, ctx: &mut RewriteStreamContext, ) -> Result<(PlanRef, ColIndexMapping)>
logical_rewrite_for_stream will rewrite the logical node, and return (new_plan_node,
col_mapping), the col_mapping is for original columns have been changed into some other
position. Read moreSource§fn to_stream_with_dist_required(
&self,
required_dist: &RequiredDist,
ctx: &mut ToStreamContext,
) -> Result<StreamPlanRef>
fn to_stream_with_dist_required( &self, required_dist: &RequiredDist, ctx: &mut ToStreamContext, ) -> Result<StreamPlanRef>
fn try_better_locality(&self, _columns: &[usize]) -> Option<LogicalPlanRef>
impl Eq for LogicalAgg
impl LogicalPlanNode for LogicalAgg
impl StructuralPartialEq for LogicalAgg
Auto Trait Implementations§
impl Freeze for LogicalAgg
impl !RefUnwindSafe for LogicalAgg
impl !Send for LogicalAgg
impl !Sync for LogicalAgg
impl Unpin for LogicalAgg
impl !UnwindSafe for LogicalAgg
Blanket Implementations§
Source§impl<P> AnyPlanNodeMeta<<P as PlanNodeMeta>::Convention> for Pwhere
P: PlanNodeMeta,
impl<P> AnyPlanNodeMeta<<P as PlanNodeMeta>::Convention> for Pwhere
P: PlanNodeMeta,
fn node_type( &self, ) -> <<P as PlanNodeMeta>::Convention as ConventionMarker>::PlanNodeType
fn plan_base(&self) -> &PlanBase<<P as PlanNodeMeta>::Convention>
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Source§impl<T> CloneToUninit for Twhere
T: Clone,
impl<T> CloneToUninit for Twhere
T: Clone,
§impl<T> Conv for T
impl<T> Conv for T
§impl<T> Downcast for Twhere
T: Any,
impl<T> Downcast for Twhere
T: Any,
§fn into_any(self: Box<T>) -> Box<dyn Any>
fn into_any(self: Box<T>) -> Box<dyn Any>
Box<dyn Trait> (where Trait: Downcast) to Box<dyn Any>, which can then be
downcast into Box<dyn ConcreteType> where ConcreteType implements Trait.§fn into_any_rc(self: Rc<T>) -> Rc<dyn Any>
fn into_any_rc(self: Rc<T>) -> Rc<dyn Any>
Rc<Trait> (where Trait: Downcast) to Rc<Any>, which can then be further
downcast into Rc<ConcreteType> where ConcreteType implements Trait.§fn as_any(&self) -> &(dyn Any + 'static)
fn as_any(&self) -> &(dyn Any + 'static)
&Trait (where Trait: Downcast) to &Any. This is needed since Rust cannot
generate &Any’s vtable from &Trait’s.§fn as_any_mut(&mut self) -> &mut (dyn Any + 'static)
fn as_any_mut(&mut self) -> &mut (dyn Any + 'static)
&mut Trait (where Trait: Downcast) to &Any. This is needed since Rust cannot
generate &mut Any’s vtable from &mut Trait’s.§impl<Q, K> Equivalent<K> for Q
impl<Q, K> Equivalent<K> for Q
§fn equivalent(&self, key: &K) -> bool
fn equivalent(&self, key: &K) -> bool
key and return true if they are equal.Source§impl<Q, K> Equivalent<K> for Q
impl<Q, K> Equivalent<K> for Q
Source§fn equivalent(&self, key: &K) -> bool
fn equivalent(&self, key: &K) -> bool
key and return true if they are equal.§impl<Q, K> Equivalent<K> for Q
impl<Q, K> Equivalent<K> for Q
§fn equivalent(&self, key: &K) -> bool
fn equivalent(&self, key: &K) -> bool
§impl<T> FmtForward for T
impl<T> FmtForward for T
§fn fmt_binary(self) -> FmtBinary<Self>where
Self: Binary,
fn fmt_binary(self) -> FmtBinary<Self>where
Self: Binary,
self to use its Binary implementation when Debug-formatted.§fn fmt_display(self) -> FmtDisplay<Self>where
Self: Display,
fn fmt_display(self) -> FmtDisplay<Self>where
Self: Display,
self to use its Display implementation when
Debug-formatted.§fn fmt_lower_exp(self) -> FmtLowerExp<Self>where
Self: LowerExp,
fn fmt_lower_exp(self) -> FmtLowerExp<Self>where
Self: LowerExp,
self to use its LowerExp implementation when
Debug-formatted.§fn fmt_lower_hex(self) -> FmtLowerHex<Self>where
Self: LowerHex,
fn fmt_lower_hex(self) -> FmtLowerHex<Self>where
Self: LowerHex,
self to use its LowerHex implementation when
Debug-formatted.§fn fmt_octal(self) -> FmtOctal<Self>where
Self: Octal,
fn fmt_octal(self) -> FmtOctal<Self>where
Self: Octal,
self to use its Octal implementation when Debug-formatted.§fn fmt_pointer(self) -> FmtPointer<Self>where
Self: Pointer,
fn fmt_pointer(self) -> FmtPointer<Self>where
Self: Pointer,
self to use its Pointer implementation when
Debug-formatted.§fn fmt_upper_exp(self) -> FmtUpperExp<Self>where
Self: UpperExp,
fn fmt_upper_exp(self) -> FmtUpperExp<Self>where
Self: UpperExp,
self to use its UpperExp implementation when
Debug-formatted.§fn fmt_upper_hex(self) -> FmtUpperHex<Self>where
Self: UpperHex,
fn fmt_upper_hex(self) -> FmtUpperHex<Self>where
Self: UpperHex,
self to use its UpperHex implementation when
Debug-formatted.§fn fmt_list(self) -> FmtList<Self>where
&'a Self: for<'a> IntoIterator,
fn fmt_list(self) -> FmtList<Self>where
&'a Self: for<'a> IntoIterator,
§impl<T> FutureExt for T
impl<T> FutureExt for T
§fn with_context(self, otel_cx: Context) -> WithContext<Self>
fn with_context(self, otel_cx: Context) -> WithContext<Self>
§fn with_current_context(self) -> WithContext<Self>
fn with_current_context(self) -> WithContext<Self>
§impl<T> Instrument for T
impl<T> Instrument for T
§fn instrument(self, span: Span) -> Instrumented<Self>
fn instrument(self, span: Span) -> Instrumented<Self>
§fn in_current_span(self) -> Instrumented<Self>
fn in_current_span(self) -> Instrumented<Self>
Source§impl<T> Instrument for T
impl<T> Instrument for T
Source§fn instrument(self, span: Span) -> Instrumented<Self>
fn instrument(self, span: Span) -> Instrumented<Self>
Source§fn in_current_span(self) -> Instrumented<Self>
fn in_current_span(self) -> Instrumented<Self>
Source§impl<T> IntoEither for T
impl<T> IntoEither for T
Source§fn into_either(self, into_left: bool) -> Either<Self, Self>
fn into_either(self, into_left: bool) -> Either<Self, Self>
self into a Left variant of Either<Self, Self>
if into_left is true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read moreSource§fn into_either_with<F>(self, into_left: F) -> Either<Self, Self>
fn into_either_with<F>(self, into_left: F) -> Either<Self, Self>
self into a Left variant of Either<Self, Self>
if into_left(&self) returns true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read moreSource§impl<T> IntoRequest<T> for T
impl<T> IntoRequest<T> for T
Source§fn into_request(self) -> Request<T>
fn into_request(self) -> Request<T>
T in a tonic::Request§impl<T> IntoResult<T> for T
impl<T> IntoResult<T> for T
type Err = Infallible
fn into_result(self) -> Result<T, <T as IntoResult<T>>::Err>
§impl<M> MetricVecRelabelExt for M
impl<M> MetricVecRelabelExt for M
§fn relabel(
self,
metric_level: MetricLevel,
relabel_threshold: MetricLevel,
) -> RelabeledMetricVec<M>
fn relabel( self, metric_level: MetricLevel, relabel_threshold: MetricLevel, ) -> RelabeledMetricVec<M>
RelabeledMetricVec::with_metric_level].§fn relabel_n(
self,
metric_level: MetricLevel,
relabel_threshold: MetricLevel,
relabel_num: usize,
) -> RelabeledMetricVec<M>
fn relabel_n( self, metric_level: MetricLevel, relabel_threshold: MetricLevel, relabel_num: usize, ) -> RelabeledMetricVec<M>
RelabeledMetricVec::with_metric_level_relabel_n].§fn relabel_debug_1(
self,
relabel_threshold: MetricLevel,
) -> RelabeledMetricVec<M>
fn relabel_debug_1( self, relabel_threshold: MetricLevel, ) -> RelabeledMetricVec<M>
RelabeledMetricVec::with_metric_level_relabel_n] with metric_level set to
MetricLevel::Debug and relabel_num set to 1.§impl<T> Pipe for Twhere
T: ?Sized,
impl<T> Pipe for Twhere
T: ?Sized,
§fn pipe<R>(self, func: impl FnOnce(Self) -> R) -> Rwhere
Self: Sized,
fn pipe<R>(self, func: impl FnOnce(Self) -> R) -> Rwhere
Self: Sized,
§fn pipe_ref<'a, R>(&'a self, func: impl FnOnce(&'a Self) -> R) -> Rwhere
R: 'a,
fn pipe_ref<'a, R>(&'a self, func: impl FnOnce(&'a Self) -> R) -> Rwhere
R: 'a,
self and passes that borrow into the pipe function. Read more§fn pipe_ref_mut<'a, R>(&'a mut self, func: impl FnOnce(&'a mut Self) -> R) -> Rwhere
R: 'a,
fn pipe_ref_mut<'a, R>(&'a mut self, func: impl FnOnce(&'a mut Self) -> R) -> Rwhere
R: 'a,
self and passes that borrow into the pipe function. Read more§fn pipe_borrow<'a, B, R>(&'a self, func: impl FnOnce(&'a B) -> R) -> R
fn pipe_borrow<'a, B, R>(&'a self, func: impl FnOnce(&'a B) -> R) -> R
§fn pipe_borrow_mut<'a, B, R>(
&'a mut self,
func: impl FnOnce(&'a mut B) -> R,
) -> R
fn pipe_borrow_mut<'a, B, R>( &'a mut self, func: impl FnOnce(&'a mut B) -> R, ) -> R
§fn pipe_as_ref<'a, U, R>(&'a self, func: impl FnOnce(&'a U) -> R) -> R
fn pipe_as_ref<'a, U, R>(&'a self, func: impl FnOnce(&'a U) -> R) -> R
self, then passes self.as_ref() into the pipe function.§fn pipe_as_mut<'a, U, R>(&'a mut self, func: impl FnOnce(&'a mut U) -> R) -> R
fn pipe_as_mut<'a, U, R>(&'a mut self, func: impl FnOnce(&'a mut U) -> R) -> R
self, then passes self.as_mut() into the pipe
function.§fn pipe_deref<'a, T, R>(&'a self, func: impl FnOnce(&'a T) -> R) -> R
fn pipe_deref<'a, T, R>(&'a self, func: impl FnOnce(&'a T) -> R) -> R
self, then passes self.deref() into the pipe function.§impl<T> Pointable for T
impl<T> Pointable for T
§impl<T> SameOrElseExt for Twhere
T: Eq,
impl<T> SameOrElseExt for Twhere
T: Eq,
§fn same_or_else(self, other: T, f: impl FnOnce() -> T) -> T
fn same_or_else(self, other: T, f: impl FnOnce() -> T) -> T
self and other are equal, if so, return self, otherwise return the result of f().§impl<T> Scope for T
impl<T> Scope for T
§impl<T> Tap for T
impl<T> Tap for T
§fn tap_borrow<B>(self, func: impl FnOnce(&B)) -> Self
fn tap_borrow<B>(self, func: impl FnOnce(&B)) -> Self
Borrow<B> of a value. Read more§fn tap_borrow_mut<B>(self, func: impl FnOnce(&mut B)) -> Self
fn tap_borrow_mut<B>(self, func: impl FnOnce(&mut B)) -> Self
BorrowMut<B> of a value. Read more§fn tap_ref<R>(self, func: impl FnOnce(&R)) -> Self
fn tap_ref<R>(self, func: impl FnOnce(&R)) -> Self
AsRef<R> view of a value. Read more§fn tap_ref_mut<R>(self, func: impl FnOnce(&mut R)) -> Self
fn tap_ref_mut<R>(self, func: impl FnOnce(&mut R)) -> Self
AsMut<R> view of a value. Read more§fn tap_deref<T>(self, func: impl FnOnce(&T)) -> Self
fn tap_deref<T>(self, func: impl FnOnce(&T)) -> Self
Deref::Target of a value. Read more§fn tap_deref_mut<T>(self, func: impl FnOnce(&mut T)) -> Self
fn tap_deref_mut<T>(self, func: impl FnOnce(&mut T)) -> Self
Deref::Target of a value. Read more§fn tap_dbg(self, func: impl FnOnce(&Self)) -> Self
fn tap_dbg(self, func: impl FnOnce(&Self)) -> Self
.tap() only in debug builds, and is erased in release builds.§fn tap_mut_dbg(self, func: impl FnOnce(&mut Self)) -> Self
fn tap_mut_dbg(self, func: impl FnOnce(&mut Self)) -> Self
.tap_mut() only in debug builds, and is erased in release
builds.§fn tap_borrow_dbg<B>(self, func: impl FnOnce(&B)) -> Self
fn tap_borrow_dbg<B>(self, func: impl FnOnce(&B)) -> Self
.tap_borrow() only in debug builds, and is erased in release
builds.§fn tap_borrow_mut_dbg<B>(self, func: impl FnOnce(&mut B)) -> Self
fn tap_borrow_mut_dbg<B>(self, func: impl FnOnce(&mut B)) -> Self
.tap_borrow_mut() only in debug builds, and is erased in release
builds.§fn tap_ref_dbg<R>(self, func: impl FnOnce(&R)) -> Self
fn tap_ref_dbg<R>(self, func: impl FnOnce(&R)) -> Self
.tap_ref() only in debug builds, and is erased in release
builds.§fn tap_ref_mut_dbg<R>(self, func: impl FnOnce(&mut R)) -> Self
fn tap_ref_mut_dbg<R>(self, func: impl FnOnce(&mut R)) -> Self
.tap_ref_mut() only in debug builds, and is erased in release
builds.§fn tap_deref_dbg<T>(self, func: impl FnOnce(&T)) -> Self
fn tap_deref_dbg<T>(self, func: impl FnOnce(&T)) -> Self
.tap_deref() only in debug builds, and is erased in release
builds.