pub struct MonitoredStreamingUploader<U: StreamingUploader> {
inner: U,
object_store_metrics: Arc<ObjectStoreMetrics>,
operation_size: usize,
}Expand description
MonitoredStreamingUploader will report the following metrics.
write_bytes: The number of bytes uploaded from the uploader’s creation to finish.operation_size:streaming_upload_write_bytes: The number of bytes written for each call towrite_bytes.streaming_upload: Same aswrite_bytes.
operation_latency:streaming_upload_start: The time spent creating the uploader.streaming_upload_write_bytes: The time spent on each call towrite_bytes.streaming_upload_finish: The time spent callingfinish.
failure_count:streaming_upload_start,streaming_upload_write_bytes,streaming_upload_finish
Fields§
§inner: U§object_store_metrics: Arc<ObjectStoreMetrics>§operation_size: usizeLength of data uploaded with this uploader.
Implementations§
source§impl<U: StreamingUploader> MonitoredStreamingUploader<U>
impl<U: StreamingUploader> MonitoredStreamingUploader<U>
pub fn new(handle: U, object_store_metrics: Arc<ObjectStoreMetrics>) -> Self
source§impl<U: StreamingUploader> MonitoredStreamingUploader<U>
impl<U: StreamingUploader> MonitoredStreamingUploader<U>
NOTICE: after #16231, streaming uploader implemented via aws-sdk-s3 will maintain metrics internally in s3.rs
so MonitoredStreamingUploader will only be used when the inner object store is opendal.
async fn write_bytes(&mut self, data: Bytes) -> ObjectResult<()>
async fn finish(self) -> ObjectResult<()>
fn get_memory_usage(&self) -> u64
Auto Trait Implementations§
impl<U> Freeze for MonitoredStreamingUploader<U>where
U: Freeze,
impl<U> !RefUnwindSafe for MonitoredStreamingUploader<U>
impl<U> Send for MonitoredStreamingUploader<U>
impl<U> Sync for MonitoredStreamingUploader<U>where
U: Sync,
impl<U> Unpin for MonitoredStreamingUploader<U>where
U: Unpin,
impl<U> !UnwindSafe for MonitoredStreamingUploader<U>
Blanket Implementations§
source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more
§impl<T> FutureExt for T
impl<T> FutureExt for T
§fn with_context(self, otel_cx: Context) -> WithContext<Self>
fn with_context(self, otel_cx: Context) -> WithContext<Self>
§fn with_current_context(self) -> WithContext<Self>
fn with_current_context(self) -> WithContext<Self>
§impl<T> Instrument for T
impl<T> Instrument for T
§fn instrument(self, span: Span) -> Instrumented<Self>
fn instrument(self, span: Span) -> Instrumented<Self>
§fn in_current_span(self) -> Instrumented<Self>
fn in_current_span(self) -> Instrumented<Self>
source§impl<T> Instrument for T
impl<T> Instrument for T
source§fn instrument(self, span: Span) -> Instrumented<Self>
fn instrument(self, span: Span) -> Instrumented<Self>
source§fn in_current_span(self) -> Instrumented<Self>
fn in_current_span(self) -> Instrumented<Self>
source§impl<T> IntoEither for T
impl<T> IntoEither for T
source§fn into_either(self, into_left: bool) -> Either<Self, Self>
fn into_either(self, into_left: bool) -> Either<Self, Self>
Converts
self into a Left variant of Either<Self, Self>
if into_left is true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read moresource§fn into_either_with<F>(self, into_left: F) -> Either<Self, Self>
fn into_either_with<F>(self, into_left: F) -> Either<Self, Self>
Converts
self into a Left variant of Either<Self, Self>
if into_left(&self) returns true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read moresource§impl<T> IntoRequest<T> for T
impl<T> IntoRequest<T> for T
source§fn into_request(self) -> Request<T>
fn into_request(self) -> Request<T>
Wrap the input message
T in a tonic::Request§impl<T> IntoResult<T> for T
impl<T> IntoResult<T> for T
type Err = Infallible
fn into_result(self) -> Result<T, <T as IntoResult<T>>::Err>
Creates a shared type from an unshared type.
source§impl<M> MetricVecRelabelExt for M
impl<M> MetricVecRelabelExt for M
source§fn relabel(
self,
metric_level: MetricLevel,
relabel_threshold: MetricLevel,
) -> RelabeledMetricVec<M>
fn relabel( self, metric_level: MetricLevel, relabel_threshold: MetricLevel, ) -> RelabeledMetricVec<M>
Equivalent to
RelabeledMetricVec::with_metric_level.source§fn relabel_n(
self,
metric_level: MetricLevel,
relabel_threshold: MetricLevel,
relabel_num: usize,
) -> RelabeledMetricVec<M>
fn relabel_n( self, metric_level: MetricLevel, relabel_threshold: MetricLevel, relabel_num: usize, ) -> RelabeledMetricVec<M>
Equivalent to
RelabeledMetricVec::with_metric_level_relabel_n.source§fn relabel_debug_1(
self,
relabel_threshold: MetricLevel,
) -> RelabeledMetricVec<M>
fn relabel_debug_1( self, relabel_threshold: MetricLevel, ) -> RelabeledMetricVec<M>
Equivalent to
RelabeledMetricVec::with_metric_level_relabel_n with metric_level set to
MetricLevel::Debug and relabel_num set to 1.