Struct re_chunk::batcher::ChunkBatcherConfig

pub struct ChunkBatcherConfig {
    pub flush_tick: Duration,
    pub flush_num_bytes: u64,
    pub flush_num_rows: u64,
    pub chunk_max_rows_if_unsorted: u64,
    pub max_commands_in_flight: Option<u64>,
    pub max_chunks_in_flight: Option<u64>,
    pub hooks: BatcherHooks,
}

Defines the different thresholds of the associated ChunkBatcher.

See Self::default and Self::from_env.

Fields

flush_tick: Duration

Duration of the periodic tick.

flush_num_bytes: u64

Flush if the accumulated payload has a size in bytes equal or greater than this.

The resulting Chunk might be larger than flush_num_bytes!

flush_num_rows: u64

Flush if the accumulated payload has a number of rows equal or greater than this.

chunk_max_rows_if_unsorted: u64

Split a chunk if it contains >= rows than this threshold and one or more of its timelines are unsorted.

max_commands_in_flight: Option<u64>

Size of the internal channel of commands.

Unbounded if left unspecified.

max_chunks_in_flight: Option<u64>

Size of the internal channel of Chunks.

Unbounded if left unspecified.

hooks: BatcherHooks

Callbacks you can install on the ChunkBatcher.

Implementations

impl ChunkBatcherConfig

pub const DEFAULT: Self = _

Default configuration, applicable to most use cases.

pub const ALWAYS: Self = _

Always flushes ASAP.

pub const NEVER: Self = _

Never flushes unless manually told to (or hitting one the builtin invariants).

pub const ENV_FLUSH_TICK: &'static str = "RERUN_FLUSH_TICK_SECS"

Environment variable to configure Self::flush_tick.

pub const ENV_FLUSH_NUM_BYTES: &'static str = "RERUN_FLUSH_NUM_BYTES"

Environment variable to configure Self::flush_num_bytes.

pub const ENV_FLUSH_NUM_ROWS: &'static str = "RERUN_FLUSH_NUM_ROWS"

Environment variable to configure Self::flush_num_rows.

pub const ENV_CHUNK_MAX_ROWS_IF_UNSORTED: &'static str = "RERUN_CHUNK_MAX_ROWS_IF_UNSORTED"

Environment variable to configure Self::chunk_max_rows_if_unsorted.

const ENV_MAX_CHUNK_ROWS_IF_UNSORTED: &'static str = "RERUN_MAX_CHUNK_ROWS_IF_UNSORTED"

👎Deprecated: use RERUN_CHUNK_MAX_ROWS_IF_UNSORTED instead

Environment variable to configure Self::chunk_max_rows_if_unsorted.

pub fn from_env() -> ChunkBatcherResult<Self>

Creates a new ChunkBatcherConfig using the default values, optionally overridden through the environment.

See Self::apply_env.

pub fn apply_env(&self) -> ChunkBatcherResult<Self>

Returns a copy of self, overriding existing fields with values from the environment if they are present.

See Self::ENV_FLUSH_TICK, Self::ENV_FLUSH_NUM_BYTES, Self::ENV_FLUSH_NUM_BYTES.

Trait Implementations

impl Clone for ChunkBatcherConfig

fn clone(&self) -> ChunkBatcherConfig

Returns a copy of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for ChunkBatcherConfig

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Default for ChunkBatcherConfig

fn default() -> Self

Returns the “default value” for a type.

impl PartialEq for ChunkBatcherConfig

fn eq(&self, other: &ChunkBatcherConfig) -> bool

This method tests for self and other values to be equal, and is used by ==.

fn ne(&self, other: &Rhs) -> bool

This method tests for !=. The default implementation is almost always sufficient, and should not be overridden without very good reason.

impl StructuralPartialEq for ChunkBatcherConfig