Function rerun::dataframe::concatenate_record_batches

source ·
pub fn concatenate_record_batches(
    schema: Schema,
    batches: &[TransportChunk]
) -> Result<TransportChunk, Error>
Expand description

Concatenate multiple TransportChunks into one.

This is a temporary method that we use while waiting to migrate towards arrow-rs.

  • arrow2 doesn’t have a RecordBatch type, therefore we emulate that using our TransportChunks.
  • arrow-rs does have one, and it natively supports concatenation.