pub fn concatenate_record_batches(
schema: Schema,
batches: &[TransportChunk]
) -> Result<TransportChunk, Error>
Expand description
Concatenate multiple TransportChunk
s into one.
This is a temporary method that we use while waiting to migrate towards arrow-rs
.
arrow2
doesn’t have aRecordBatch
type, therefore we emulate that using ourTransportChunk
s.arrow-rs
does have one, and it natively supports concatenation.