MCPcopy Create free account
hub / github.com/apache/arrow / GeneratorFromReader

Function GeneratorFromReader

cpp/src/arrow/dataset/file_csv.cc:354–363  ·  view source on GitHub ↗

Source from the content-addressed store, hash-verified

352}
353
354static RecordBatchGenerator GeneratorFromReader(
355 const Future<std::shared_ptr<csv::StreamingReader>>& reader, int64_t batch_size) {
356 auto gen_fut = reader.Then(
357 [batch_size](
358 const std::shared_ptr<csv::StreamingReader>& reader) -> RecordBatchGenerator {
359 auto batch_gen = [reader]() { return reader->ReadNextAsync(); };
360 return MakeChunkedBatchGenerator(std::move(batch_gen), batch_size);
361 });
362 return MakeFromFuture(std::move(gen_fut));
363}
364
365} // namespace
366

Callers 1

ScanBatchesAsyncMethod · 0.85

Calls 4

MakeFromFutureFunction · 0.85
ThenMethod · 0.80
ReadNextAsyncMethod · 0.45

Tested by

no test coverage detected