MCPcopy Create free account
hub / github.com/apache/arrow / GetFragments

Method GetFragments

cpp/src/arrow/dataset/scanner.cc:377–384  ·  view source on GitHub ↗

Source from the content-addressed store, hash-verified

375};
376
377Result<FragmentGenerator> AsyncScanner::GetFragments() const {
378 // TODO(ARROW-8163): Async fragment scanning will return AsyncGenerator<Fragment>
379 // here. Current iterator based versions are all fast & sync so we will just ToVector
380 // it
381 ARROW_ASSIGN_OR_RAISE(auto fragments_it, dataset_->GetFragments(scan_options_->filter));
382 ARROW_ASSIGN_OR_RAISE(auto fragments_vec, fragments_it.ToVector());
383 return MakeVectorGenerator(std::move(fragments_vec));
384}
385
386Result<TaggedRecordBatchIterator> AsyncScanner::ScanBatches() {
387 return ::arrow::internal::IterateSynchronously<TaggedRecordBatch>(

Callers 3

TEST_FFunction · 0.45
GetFragmentsFromDatasetsFunction · 0.45

Calls 1

MakeVectorGeneratorFunction · 0.85

Tested by 1

TEST_FFunction · 0.36