MCPcopy Create free account
hub / github.com/apache/arrow / SubmitRead

Method SubmitRead

cpp/src/parquet/arrow/reader.cc:1284–1293  ·  view source on GitHub ↗

Synchronous fallback for when pre-buffer isn't enabled. Making the Parquet reader truly asynchronous requires heavy refactoring, so the generator piggybacks on ReadRangeCache. The lazy ReadRangeCache can be used for async I/O without forcing readahead.

Source from the content-addressed store, hash-verified

1282 // generator piggybacks on ReadRangeCache. The lazy ReadRangeCache can be used for
1283 // async I/O without forcing readahead.
1284 static ::arrow::Future<RecordBatchGenerator> SubmitRead(
1285 ::arrow::internal::Executor* cpu_executor, std::shared_ptr<FileReaderImpl> self,
1286 const int row_group, const std::vector<int>& column_indices) {
1287 if (!cpu_executor) {
1288 return ReadOneRowGroup(cpu_executor, self, row_group, column_indices);
1289 }
1290 // If we have an executor, then force transfer (even if I/O was complete)
1291 return ::arrow::DeferNotOk(cpu_executor->Submit(ReadOneRowGroup, cpu_executor, self,
1292 row_group, column_indices));
1293 }
1294
1295 static ::arrow::Future<RecordBatchGenerator> ReadOneRowGroup(
1296 ::arrow::internal::Executor* cpu_executor, std::shared_ptr<FileReaderImpl> self,

Callers

nothing calls this directly

Calls 1

DeferNotOkFunction · 0.85

Tested by

no test coverage detected