MCPcopy Create free account
hub / github.com/apache/datafusion / with_file_groups

Method with_file_groups

datafusion/datasource/src/file_scan_config/mod.rs:431–434  ·  view source on GitHub ↗

Set the list of files to be processed, grouped into partitions. Each file must have a schema of `file_schema` or a subset. If a particular file has a subset, the missing columns are padded with NULLs. DataFusion may attempt to read each partition of files concurrently, however files *within* a partition will be read sequentially, one after the next.

(mut self, file_groups: Vec<FileGroup>)

Source from the content-addressed store, hash-verified

429 /// concurrently, however files *within* a partition will be read
430 /// sequentially, one after the next.
431 pub fn with_file_groups(mut self, file_groups: Vec<FileGroup>) -> Self {
432 self.file_groups = file_groups;
433 self
434 }
435
436 /// Add a new file group
437 ///

Calls

no outgoing calls