MCPcopy Create free account
hub / github.com/apache/arrow / _ensure_format

Function _ensure_format

python/pyarrow/dataset.py:297–317  ·  view source on GitHub ↗
(obj)

Source from the content-addressed store, hash-verified

295
296
297def _ensure_format(obj):
298 if isinstance(obj, FileFormat):
299 return obj
300 elif obj == "parquet":
301 if not _parquet_available:
302 raise ValueError(_parquet_msg)
303 return ParquetFileFormat()
304 elif obj in {"ipc", "arrow"}:
305 return IpcFileFormat()
306 elif obj == "feather":
307 return FeatherFileFormat()
308 elif obj == "csv":
309 return CsvFileFormat()
310 elif obj == "orc":
311 if not _orc_available:
312 raise ValueError(_orc_msg)
313 return OrcFileFormat()
314 elif obj == "json":
315 return JsonFileFormat()
316 else:
317 raise ValueError(f"format '{obj}' is not supported")
318
319
320def _ensure_multiple_sources(paths, filesystem=None):

Callers 2

_filesystem_datasetFunction · 0.85
write_datasetFunction · 0.85

Calls 4

ParquetFileFormatClass · 0.85
IpcFileFormatClass · 0.85
CsvFileFormatClass · 0.85
JsonFileFormatClass · 0.85

Tested by

no test coverage detected