MCPcopy Create free account
hub / github.com/apache/arrow / test_construct_from_single_directory

Function test_construct_from_single_directory

python/pyarrow/tests/test_dataset.py:2518–2534  ·  view source on GitHub ↗
(tempdir, dataset_reader, pickle_module)

Source from the content-addressed store, hash-verified

2516
2517@pytest.mark.parquet
2518def test_construct_from_single_directory(tempdir, dataset_reader, pickle_module):
2519 directory = tempdir / 'single-directory'
2520 directory.mkdir()
2521 tables, paths = _create_directory_of_files(directory)
2522
2523 d1 = ds.dataset(directory)
2524 d2 = ds.dataset(directory, filesystem=fs.LocalFileSystem())
2525 d3 = ds.dataset(directory.name, filesystem=_filesystem_uri(tempdir))
2526 t1 = dataset_reader.to_table(d1)
2527 t2 = dataset_reader.to_table(d2)
2528 t3 = dataset_reader.to_table(d3)
2529 assert t1 == t2 == t3
2530
2531 # test pickle roundtrip
2532 for d in [d1, d2, d3]:
2533 restored = pickle_module.loads(pickle_module.dumps(d))
2534 assert dataset_reader.to_table(restored) == t1
2535
2536
2537@pytest.mark.parquet

Callers

nothing calls this directly

Calls 6

_filesystem_uriFunction · 0.90
LocalFileSystemMethod · 0.80
loadsMethod · 0.80
dumpsMethod · 0.80
to_tableMethod · 0.45

Tested by

no test coverage detected