MCPcopy Create free account
hub / github.com/apache/arrow / test_construct_from_single_directory

Function test_construct_from_single_directory

python/pyarrow/tests/test_dataset.py:2523–2539  ·  view source on GitHub ↗
(tempdir, dataset_reader, pickle_module)

Source from the content-addressed store, hash-verified

2521
2522@pytest.mark.parquet
2523def test_construct_from_single_directory(tempdir, dataset_reader, pickle_module):
2524 directory = tempdir / 'single-directory'
2525 directory.mkdir()
2526 tables, paths = _create_directory_of_files(directory)
2527
2528 d1 = ds.dataset(directory)
2529 d2 = ds.dataset(directory, filesystem=fs.LocalFileSystem())
2530 d3 = ds.dataset(directory.name, filesystem=_filesystem_uri(tempdir))
2531 t1 = dataset_reader.to_table(d1)
2532 t2 = dataset_reader.to_table(d2)
2533 t3 = dataset_reader.to_table(d3)
2534 assert t1 == t2 == t3
2535
2536 # test pickle roundtrip
2537 for d in [d1, d2, d3]:
2538 restored = pickle_module.loads(pickle_module.dumps(d))
2539 assert dataset_reader.to_table(restored) == t1
2540
2541
2542@pytest.mark.parquet

Callers

nothing calls this directly

Calls 6

_filesystem_uriFunction · 0.90
LocalFileSystemMethod · 0.80
loadsMethod · 0.80
dumpsMethod · 0.80
to_tableMethod · 0.45

Tested by

no test coverage detected