MCPcopy Create free account
hub / github.com/apache/arrow / test_write_dataset

Function test_write_dataset

python/pyarrow/tests/test_dataset.py:4221–4253  ·  view source on GitHub ↗
(tempdir)

Source from the content-addressed store, hash-verified

4219
4220@pytest.mark.parquet
4221def test_write_dataset(tempdir):
4222 # manually create a written dataset and read as dataset object
4223 directory = tempdir / 'single-file'
4224 directory.mkdir()
4225 _ = _create_single_file(directory)
4226 dataset = ds.dataset(directory)
4227
4228 # full string path
4229 target = tempdir / 'single-file-target'
4230 expected_files = [target / "part-0.arrow"]
4231 _check_dataset_roundtrip(dataset, str(target), expected_files, 'a', target)
4232
4233 # pathlib path object
4234 target = tempdir / 'single-file-target2'
4235 expected_files = [target / "part-0.arrow"]
4236 _check_dataset_roundtrip(dataset, target, expected_files, 'a', target)
4237
4238 # relative path
4239 target = tempdir / 'single-file-target3'
4240 expected_files = [target / "part-0.arrow"]
4241 with change_cwd(tempdir):
4242 _check_dataset_roundtrip(
4243 dataset, './single-file-target3', expected_files, 'a', target)
4244
4245 # Directory of files
4246 directory = tempdir / 'single-directory'
4247 directory.mkdir()
4248 _ = _create_directory_of_files(directory)
4249 dataset = ds.dataset(directory)
4250
4251 target = tempdir / 'single-directory-target'
4252 expected_files = [target / "part-0.arrow"]
4253 _check_dataset_roundtrip(dataset, str(target), expected_files, 'a', target)
4254
4255
4256@pytest.mark.parquet

Callers

nothing calls this directly

Calls 4

change_cwdFunction · 0.90
_create_single_fileFunction · 0.85
_check_dataset_roundtripFunction · 0.85

Tested by

no test coverage detected