MCPcopy Create free account
hub / github.com/apache/arrow / test_write_dataset

Function test_write_dataset

python/pyarrow/tests/test_dataset.py:4219–4251  ·  view source on GitHub ↗
(tempdir)

Source from the content-addressed store, hash-verified

4217
4218@pytest.mark.parquet
4219def test_write_dataset(tempdir):
4220 # manually create a written dataset and read as dataset object
4221 directory = tempdir / 'single-file'
4222 directory.mkdir()
4223 _ = _create_single_file(directory)
4224 dataset = ds.dataset(directory)
4225
4226 # full string path
4227 target = tempdir / 'single-file-target'
4228 expected_files = [target / "part-0.arrow"]
4229 _check_dataset_roundtrip(dataset, str(target), expected_files, 'a', target)
4230
4231 # pathlib path object
4232 target = tempdir / 'single-file-target2'
4233 expected_files = [target / "part-0.arrow"]
4234 _check_dataset_roundtrip(dataset, target, expected_files, 'a', target)
4235
4236 # relative path
4237 target = tempdir / 'single-file-target3'
4238 expected_files = [target / "part-0.arrow"]
4239 with change_cwd(tempdir):
4240 _check_dataset_roundtrip(
4241 dataset, './single-file-target3', expected_files, 'a', target)
4242
4243 # Directory of files
4244 directory = tempdir / 'single-directory'
4245 directory.mkdir()
4246 _ = _create_directory_of_files(directory)
4247 dataset = ds.dataset(directory)
4248
4249 target = tempdir / 'single-directory-target'
4250 expected_files = [target / "part-0.arrow"]
4251 _check_dataset_roundtrip(dataset, str(target), expected_files, 'a', target)
4252
4253
4254@pytest.mark.parquet

Callers

nothing calls this directly

Calls 4

change_cwdFunction · 0.90
_create_single_fileFunction · 0.85
_check_dataset_roundtripFunction · 0.85

Tested by

no test coverage detected