MCPcopy Create free account
hub / github.com/apache/arrow / test_write_dataset

Function test_write_dataset

python/pyarrow/tests/test_dataset.py:4225–4257  ·  view source on GitHub ↗
(tempdir)

Source from the content-addressed store, hash-verified

4223
4224@pytest.mark.parquet
4225def test_write_dataset(tempdir):
4226 # manually create a written dataset and read as dataset object
4227 directory = tempdir / 'single-file'
4228 directory.mkdir()
4229 _ = _create_single_file(directory)
4230 dataset = ds.dataset(directory)
4231
4232 # full string path
4233 target = tempdir / 'single-file-target'
4234 expected_files = [target / "part-0.arrow"]
4235 _check_dataset_roundtrip(dataset, str(target), expected_files, 'a', target)
4236
4237 # pathlib path object
4238 target = tempdir / 'single-file-target2'
4239 expected_files = [target / "part-0.arrow"]
4240 _check_dataset_roundtrip(dataset, target, expected_files, 'a', target)
4241
4242 # relative path
4243 target = tempdir / 'single-file-target3'
4244 expected_files = [target / "part-0.arrow"]
4245 with change_cwd(tempdir):
4246 _check_dataset_roundtrip(
4247 dataset, './single-file-target3', expected_files, 'a', target)
4248
4249 # Directory of files
4250 directory = tempdir / 'single-directory'
4251 directory.mkdir()
4252 _ = _create_directory_of_files(directory)
4253 dataset = ds.dataset(directory)
4254
4255 target = tempdir / 'single-directory-target'
4256 expected_files = [target / "part-0.arrow"]
4257 _check_dataset_roundtrip(dataset, str(target), expected_files, 'a', target)
4258
4259
4260@pytest.mark.parquet

Callers

nothing calls this directly

Calls 4

change_cwdFunction · 0.90
_create_single_fileFunction · 0.85
_check_dataset_roundtripFunction · 0.85

Tested by

no test coverage detected