MCPcopy Create free account
hub / github.com/apache/arrow / test_write_dataset_partitioned_dict

Function test_write_dataset_partitioned_dict

python/pyarrow/tests/test_dataset.py:4682–4703  ·  view source on GitHub ↗
(tempdir)

Source from the content-addressed store, hash-verified

4680@pytest.mark.parquet
4681@pytest.mark.pandas
4682def test_write_dataset_partitioned_dict(tempdir):
4683 directory = tempdir / "partitioned"
4684 _ = _create_parquet_dataset_partitioned(directory)
4685
4686 # directory partitioning, dictionary partition columns
4687 dataset = ds.dataset(
4688 directory,
4689 partitioning=ds.HivePartitioning.discover(infer_dictionary=True))
4690 target = tempdir / 'partitioned-dir-target'
4691 expected_paths = [
4692 target / "a", target / "a" / "part-0.arrow",
4693 target / "b", target / "b" / "part-0.arrow"
4694 ]
4695 partitioning = ds.partitioning(pa.schema([
4696 dataset.schema.field('part')]),
4697 dictionaries={'part': pa.array(['a', 'b'])})
4698 # NB: dictionaries required here since we use partitioning to parse
4699 # directories in _check_dataset_roundtrip (not currently required for
4700 # the formatting step)
4701 _check_dataset_roundtrip(
4702 dataset, str(target), expected_paths, 'f1', target,
4703 partitioning=partitioning)
4704
4705
4706@pytest.mark.parquet

Callers

nothing calls this directly

Calls 6

_check_dataset_roundtripFunction · 0.85
partitioningMethod · 0.80
schemaMethod · 0.45
fieldMethod · 0.45
arrayMethod · 0.45

Tested by

no test coverage detected