MCPcopy Create free account
hub / github.com/apache/arrow / test_json_format_options

Function test_json_format_options

python/pyarrow/tests/test_dataset.py:3611–3628  ·  view source on GitHub ↗
(tempdir, dataset_reader)

Source from the content-addressed store, hash-verified

3609
3610@pytest.mark.pandas
3611def test_json_format_options(tempdir, dataset_reader):
3612 table = pa.table({'a': pa.array([1, 2, 3], type="int64"),
3613 'b': pa.array([.1, .2, .3], type="float64")})
3614
3615 path = str(tempdir / 'test.json')
3616 out = table.to_pandas().to_json(orient='records')[1:-1].replace('},{', '}\n{')
3617 with open(path, 'w') as f:
3618 f.write(out)
3619
3620 with pytest.raises(ValueError,
3621 match="try to increase block size"):
3622 dataset = ds.dataset(path, format=ds.JsonFileFormat(
3623 read_options=pa.json.ReadOptions(block_size=4)))
3624
3625 dataset = ds.dataset(path, format=ds.JsonFileFormat(
3626 read_options=pa.json.ReadOptions(block_size=64)))
3627 result = dataset_reader.to_table(dataset)
3628 assert result.equals(table)
3629
3630
3631@pytest.mark.pandas

Callers

nothing calls this directly

Calls 5

JsonFileFormatMethod · 0.80
equalsMethod · 0.80
arrayMethod · 0.45
writeMethod · 0.45
to_tableMethod · 0.45

Tested by

no test coverage detected