MCPcopy Create free account
hub / github.com/dask/dask / optimize

Function optimize

dask/bag/core.py:162–169  ·  view source on GitHub ↗

Optimize a dask from a dask Bag.

(dsk, keys, fuse_keys=None, **kwargs)

Source from the content-addressed store, hash-verified

160
161
162def optimize(dsk, keys, fuse_keys=None, **kwargs):
163 """Optimize a dask from a dask Bag."""
164 dsk = convert_legacy_graph(dsk)
165 keys = list(flatten(keys))
166 dsk2 = cull(dsk, keys)
167 dsk3 = fuse_linear_task_spec(dsk2, keys + (fuse_keys or []))
168 dsk4 = lazify(dsk3)
169 return dsk4
170
171
172def _to_textfiles_chunk(data, lazy_file, last_endline):

Callers 1

test_optimizeFunction · 0.90

Calls 5

convert_legacy_graphFunction · 0.90
flattenFunction · 0.90
cullFunction · 0.90
fuse_linear_task_specFunction · 0.90
lazifyFunction · 0.85

Tested by 1

test_optimizeFunction · 0.72