MCPcopy Create free account
hub / github.com/dask/dask / optimize

Function optimize

dask/bag/core.py:161–168  ·  view source on GitHub ↗

Optimize a dask from a dask Bag.

(dsk, keys, fuse_keys=None, **kwargs)

Source from the content-addressed store, hash-verified

159
160
161def optimize(dsk, keys, fuse_keys=None, **kwargs):
162 """Optimize a dask from a dask Bag."""
163 dsk = convert_legacy_graph(dsk)
164 keys = list(flatten(keys))
165 dsk2 = cull(dsk, keys)
166 dsk3 = fuse_linear_task_spec(dsk2, keys + (fuse_keys or []))
167 dsk4 = lazify(dsk3)
168 return dsk4
169
170
171def _to_textfiles_chunk(data, lazy_file, last_endline):

Callers 1

test_optimizeFunction · 0.90

Calls 5

convert_legacy_graphFunction · 0.90
flattenFunction · 0.90
cullFunction · 0.90
fuse_linear_task_specFunction · 0.90
lazifyFunction · 0.85

Tested by 1

test_optimizeFunction · 0.72