MCPcopy Create free account
hub / github.com/dask/dask / get_default_shuffle_method

Function get_default_shuffle_method

dask/utils.py:2227–2243  ·  view source on GitHub ↗
()

Source from the content-addressed store, hash-verified

2225
2226
2227def get_default_shuffle_method() -> str:
2228 if d := config.get("dataframe.shuffle.method", None):
2229 return d
2230 try:
2231 from distributed import default_client
2232
2233 default_client()
2234 except (ImportError, ValueError):
2235 return "disk"
2236
2237 try:
2238 from distributed.shuffle import check_minimal_arrow_version
2239
2240 check_minimal_arrow_version()
2241 except ModuleNotFoundError:
2242 return "tasks"
2243 return "p2p"
2244
2245
2246def get_meta_library(like):

Callers 6

groupbyMethod · 0.90
shuffleMethod · 0.90
_lowerMethod · 0.90
is_broadcast_joinMethod · 0.90
_lowerMethod · 0.90

Calls 1

getMethod · 0.45

Tested by

no test coverage detected