MCPcopy Create free account
hub / github.com/dask/dask / get_default_shuffle_method

Function get_default_shuffle_method

dask/utils.py:2222–2238  ·  view source on GitHub ↗
()

Source from the content-addressed store, hash-verified

2220
2221
2222def get_default_shuffle_method() -> str:
2223 if d := config.get("dataframe.shuffle.method", None):
2224 return d
2225 try:
2226 from distributed import default_client
2227
2228 default_client()
2229 except (ImportError, ValueError):
2230 return "disk"
2231
2232 try:
2233 from distributed.shuffle import check_minimal_arrow_version
2234
2235 check_minimal_arrow_version()
2236 except ModuleNotFoundError:
2237 return "tasks"
2238 return "p2p"
2239
2240
2241def get_meta_library(like):

Callers 6

groupbyMethod · 0.90
shuffleMethod · 0.90
_lowerMethod · 0.90
is_broadcast_joinMethod · 0.90
_lowerMethod · 0.90

Calls 1

getMethod · 0.45

Tested by

no test coverage detected