MCPcopy
hub / github.com/ray-project/ray / _deduce_default_shuffle_algorithm

Function _deduce_default_shuffle_algorithm

python/ray/data/context.py:442–458  ·  view source on GitHub ↗
()

Source from the content-addressed store, hash-verified

440
441
442def _deduce_default_shuffle_algorithm() -> ShuffleStrategy:
443 if DEFAULT_USE_PUSH_BASED_SHUFFLE:
444 logger.warning(
445 "RAY_DATA_PUSH_BASED_SHUFFLE is deprecated, please use "
446 "RAY_DATA_DEFAULT_SHUFFLE_STRATEGY to set shuffling strategy"
447 )
448
449 return ShuffleStrategy.SORT_SHUFFLE_PUSH_BASED
450 else:
451 vs = [s for s in ShuffleStrategy] # noqa: C416
452
453 assert DEFAULT_SHUFFLE_STRATEGY in vs, (
454 f"RAY_DATA_DEFAULT_SHUFFLE_STRATEGY has to be one of the [{','.join(vs)}] "
455 f"(got {DEFAULT_SHUFFLE_STRATEGY})"
456 )
457
458 return DEFAULT_SHUFFLE_STRATEGY
459
460
461def _default_fixed_shape_tensor_format():

Callers 1

DataContextClass · 0.85

Calls 2

warningMethod · 0.45
joinMethod · 0.45

Tested by

no test coverage detected

Used in the wild real call sites across dependent graphs

searching dependent graphs…