MCPcopy
hub / github.com/hpcaitech/ColossalAI / is_using_sequence

Function is_using_sequence

colossalai/legacy/utils/common.py:78–79  ·  view source on GitHub ↗
()

Source from the content-addressed store, hash-verified

76
77
78def is_using_sequence():
79 return gpc.is_initialized(ParallelMode.SEQUENCE) and gpc.get_world_size(ParallelMode.SEQUENCE) > 1
80
81
82class model_branch_context(object):

Callers 1

initializeFunction · 0.90

Calls 2

is_initializedMethod · 0.45
get_world_sizeMethod · 0.45

Tested by

no test coverage detected

Used in the wild real call sites across dependent graphs

searching dependent graphs…