Function get_pipeline_parallel_comm

training/comm/comm_utils.py:38–40 · view source on GitHub ↗

()

Source from the content-addressed store, hash-verified

36
37
38	def get_pipeline_parallel_comm() -> NCCLCommunicator:
39	assert _PIPELINE_PARALLEL_COMM is not None
40	return _PIPELINE_PARALLEL_COMM
41
42
43	def get_pipeline_parallel_rank() -> int:

train_loopFunction · 0.85

__init__Method · 0.85

no outgoing calls

no test coverage detected