MCPcopy Create free account
hub / github.com/deepspeedai/DeepSpeedExamples / load_attention

Function load_attention

Megatron-LM/utils.py:385–387  ·  view source on GitHub ↗
(our, oai, dst2src=False)

Source from the content-addressed store, hash-verified

383 load_weights(oai.c_proj, our.dense_4h_to_h, dst2src)
384
385def load_attention(our, oai, dst2src=False):
386 load_weights(oai.c_attn, our.query_key_value, dst2src)
387 load_weights(oai.c_proj, our.dense, dst2src)
388
389def load_transformer_layer(our, oai, dst2src=False):
390 load_weights(oai.ln_1, our.input_layernorm, dst2src)

Callers 1

load_transformer_layerFunction · 0.85

Calls 1

load_weightsFunction · 0.85

Tested by

no test coverage detected