Function apply_rotary_pos_emb

moe/model_config.py:135–145 · view source on GitHub ↗

(
        q, k, cos, sin, position_ids=None, unsqueeze_dim: int = 1 
)

Source from the content-addressed store, hash-verified

source not stored for this graph (policy: none)

forwardMethod · 0.85

rotate_halfFunction · 0.85

no test coverage detected