hub / github.com/csunny/algorithm / forward

Method forward

moe/model_config.py:181–236 · view source on GitHub ↗

(self, 
                x: torch.Tensor,
                position_embeddings: Tuple[torch.Tensor, torch.Tensor],
                past_key_value: Optional[Tuple[torch.Tensor]] = None,
                use_cache: bool = False,
                attention_mask: Optional[torch.Tensor] = None)

Source from the content-addressed store, hash-verified

source not stored for this graph (policy: none)

Callers

nothing calls this directly

Calls 2

apply_rotary_pos_embFunction · 0.85

repeat_kvFunction · 0.85

Tested by

no test coverage detected