MCPcopy Create free account
hub / github.com/ASLP-lab/OSUM / forward_layers_checkpointed

Method forward_layers_checkpointed

OSUM/wenet/LLM/decoder.py:151–157  ·  view source on GitHub ↗
(self, xs: torch.Tensor,
                                    att_mask: torch.Tensor,
                                    pos_emb: torch.Tensor)

Source from the content-addressed store, hash-verified

149
150 @torch.jit.ignore(drop=True)
151 def forward_layers_checkpointed(self, xs: torch.Tensor,
152 att_mask: torch.Tensor,
153 pos_emb: torch.Tensor) -> torch.Tensor:
154 for layer in self.decoders:
155 xs, _, _, _ = ckpt.checkpoint(layer.__call__, xs, att_mask,
156 pos_emb)
157 return xs
158
159 @property
160 def hidden_size(self):

Callers 1

forwardMethod · 0.95

Calls

no outgoing calls

Tested by

no test coverage detected