MCPcopy Create free account
hub / github.com/GreenBitAI/low_bit_llama / forward

Method forward

evaluate.py:30–35  ·  view source on GitHub ↗
(self, inp, **kwargs)

Source from the content-addressed store, hash-verified

28 self.module = module
29
30 def forward(self, inp, **kwargs):
31 inps[cache['i']] = inp
32 cache['i'] += 1
33 cache['attention_mask'] = kwargs['attention_mask']
34 cache['position_ids'] = kwargs['position_ids']
35 raise ValueError
36
37 layers[0] = Catcher(layers[0])
38 for i in range(nsamples):

Callers

nothing calls this directly

Calls

no outgoing calls

Tested by

no test coverage detected