Method sample_next_token

sampler.py:83–103 · view source on GitHub ↗

(self, logit: torch.Tensor, strategy: str = 'greedy', temperature: float = 1.0)

Source from the content-addressed store, hash-verified

source not stored for this graph (policy: none)

sample_fontMethod · 0.95

top_k_top_p_filteringFunction · 0.85

no test coverage detected