Endpoints — github.com/Lightning-AI/lit-llama

CodeHub MCPcopy Create free account

hub / github.com/Lightning-AI/lit-llama / endpoints

Endpoints1 in github.com/Lightning-AI/lit-llama

⨍ Functions 276◇ Types & classes 39 ↳ Endpoints 1

mock.patch("torch.cuda.is_bf16_supported", return_value=False)

tests/test_generate.py:None