(self, model, max_new_tokens=4096, temperature=0, device="cuda", dtype=torch.float16, system_prompt=None, api_key=None)
source not stored for this graph (policy: none)
nothing calls this directly
no test coverage detected