Functionrun_single(prompt, sys_prompt, temperature, max_new_tokens, device,
model_path, device_map, torch_dtype,
inference/app.py:140
Functionstream_single(prompt, sys_prompt, temperature, max_new_tokens, device,
model_path, device_map, torch_dtyp
inference/app_stream.py:224