MCPcopy
hub / github.com/hpcaitech/ColossalAI / inference_example.py

File inference_example.py

applications/Colossal-LLaMA/inference/inference_example.py:None–None  ·  view source on GitHub ↗

Source from the content-addressed store, hash-verified

1import argparse
2
3import torch
4from colossal_llama.dataset.conversation import default_conversation

Callers

nothing calls this directly

Calls 2

get_dist_loggerFunction · 0.90
generateFunction · 0.70

Tested by

no test coverage detected