MCPcopy
hub / github.com/Tele-AI/Telechat / telechat_quantized_infer_demo.py

File telechat_quantized_infer_demo.py

quant/telechat_quantized_infer_demo.py:None–None  ·  view source on GitHub ↗

Source from the content-addressed store, hash-verified

1import os
2from transformers import AutoTokenizer, GenerationConfig
3from modeling_telechat_gptq import TelechatGPTQForCausalLM
4

Callers

nothing calls this directly

Calls 1

mainFunction · 0.70

Tested by

no test coverage detected