MCPcopy Create free account
hub / github.com/OpenBitSys/BitDistiller / demo.py

File demo.py

inference/demo.py:None–None  ·  view source on GitHub ↗

Source from the content-addressed store, hash-verified

1import argparse
2import time
3import numpy as np
4import torch

Callers

nothing calls this directly

Calls 8

load_awq_llama_fastFunction · 0.90
load_awq_modelFunction · 0.90
make_fused_mlpFunction · 0.90
get_prompterFunction · 0.90
get_stop_token_idsFunction · 0.90
stream_outputFunction · 0.85
insert_promptMethod · 0.45
update_templateMethod · 0.45

Tested by

no test coverage detected