File chat_cli.py

scripts/chat_cli.py:None–None · view source on GitHub ↗

Source from the content-addressed store, hash-verified

1	"""
2	New and upgraded chat mode because a lot of the code has changed since the last one.
3
4	Intended to be run single GPU only atm:

nothing calls this directly

autodetect_device_typeFunction · 0.90

compute_initFunction · 0.90

load_modelFunction · 0.90

EngineClass · 0.90

get_bos_token_idMethod · 0.45

encode_specialMethod · 0.45

encodeMethod · 0.45

generateMethod · 0.45

decodeMethod · 0.45

no test coverage detected