MCPcopy
hub / github.com/lm-sys/FastChat / multi_model_worker.py

File multi_model_worker.py

fastchat/serve/multi_model_worker.py:None–None  ·  view source on GitHub ↗

Source from the content-addressed store, hash-verified

1"""
2A multi-model worker that contains multiple sub-works one for each model. This
3supports running a list of models on the same machine so that they can
4(potentially) share the same background weights.

Callers

nothing calls this directly

Calls 1

Tested by

no test coverage detected