MCPcopy
hub / github.com/zai-org/GLM-130B / add_bminf_args

Function add_bminf_args

initialize.py:14–20  ·  view source on GitHub ↗

Arguments for BMInf

(parser)

Source from the content-addressed store, hash-verified

12
13
14def add_bminf_args(parser):
15 """Arguments for BMInf"""
16 group = parser.add_argument_group("BMInf")
17
18 group.add_argument("--bminf", action="store_true", help="Use BMInf to support low resource evaluation")
19 group.add_argument("--bminf-memory-limit", type=int, default=20, help="Max memory for model per GPU (in GB)")
20 return parser
21
22
23def add_quantization_args(parser):

Callers 1

initializeFunction · 0.85

Calls

no outgoing calls

Tested by

no test coverage detected