MCPcopy
hub / github.com/ModelTC/LightLLM / get_env_start_args

Function get_env_start_args

lightllm/utils/envs_utils.py:44–49  ·  view source on GitHub ↗
()

Source from the content-addressed store, hash-verified

42
43@lru_cache(maxsize=None)
44def get_env_start_args():
45 from lightllm.server.core.objs.start_args_type import StartArgs
46
47 start_args: StartArgs = json.loads(os.environ["LIGHTLLM_START_ARGS"])
48 start_args: StartArgs = EasyDict(start_args)
49 return start_args
50
51
52@lru_cache(maxsize=None)

Callers 15

create_new_group_for_current_nodeFunction · 0.90
_init_nccl_envFunction · 0.90
health_checkFunction · 0.90
terminate_all_processesMethod · 0.90
init_custom_reduceMethod · 0.90
init_custom_gatherMethod · 0.90
startup_eventFunction · 0.90
__init__Method · 0.90
initMethod · 0.90
get_tuple_tokensMethod · 0.90
get_req_class_typeMethod · 0.90
get_max_req_numMethod · 0.90

Calls

no outgoing calls

Tested by 1

test_model_inferMethod · 0.72