MCPcopy
hub / github.com/deepspeedai/DeepSpeed / _validate_folder_mapping

Function _validate_folder_mapping

deepspeed/nvme/ds_aio_args.py:43–65  ·  view source on GitHub ↗
(args)

Source from the content-addressed store, hash-verified

41
42
43def _validate_folder_mapping(args):
44 no_error = True
45 error_messages = []
46 invalid_mappings = [m for m in args.folder_to_device_mapping if MAPPING_DELIMITER not in m]
47 if len(invalid_mappings) > 0:
48 error_messages.append(
49 f'Missing delimiter ({MAPPING_DELIMITER}) in folder_to_device_mapping {invalid_mappings}')
50 no_error = False
51
52 folder_list = [m.split(MAPPING_DELIMITER)[0] for m in args.folder_to_device_mapping]
53 invalid_folders = [d for d in folder_list if not os.path.exists(d)]
54 if len(invalid_folders) > 0:
55 error_messages.append(f'Invalid folders in folder_to_device_mapping: {invalid_folders}')
56 no_error = False
57
58 if args.gpu:
59 device_list = [int(m.split(MAPPING_DELIMITER)[1]) for m in args.folder_to_device_mapping]
60 invalid_device_list = [dev_id for dev_id in device_list if not dev_id < get_accelerator().device_count()]
61 if len(invalid_device_list) > 0:
62 error_messages.append(f'Invalid device ids in folder_to_device_mapping: {invalid_device_list}')
63 no_error = False
64
65 return no_error, error_messages
66
67
68def validate_args(args):

Callers 1

validate_argsFunction · 0.70

Calls 4

get_acceleratorFunction · 0.90
appendMethod · 0.80
existsMethod · 0.45
device_countMethod · 0.45

Tested by

no test coverage detected

Used in the wild real call sites across dependent graphs

searching dependent graphs…