MCPcopy Index your code
hub / github.com/deepspeedai/DeepSpeedExamples / get_filepaths

Function get_filepaths

Megatron-LM/scripts/split_json.py:63–71  ·  view source on GitHub ↗
(filepaths, output_dir)

Source from the content-addressed store, hash-verified

61
62
63def get_filepaths(filepaths, output_dir):
64 paths = []
65 train_path = 'train.json'
66 dev_path = 'dev.json'
67 test_path = 'test.json'
68 paths.append(os.path.join(output_dir, train_path))
69 paths.append(os.path.join(output_dir, dev_path))
70 paths.append(os.path.join(output_dir, test_path))
71 return paths
72
73def write_files(lines, mappings, filepaths):
74 for l, m, path in zip(lines, mappings, filepaths):

Callers 1

split_json.pyFile · 0.85

Calls 1

appendMethod · 0.80

Tested by

no test coverage detected