MCPcopy Create free account
hub / github.com/TPCD/DCCL / parse_multiple_files

Function parse_multiple_files

project_utils/slurm_out_parser.py:95–112  ·  view source on GitHub ↗
(all_paths, rx_dict, root_dir=save_root_dir, save_name='test.pkl', verbose=True, save=False)

Source from the content-addressed store, hash-verified

93
94
95def parse_multiple_files(all_paths, rx_dict, root_dir=save_root_dir, save_name='test.pkl', verbose=True, save=False):
96
97 all_data = []
98 for path in all_paths:
99
100 data = parse_out_file(path, rx_dict, save=False, verbose=False)
101 all_data.append(data)
102
103 all_data = pd.concat(all_data)
104 save_path = os.path.join(root_dir, save_name)
105
106 if save:
107 all_data.to_pickle(save_path)
108
109 if verbose:
110 print(all_data)
111
112 return all_data
113
114
115save_dir = '/work/sagar/open_set_recognition/sweep_summary_files/ensemble_pkls'

Callers 1

Calls 1

parse_out_fileFunction · 0.85

Tested by

no test coverage detected