MCPcopy Create free account
hub / github.com/SHAILAB-IPEC/OpenFly-Platform / pprint_data_mixture

Function pprint_data_mixture

train/datasets/data_utils.py:691–697  ·  view source on GitHub ↗
(dataset_kwargs_list: List[Dict[str, Any]], dataset_weights: List[int])

Source from the content-addressed store, hash-verified

689
690# === RLDS Dataset Initialization Utilities ===
691def pprint_data_mixture(dataset_kwargs_list: List[Dict[str, Any]], dataset_weights: List[int]) -> None:
692 print("\n######################################################################################")
693 print(f"# Loading the following {len(dataset_kwargs_list)} datasets (incl. sampling weight):{'': >24} #")
694 for dataset_kwargs, weight in zip(dataset_kwargs_list, dataset_weights):
695 pad = 80 - len(dataset_kwargs["name"])
696 print(f"# {dataset_kwargs['name']}: {weight:=>{pad}f} #")
697 print("######################################################################################\n")
698
699
700def get_dataset_statistics(

Callers 1

make_interleaved_datasetFunction · 0.90

Calls

no outgoing calls

Tested by

no test coverage detected