File base_train.py

scripts/base_train.py:None–None · view source on GitHub ↗

Source from the content-addressed store, hash-verified

1	"""
2	Train model. From root directory of the project, run as:
3
4	python -m scripts.base_train

nothing calls this directly

print_bannerFunction · 0.90

autodetect_device_typeFunction · 0.90

compute_initFunction · 0.90

get_peak_flopsFunction · 0.90

print0Function · 0.90

DummyWandbClass · 0.90

get_tokenizerFunction · 0.90

get_token_bytesFunction · 0.90

get_base_dirFunction · 0.90

load_checkpointFunction · 0.90

convert_to_float8_trainingFunction · 0.90

tokenizing_distributed_data_loader_with_state_bos_bestfitFunction · 0.90

no test coverage detected