MCPcopy Create free account
hub / github.com/OpenSparseLLMs/Linear-MoE / pretrain_llama.py

File pretrain_llama.py

examples/linear_llama3/pretrain_llama.py:None–None  ·  view source on GitHub ↗

Source from the content-addressed store, hash-verified

1# Copyright (c) 2023, NVIDIA CORPORATION. All rights reserved.
2"""Pretrain GPT."""
3
4import os

Callers

nothing calls this directly

Calls 1

pretrainFunction · 0.90

Tested by

no test coverage detected