MCPcopy Create free account
hub / github.com/OpenBMB/ToolBench / train_lora.py

File train_lora.py

toolbench/train/train_lora.py:None–None  ·  view source on GitHub ↗

Source from the content-addressed store, hash-verified

1# Usage: deepspeed train_lora.py --deepspeed <$PATH_TO_DEEPSPEED_CONFIG>
2
3# Adopted from tatsu-lab@stanford_alpaca. Below is the original copyright:
4# Copyright 2023 Rohan Taori, Ishaan Gulrajani, Tianyi Zhang, Yann Dubois, Xuechen Li

Callers

nothing calls this directly

Calls 2

replace_llama_attn_with_flash_attnFunction · 0.90
trainFunction · 0.70

Tested by

no test coverage detected