2 Commits

Author	SHA1	Message	Date
Wing Lian	782b6a4216	set fp16 to false if bf16, update bf16: auto in example YAMLs (#1122) [skip ci] ... * set fp16 to false if bf16, update bf16: auto in example YAMLs * unset fp16 so that it fallsback properly if bf16 isn't available * Update README.md [skip-ci] Co-authored-by: NanoCode012 <kevinvong@rocketmail.com> * test that bf16 disables fp16 --------- Co-authored-by: NanoCode012 <kevinvong@rocketmail.com>	2024-01-22 18:44:01 -05:00
Evan Griffiths	6ef46f8dca	Add an example config for finetuning a 34B model on a 24GB GPU (#1000) ... * Add an example config for finetuning a 34B model on a 24GB GPU * Remore wandb project	2023-12-25 10:29:55 -08:00