tocmo0nlord/axolotl

Files

History

Wing Lian 39619028a3 use pythia-12b, neox-20b is flaky

2023-06-10 14:22:30 -04:00

..

config.yml

use pythia-12b, neox-20b is flaky

2023-06-10 14:22:30 -04:00

README.md

use pythia-12b, neox-20b is flaky

2023-06-10 14:22:30 -04:00

README.md

Python 12B

Single-GPU A100 only (?)

python scripts/finetune.py examples/pythia-12b/config.yml

⚠️ Multiple-GPU A100 - Doesn't seem to work with multi-gpu without causing OOM! ⚠️