Files

Wing Lian 165da584b3 fix config for parity with previous change

5159d00a86\#diff-65b4693504c4e8ffac76c7f2c90913faee381f802cf64e7f49c995a2134ed3b3R164

2023-05-11 08:13:09 -04:00

config.yml

2023-05-11 08:13:09 -04:00

README.md

add 4bit lora 7b

2023-05-09 14:38:32 -04:00

LLaMa 7B using LoRA

This is a good place to start for beginners. This will run on an NVIDIA RTX4090 with no other changes needed.

accelerate launch scripts/finetune.py examples/4bit-lora-7b/config.yml