add 4bit lora 7b

2023-05-09 14:38:32 -04:00
parent 02c59832a3
commit 7967cd1039
2 changed files with 69 additions and 0 deletions
--- a/examples/4bit-lora-7b/README.md
+++ b/examples/4bit-lora-7b/README.md
@@ -0,0 +1,8 @@
+# LLaMa 7B using LoRA
+
+This is a good place to start for beginners. This will run on an NVIDIA RTX4090 with no other changes needed.
+
+```shell
+accelerate launch scripts/finetune.py examples/4bit-lora-7b/config.yml
+
+```