Files

Wing Lian cb9797ef5a improve llama pad token handling (#475 )

* improve llama pad token handling

* tweak logic to not clobber

2023-08-24 13:20:35 -04:00

config.yml

2023-08-24 13:20:35 -04:00

README.md

2023-06-12 17:06:15 +09:00

LLaMa 7B using LoRA

This is a good place to start for beginners. This will run on an NVIDIA RTX4090 with no other changes needed.

accelerate launch scripts/finetune.py examples/gptq-lora-7b/config.yml