tocmo0nlord/axolotl
1
0
Fork 0
Code Issues Pull Requests Actions 2 Packages Projects Releases Wiki Activity

Peft lotfq (#1222)

Browse Source 
* loftq support for lora

* fix loftq check

* update readme for loftq

* readability cleanup

* use peft main for loftq fixes, remove unnecessary special tokens

* remove unused test from older deprecation
This commit is contained in:
Wing Lian
2024-01-28 18:50:08 -05:00
committed by GitHub
parent 18f811978c
commit 4cb7900a56
9 changed files with 97 additions and 30 deletions
Download Patch File Download Diff File Expand all files Collapse all files

3
examples/llama-2/fft_optimized.yml
View File

@@ -67,6 +67,3 @@ weight_decay: 0.1
fsdp:
fsdp_config:
special_tokens:
bos_token: "<s>"
eos_token: "</s>"
unk_token: "<unk>"