Commit Graph

6 Commits

Author SHA1 Message Date
Wing Lian
0da0cd02e5 make sure to use the correct tokenizer 2025-01-09 18:57:28 -05:00
Wing Lian
dd48ce7365 make sure to set tokenizer from l3 70b and save safetensors 2025-01-09 18:57:28 -05:00
Wing Lian
6fbc35762b lower lr 2025-01-09 18:57:28 -05:00
Wing Lian
71cb5b98c9 set lora_dropout explicitly 2025-01-09 18:57:28 -05:00
Wing Lian
890d85f267 make the kd e2e fit in vram for ci and add lora version 2025-01-09 18:57:28 -05:00
Wing Lian
7dc137ed5b rename test files so it gets picked up 2025-01-09 18:57:28 -05:00