Wing Lian
3e2b269d06
update tinyllama to use final instead of checkpoints ( #1820 ) [skip ci]
2024-08-09 10:58:19 -04:00
Jaydeep Thik
84bb8061ba
Update tiny-llama qlora.yml addressing eval packing error ( #1638 )
2024-05-22 08:34:06 -04:00
Wing Lian
4fde300e5f
update outputs path so that we can mount workspace to /workspace/data ( #1623 )
...
* update outputs path so that we can mount workspace to /workspace/data
* fix ln order
2024-05-15 12:44:13 -04:00
NanoCode012
a7a9a1433a
fix(examples): remove is_*_derived as it's parsed automatically ( #1297 )
2024-02-22 00:52:46 +09:00
Wing Lian
782b6a4216
set fp16 to false if bf16, update bf16: auto in example YAMLs ( #1122 ) [skip ci]
...
* set fp16 to false if bf16, update bf16: auto in example YAMLs
* unset fp16 so that it fallsback properly if bf16 isn't available
* Update README.md [skip-ci]
Co-authored-by: NanoCode012 <kevinvong@rocketmail.com >
* test that bf16 disables fp16
---------
Co-authored-by: NanoCode012 <kevinvong@rocketmail.com >
2024-01-22 18:44:01 -05:00
NanoCode012
8ba27f3bde
fix: lint ( #1037 )
2024-01-03 10:23:44 -05:00
Tim Dolan
c75f916745
added tiny llama examples for lora and qlora ( #1027 )
...
* added tiny llama examples for lora and qlora
* corrected yml files and removed tiny-llama.yml from llama-2 example
2024-01-02 20:00:37 -05:00