mhenrichsen
|
fdffef5940
|
new llama-2 default settings (#370)
* new default settings
* fix whitespace
* rm max packed sequence length
---------
Co-authored-by: Mads Henrichsen <mads@BrbartiendeMads.lan>
|
2023-08-14 17:39:09 +09:00 |
|
Morgan McGuire
|
7019509daa
|
Add wandb_entity to wandb options, update example configs, update README (#361)
* Update wandb_entity and add wandb descriptions
* add wandb to config section
* remove trailing whitespace for pre-commit hook
* remove trailing whitespace for pre-commit hook
---------
Co-authored-by: Morgan McGuire <morganmcguire@Morgans-MacBook-Pro.local>
Co-authored-by: Wing Lian <wing.lian@gmail.com>
|
2023-08-12 12:17:11 -04:00 |
|
Aman Karmani
|
36fefcf94b
|
set group_by_length to false in examples
|
2023-08-06 23:59:09 -07:00 |
|
mhenrichsen
|
dc71d8872a
|
feat/llama-2 examples (#319)
* qlora llama-2
* qlora llama-2
* linting
* readme
* lora added
* linting
* change group_by_length
* 13b fitting on 24gb
* grouped lengths true
* add pad token
* change out dir
---------
Co-authored-by: Mads Henrichsen <mads@Brbar-tilhrende-Mads.local>
|
2023-08-03 19:22:48 +09:00 |
|