tocmo0nlord/axolotl
1
0
Fork 0
Code Issues Pull Requests Actions 3 Packages Projects Releases Wiki Activity

rename jamba example (#1846) [skip ci]

Browse Source 
* rename jamba example

* feat: change readme

---------

Co-authored-by: Gal Cohen <galc@ai21.com>
This commit is contained in:
Gal Cohen (galco)
2024-08-22 16:22:55 +03:00
committed by GitHub
parent f07802f9fa
commit 957c956f89
3 changed files with 47 additions and 36 deletions
Download Patch File Download Diff File Expand all files Collapse all files

2
examples/jamba/README.md
View File

@@ -6,5 +6,5 @@
- ✅ qlora w/ deepspeed Zero-3 needs at least 2x GPUs and 67GiB VRAM (wtf?)
- ✅ qlora single-gpu, ~51GiB VRAM
- ✅ multipack
- ❓ FSDP
- ✅ FSDP
- ❓ 8-bit LoRA