tocmo0nlord/axolotl
1
0
Fork 0
Code Issues Pull Requests Actions 3 Packages Projects Releases Wiki Activity

more matrix updates

Browse Source
This commit is contained in:
Wing Lian
2023-06-11 10:52:36 -04:00
parent a43bae9ff0
commit 280832cec2
1 changed files with 7 additions and 7 deletions
Download Patch File Download Diff File Expand all files Collapse all files

14
README.md
View File

@@ -17,13 +17,13 @@
## Axolotl supports ## Axolotl supports
| | fp16/fp32 | fp16/fp32 w/ lora | qlora | 4bit-quant | 4bit-quant w/flash attention | flash attention | xformers attention | | | fp16/fp32 | fp16/fp32 w/ lora | qlora | 4bit-quant | 4bit-quant w/flash attention | flash attention | xformers attention |
|----------|:----------|:------------------|------|------------|------------------------------|----------------|-----------------| |----------|:----------|:------------------|-------|------------|------------------------------|-----------------|--------------------|
| llama | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | | llama | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ |
| Pythia | ✅ | ✅ | ❓ | ❌ | ❌ | ❌ | ❓ | | Pythia | ✅ | ✅ | ✅ | ❌ | ❌ | ❌ | ❓ |
| cerebras | ✅ | ✅ | ❓ | ❌ | ❌ | ❌ | ✅ | | cerebras | ✅ | ✅ | ✅ | ❌ | ❌ | ❌ | ✅ |
| mpt | ✅ | ❌ | ❓ | ❌ | ❌ | ❌ | ❓ | | mpt | ✅ | ❌ | ❓ | ❌ | ❌ | ❌ | ❓ |
| falcon | ✅ | ✅ | ✅ | ❌ | ❌ | ❌ | ✅ | | falcon | ✅ | ✅ | ✅ | ❌ | ❌ | ❌ | ✅ |
| gpt-j | ✅ | ✅ | ✅ | ❌ | ❌ | ❓ | ✅ | | gpt-j | ✅ | ✅ | ✅ | ❌ | ❌ | ❓ | ✅ |
## Quickstart ⚡ ## Quickstart ⚡