From 3d1f203b6231f42f33289a06b6b444871d5e983a Mon Sep 17 00:00:00 2001 From: NanoCode012 Date: Wed, 16 Aug 2023 13:56:48 +0900 Subject: [PATCH] Fix(docs): Remove gptq+lora and fix xformer compat list (#423) --- README.md | 18 +++++++++--------- 1 file changed, 9 insertions(+), 9 deletions(-) diff --git a/README.md b/README.md index a81b63f1b..1be423454 100644 --- a/README.md +++ b/README.md @@ -49,15 +49,15 @@ Axolotl is a tool designed to streamline the fine-tuning of various AI models, o ## Axolotl supports -| | fp16/fp32 | lora | qlora | gptq | gptq w/ lora | gptq w/flash attn | flash attn | xformers attn | -|----------|:----------|:-----|-------|------|:-------------|-------------------|------------|---------------| -| llama | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | -| Pythia | ✅ | ✅ | ✅ | ❌ | ❓ | ❌ | ❌ | ❓ | -| cerebras | ✅ | ✅ | ✅ | ❌ | ❓ | ❌ | ❌ | ✅ | -| mpt | ✅ | ❌ | ❓ | ❌ | ❓ | ❌ | ❌ | ❓ | -| falcon | ✅ | ✅ | ✅ | ❌ | ❓ | ❌ | ❌ | ✅ | -| gpt-j | ✅ | ✅ | ✅ | ❌ | ❓ | ❌ | ❓ | ✅ | -| XGen | ✅ | ❓ | ✅ | ❓ | ❓ | ❓ | ❓ | ✅ +| | fp16/fp32 | lora | qlora | gptq | gptq w/flash attn | flash attn | xformers attn | +|----------|:----------|:-----|-------|------|-------------------|------------|---------------| +| llama | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | +| Pythia | ✅ | ✅ | ✅ | ❌ | ❌ | ❌ | ❓ | +| cerebras | ✅ | ✅ | ✅ | ❌ | ❌ | ❌ | ❓ | +| mpt | ✅ | ❌ | ❓ | ❌ | ❌ | ❌ | ❓ | +| falcon | ✅ | ✅ | ✅ | ❌ | ❌ | ❌ | ❓ | +| gpt-j | ✅ | ✅ | ✅ | ❌ | ❌ | ❓ | ❓ | +| XGen | ✅ | ❓ | ✅ | ❓ | ❓ | ❓ | ✅ | ## Quickstart ⚡