From a5a625f47e44ea98dd5595ce1822d6b2dab720da Mon Sep 17 00:00:00 2001 From: Wing Lian Date: Fri, 15 Sep 2023 02:46:15 -0400 Subject: [PATCH] update support matrix with btlm and phi (#579) --- README.md | 18 ++++++++++-------- 1 file changed, 10 insertions(+), 8 deletions(-) diff --git a/README.md b/README.md index 4e213018d..a58ba5965 100644 --- a/README.md +++ b/README.md @@ -51,14 +51,16 @@ Axolotl is a tool designed to streamline the fine-tuning of various AI models, o ## Axolotl supports | | fp16/fp32 | lora | qlora | gptq | gptq w/flash attn | flash attn | xformers attn | -|----------|:----------|:-----|-------|------|-------------------|------------|---------------| -| llama | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | -| Pythia | ✅ | ✅ | ✅ | ❌ | ❌ | ❌ | ❓ | -| cerebras | ✅ | ✅ | ✅ | ❌ | ❌ | ❌ | ❓ | -| mpt | ✅ | ❌ | ❓ | ❌ | ❌ | ❌ | ❓ | -| falcon | ✅ | ✅ | ✅ | ❌ | ❌ | ❌ | ❓ | -| gpt-j | ✅ | ✅ | ✅ | ❌ | ❌ | ❓ | ❓ | -| XGen | ✅ | ❓ | ✅ | ❓ | ❓ | ❓ | ✅ | +|----------|:----------|:-----|-------|------|-------------------|------------|--------------| +| llama | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | +| Pythia | ✅ | ✅ | ✅ | ❌ | ❌ | ❌ | ❓ | +| cerebras | ✅ | ✅ | ✅ | ❌ | ❌ | ❌ | ❓ | +| btlm | ✅ | ✅ | ✅ | ❌ | ❌ | ❌ | ❓ | +| mpt | ✅ | ❌ | ❓ | ❌ | ❌ | ❌ | ❓ | +| falcon | ✅ | ✅ | ✅ | ❌ | ❌ | ❌ | ❓ | +| gpt-j | ✅ | ✅ | ✅ | ❌ | ❌ | ❓ | ❓ | +| XGen | ✅ | ❓ | ✅ | ❓ | ❓ | ❓ | ✅ | +| phi | ✅ | ✅ | ✅ | ❓ | ❓ | ❓ | ❓ | ## Quickstart ⚡