diff --git a/README.md b/README.md index 87251f70a..ff4cb1076 100644 --- a/README.md +++ b/README.md @@ -1,6 +1,15 @@ -~~# Axolotl +# Axolotl + +#### Go ahead and axolotl questions + +## Support Matrix + +| | fp16/fp32 | fp16/fp32 w/ lora | 4bit-quant | 4bit-quant w/flash attention | flash attention | xformers attention | +|----------|:----------|:------------------|------------|------------------------------|-----------------|--------------------| +| llama | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | +| Pythia | ✅ | ✅ | ❌ | ❌ | ❌ | ❓ | +| cerebras | ✅ | ✅ | ❌ | ❌ | ❌ | ❓ | -#### You know you're going to axolotl questions ## Getting Started