tocmo0nlord/axolotl
1
0
Fork 0
Code Issues Pull Requests Actions 2 Packages Projects Releases Wiki Activity

fix inference when no chat_template is set, fix unsloth dora check (#2092)

Browse Source 
* fix inference when no chat_template is set, fix unsloth dora check

* remove old unsloth version check

* update docs on installing unsloth
This commit is contained in:
Wing Lian
2024-11-20 14:07:54 -05:00
committed by GitHub
parent 68a26f1005
commit 2e99bb303e
5 changed files with 46 additions and 24 deletions
Download Patch File Download Diff File Expand all files Collapse all files

6
docs/unsloth.qmd
View File

@@ -11,12 +11,10 @@ standard industry baselines.
### Installation
The following will install unsloth from source and downgrade xformers as unsloth is incompatible with the most up
to date libraries.
The following will install the correct unsloth and extras from source.
```bash
pip install --no-deps "unsloth @ git+https://github.com/unslothai/unsloth.git"
pip install --no-deps --force-reinstall xformers==0.0.26.post1
python scripts/unsloth_install.py | sh
```
### Using unsloth w Axolotl