tocmo0nlord/axolotl
1
0
Fork 0
Code Issues Pull Requests Actions 2 Packages Projects Releases Wiki Activity
Files
f083aed2c79ade03b4680a6908452a3e72bc3045
axolotl/docs/mac.md
Maxime 0f6af36d50 Mps mistral lora (#1292) [skip ci] 
* Lora example for Mistral on MPS backend

* Add some MPS documentation

* Update examples/mistral/lora-mps.yml

Co-authored-by: NanoCode012 <kevinvong@rocketmail.com>

* Update examples/mistral/lora-mps.yml

Co-authored-by: NanoCode012 <kevinvong@rocketmail.com>

* Update README.md

---------

Co-authored-by: NanoCode012 <kevinvong@rocketmail.com>
Co-authored-by: Wing Lian <wing.lian@gmail.com>
2024-02-26 22:39:57 -05:00

567 B
Raw Blame History

Mac M series support

Currently Axolotl on Mac is partially usable, many of the dependencies of Axolotl including Pytorch do not support MPS or have incomplete support.

Current support:

  • Support for all models
  • Full training of models
  • LoRA training
  • Sample packing
  • FP16 and BF16 (awaiting AMP support for MPS in Pytorch)
  • Tri-dao's flash-attn (until it is supported use spd_attention as an alternative)
  • xformers
  • bitsandbytes (meaning no 4/8 bits loading and bnb optimizers)
  • qlora
  • DeepSpeed

Untested:

  • FSDP
Reference in New Issue View Git Blame Copy Permalink