Feat(doc): Add features to doc (#583)
This commit is contained in:
12
README.md
12
README.md
@@ -2,6 +2,18 @@
|
|||||||
|
|
||||||
Axolotl is a tool designed to streamline the fine-tuning of various AI models, offering support for multiple configurations and architectures.
|
Axolotl is a tool designed to streamline the fine-tuning of various AI models, offering support for multiple configurations and architectures.
|
||||||
|
|
||||||
|
Features:
|
||||||
|
- Train various Huggingface models such as llama, pythia, falcon, mpt
|
||||||
|
- Supports fullfinetune, lora, qlora, relora, and gptq
|
||||||
|
- Customize configurations using a simple yaml file or CLI overwrite
|
||||||
|
- Load different dataset formats, use custom formats, or bring your own tokenized datasets
|
||||||
|
- Integrated with xformer, flash attention, rope scaling, and multipacking
|
||||||
|
- Works with single GPU or multiple GPUs via FSDP or Deepspeed
|
||||||
|
- Easily run with Docker locally or on the cloud
|
||||||
|
- Log results and optionally checkpoints to wandb
|
||||||
|
- And more!
|
||||||
|
|
||||||
|
|
||||||
<table>
|
<table>
|
||||||
<tr>
|
<tr>
|
||||||
<td>
|
<td>
|
||||||
|
|||||||
Reference in New Issue
Block a user