Feat(doc): Add features to doc (#583)

This commit is contained in:
NanoCode012
2023-09-16 01:14:15 +09:00
committed by GitHub
parent f7a22632d7
commit 3a2edc85c3

View File

@@ -2,6 +2,18 @@
Axolotl is a tool designed to streamline the fine-tuning of various AI models, offering support for multiple configurations and architectures.
Features:
- Train various Huggingface models such as llama, pythia, falcon, mpt
- Supports fullfinetune, lora, qlora, relora, and gptq
- Customize configurations using a simple yaml file or CLI overwrite
- Load different dataset formats, use custom formats, or bring your own tokenized datasets
- Integrated with xformer, flash attention, rope scaling, and multipacking
- Works with single GPU or multiple GPUs via FSDP or Deepspeed
- Easily run with Docker locally or on the cloud
- Log results and optionally checkpoints to wandb
- And more!
<table>
<tr>
<td>