Fix: Cannot tokenize with bf16 and on cpu (#766)

This commit is contained in:
NanoCode012
2023-10-23 01:32:26 +09:00
committed by GitHub
parent 9923b72649
commit afedc470bd

View File

@@ -819,7 +819,7 @@ accelerate launch -m axolotl.cli.train your_config.yml
You can optionally pre-tokenize dataset with the following before finetuning:
```bash
CUDA_VISIBLE_DEVICES="" accelerate launch -m axolotl.cli.train your_config.yml --prepare_ds_only
CUDA_VISIBLE_DEVICES=0 accelerate launch -m axolotl.cli.train your_config.yml --prepare_ds_only
```
##### Config