tocmo0nlord/axolotl
1
0
Fork 0
Code Issues Pull Requests Actions 3 Packages Projects Releases Wiki Activity

hint to what AMP means

Browse Source
This commit is contained in:
Wing Lian
2023-06-15 02:06:27 -04:00
parent 88e17ffc50
commit d7635b7148
1 changed files with 1 additions and 1 deletions
Download Patch File Download Diff File Expand all files Collapse all files

2
README.md
View File

@@ -264,7 +264,7 @@ See sample configs in [configs](configs) folder or [examples](examples) for quic
bf16: true # require >=ampere bf16: true # require >=ampere
fp16: true fp16: true
tf32: true # require >=ampere tf32: true # require >=ampere
bfloat16: true # require >=ampere, use instead of bf16 when you don't want AMP bfloat16: true # require >=ampere, use instead of bf16 when you don't want AMP (automatic mixed precision)
float16: true # use instead of fp16 when you don't want AMP float16: true # use instead of fp16 when you don't want AMP
``` ```
Note: Repo does not do 4-bit quantization. Note: Repo does not do 4-bit quantization.