2efe1b4c09
* feat(doc): organize docs, add to menu bar, fix broken formatting * feat: add link to custom integrations * feat: update readme for integrations to include citations and repo link * chore: update lm_eval info * chore: use fullname * Update docs/cli.qmd per suggestion Co-authored-by: Dan Saunders <danjsaund@gmail.com> * feat: add sweep doc * feat: add kd doc * fix: remove toc * fix: update deprecation * feat: add more info about chat_template issues * fix: heading level * fix: shell->bash code block * fix: ray link * fix(doc): heading level, header links, formatting * feat: add grpo docs * feat: add style changes * fix: wrong cli arg for lm-eval * fix: remove old run method * feat: load custom integration doc dynamically * fix: remove old cli way * fix: toc * fix: minor formatting --------- Co-authored-by: Dan Saunders <danjsaund@gmail.com>
26 lines
731 B
Plaintext
26 lines
731 B
Plaintext
---
|
|
title: "PyTorch ao"
|
|
description: "Custom data types and layouts for training and inference"
|
|
---
|
|
|
|
To use experimental optimizers (`AdamWFp8`, `AdamW4bit`, `AdamW8bit`) from Pytorch Ao, please install the package as shown below.
|
|
|
|
::: {.callout-tip}
|
|
Some experimental optimizers are already present in regular Pytorch, so please re-check if you actually need this package!
|
|
:::
|
|
|
|
### Installation
|
|
|
|
Stable Release from the PyTorch index
|
|
|
|
```bash
|
|
pip install torchao --extra-index-url https://download.pytorch.org/whl/cu121 # full options are cpu/cu118/cu121/cu124
|
|
```
|
|
|
|
|
|
Nightly release
|
|
|
|
```bash
|
|
pip install --pre torchao-nightly --index-url https://download.pytorch.org/whl/nightly/cu121 # full options are cpu/cu118/cu121/cu124
|
|
```
|