Wing Lian a236f5eab5 add support for 4bit optimizers

2024-03-19 22:57:40 -04:00

..

images

support for true batches with multipack (#1230)

2024-02-01 10:18:42 -05:00

debugging.md

Update debugging.md (#1339) [skip ci]

2024-02-27 15:47:31 +09:00

faq.md

feat(doc): add dummyoptim faq fix (#802)

2023-10-29 23:06:06 +09:00

fsdp_qlora.md

Add QLoRA + FSDP Docs (#1403)

2024-03-14 11:04:51 -04:00

input_output.md

add docs for input_output format (#1367) [skip ci]

2024-03-06 09:09:49 -05:00

mac.md

Mps mistral lora (#1292) [skip ci]

2024-02-26 22:39:57 -05:00

multi-node.md

Create multi-node.md (#613)

2023-09-20 22:02:16 -04:00

multipack.md

support for true batches with multipack (#1230)

2024-02-01 10:18:42 -05:00

nccl.md

Adding NCCL Timeout Guide (#536)

2023-09-08 11:57:47 -04:00

optimizers.md

add support for 4bit optimizers

2024-03-19 22:57:40 -04:00

rlhf.md

ORPO (#1419)

2024-03-18 13:10:00 -04:00