Wing Lian 59899b9817 pass additional info for fix untrained tokens when using distributed + offloading (#2388) ...

* pass additional info for fix untrained tokens when using distributed + offloading

* use latest version of vendored lib

* use v0.0.5 of contribs lgpl

* fix for no bad tokens and add tests

* use release

* add multigpu test too

* make sure the multigpu zero3 test actually uses zero3

2025-03-11 12:02:43 -04:00

..

__init__.py

Attempt to run multigpu in PR CI for now to ensure it works (#1815) [skip ci]

2024-08-09 11:50:13 -04:00

test_eval.py

replace tensorboard checks with helper function (#2120) [skip ci]

2024-12-03 21:06:20 -05:00

test_grpo.py

GRPO (#2307)

2025-02-13 16:01:01 -05:00

test_llama.py

pass additional info for fix untrained tokens when using distributed + offloading (#2388)

2025-03-11 12:02:43 -04:00

test_qwen2.py

updating to fused (#2293)

2025-01-30 11:45:56 -05:00

test_ray.py

disable ray tests for latest torch release (#2328)

2025-02-12 18:29:02 -05:00