Wing Lian 20620771f1 Pretrain multipack (#2278) ...

* fix for pretrain with packing

* fix model name and loss expected

* make sure to check with micro batch size for pretraining

* change loss threshholds based on parametrization

* make tests smaller for CI

* fix pretrain packing

* fix pretrain packing test

* address pr feedback

2025-01-24 12:55:20 -05:00

3.0 KiB

Raw Blame History

View Raw