2 Commits

Author	SHA1	Message	Date
Wing Lian	ac77da96da	use smaller pretrained models for ci (#3620) [skip ci] ... * use smaller pretrained models for ci * more steps for loss check * fix tests * more train steps * fix losses	2026-04-27 13:22:56 -04:00
Wing Lian	b3289fd190	feat: LoRA kernel support for bias, dropout, dora, embeddings (#3528) [skip ci] ... * feat: LoRA kernel support for bias, dropout, dora, embeddings * chore: lint * chore: lint * address PR feedback, add regression tests, add fsdp2 tests for lora kernels * update tests for new sigs * update tests now that bias and dropout are supported	2026-03-22 13:53:19 -04:00