2 Commits

Author	SHA1	Message	Date
NanoCode012	a48dbf6561	fix: remove FA for qwen examples (#900) ... * fix: remove FA for qwen lora * fix: remove FA for qlora	2023-11-27 21:23:54 +09:00
NanoCode012	1115c501b8	Feat: Add Qwen (#894) ... * Feat: Add Qwen * feat: add qwen lora example * feat: update matrix * fix: add trust_remote_code * fix: disable gradient checkpointing * chore: add warning about gradient checkpointing * fix: config * fix: turn off sample packing for this example and reduce seq len * chore: add comment on seq len	2023-11-26 00:05:01 +09:00