2 Commits

Author	SHA1	Message	Date
VED	258ce8d4fa	feat : scaled softmax support (#3338) ... * scaled softmax * comment * lint * remove egear * validation for flash * lint * val imporve + neet * fix correct softmax scale val(learned) * learned scale val 4 ssm * lint * fix model_type rmv * sdpa_atten * test fix + lint * test fix * sdp_a val rmv * flex fix * main flash * lint * flex attn * lint comment * fix score_mod * Update src/axolotl/utils/schemas/validation.py Co-authored-by: NanoCode012 <kevinvong@rocketmail.com> --------- Co-authored-by: Ved <ved.work2024@gmail.com> Co-authored-by: NanoCode012 <kevinvong@rocketmail.com>	2026-01-13 14:33:11 +07:00
NanoCode012	5992e607a2	fix: improve ministral3 docs to be clearer (#3300) ... * fix: improve ministral3 docs to be clearer * fix: title * chore: wording	2025-12-04 21:44:44 +07:00