3 Commits

Author	SHA1	Message	Date
Wing Lian	cada93cee5	upgrade transformers==5.3.0 trl==0.29.0 kernels (#3459) ... * upgrade transformers==5.3.0 trl==0.29.0 kernels * use latest deepspeed fixes * use corect image for cleanup * fix test outputs for tokenizer fixes upstream * fix import: * keep trl at 0.28.0 * handle updated API * use latest trl since 0.28.0 doesn't work with latest transformers * use trl experimental for pad to length * monkeypatch trl with ORPOTrainer so liger doesn't croak * upgrade accelerate * more fixes * move patch for orpotrainer * load the imports later * remove use_logits_to_keep * fix loss_type arg as a list * fetch hf cache from s3 * just manually download the missing model for now * lint for pre-commit update * a few more missing models on disk * fix: loss_type internally now list * fix: remove deprecated code and raise deprecate * fix: remove unneeded blocklist * fix: remove reliance on transformers api to find package available * chore: refactor shim for less sideeffect * fix: silent trl experimental warning --------- Co-authored-by: NanoCode012 <nano@axolotl.ai>	2026-03-06 09:11:20 -05:00
NanoCode012	4e22cf0651	fix: remove telemetry warning (#3397) [skip ci]	2026-02-10 23:01:16 +07:00
NanoCode012	4e55871112	feat: Add opt-out Telemetry (#3237) ... * initial telemetry manager impl * adding todo * updates * updates * progress on telemetry: config load, process, model load, train start / end, error tracking * update error file path sanitization function; adding more error tracking * updated sanitization logic, tests * adding runtime metrics (cpu + gpu memory, steps/s, etc.) * tests for runtime metrics telemetry and assoc. callback * small update / fix * simplifying path redaction * sleep on all ranks in distributed setting * adding back in base_model redaction w/ whitelist * fix * doc update * improved redaction, send system info during model config load telemetry, etc. * adding runtime metrics / system info additional accelerator support, etc. * adding runtime metrics / system info additional accelerator support, etc. * remove duplicate info * fixes * fix issue with tests in ci * distributed fix * opt-in version of telemetry * enable / disable logic update * docs fix * doc update * minor fixes * simplifying * slight changes * fix * lint * update posthog dep * coderabbit comments * fix: opt-in model * fix: increase time since last * fix: increase whitelist orgs * fix: posthog init and shutdown * fix: imports * fix: also check grad norm * fix: duplicate plugin_manager calls * fix: bad merge * chore: update docs * fix: cache process per comment * fix: error handling * fix: tests * Revert "fix: error handling" This reverts commit 22d1ea5755. * fix: test telemetry error_handled bool * fix: revert test * chore: final doc fixes --------- Co-authored-by: Dan Saunders <danjsaund@gmail.com> Co-authored-by: Dan Saunders <dan@axolotl.ai>	2025-11-18 11:35:25 +07:00