VED a6080df73c compute loss only if training and update token metric naming (#3293) [skip ci] ...

* compute loss only if training

* save total_tokens for checkpiont

* check if string

* refactor total_tokens/ num_tokens

* refactor 2

* rplc trainable_step/trian_per_sec_per_gpu

* lint + log trainable/tokens

* consolidate it in the callback.

* test for total_tokes aftr remuse

* check if tokenstate exist after ckpt

---------

Co-authored-by: Ved <ved.work2024@gmail.com>

2025-12-25 18:38:17 +07:00

4.2 KiB

Raw Blame History

View Raw