NanoCode012 cba5a457d9 fix: use text_column even when not packing for pretraining (#2254) ...

* fix: use text_column even when not packing for pretraining

* feat: update test to check when not packing

* chore: lint

* Update src/axolotl/utils/data/pretraining.py

Co-authored-by: Wing Lian <wing.lian@gmail.com>

---------

Co-authored-by: Wing Lian <wing@axolotl.ai>
Co-authored-by: Wing Lian <wing.lian@gmail.com>

2025-01-14 22:08:56 -05:00

2.0 KiB

Raw Blame History

View Raw