Jan Philipp Harries 2f586d18db Fix pretraining with iterable/streaming Dataset (#556) ...

* return without packing prep/len

* fix remove columns

* fix encode arguments

* add error when max steps not set

* fix test

---------

Co-authored-by: Jan Philipp Harries <jphme@users.noreply.github.com>

2023-09-13 00:16:40 -04:00

2.2 KiB

Raw Blame History

View Raw