3 Commits

Author	SHA1	Message	Date
Alpay Ariyak	ab461d83c4	Fix documentation for pre-tokenized dataset (#1894) ... It's currently asking to not add BOS and EOS, stating that Axolotl adds them, but this is not true	2024-09-05 23:11:31 +09:00
Josh Bleecher Snyder	f2480a1d91	improve Pre-Tokenized Dataset docs (#1684) [skip ci] ... Fixes #1661	2024-06-26 13:13:21 -07:00
Hamel Husain	86b7d22f35	Reorganize Docs (#1468)	2024-04-01 08:00:52 -07:00