Files
axolotl/tests
DavidFarago 559562d790 Allow "weight: 0" in messages to mask them (#1703)
Allow in message objects the additional key `weight`, which can be set
to 0 (or 1) to cause that message to be masked out (or left unmasked)
for training (similar to [1]). This is helpful for training the model to be robust and
capable of error recovery upon a bad assistant message.
A missing `weight` key defaults to weight 1, to guarantee downward compatibility.

[1]: https://github.com/mistralai/mistral-finetune
2024-06-20 10:05:16 -04:00
..
2024-04-19 17:25:36 -04:00
2024-06-04 16:09:51 -04:00
2024-02-26 12:24:14 -05:00
2024-05-20 16:05:16 -04:00