DavidFarago 559562d790 Allow "weight: 0" in messages to mask them (#1703) ...

Allow in message objects the additional key `weight`, which can be set
to 0 (or 1) to cause that message to be masked out (or left unmasked)
for training (similar to [1]). This is helpful for training the model to be robust and
capable of error recovery upon a bad assistant message.
A missing `weight` key defaults to weight 1, to guarantee downward compatibility.

[1]: https://github.com/mistralai/mistral-finetune

2024-06-20 10:05:16 -04:00

..

test_alpaca.py

fix broken linting (#1541)

2024-04-19 01:03:04 -04:00

test_chat_templates.py

Generalizing the chat_template prompt strategy (#1660) [skip ci]

2024-05-28 11:24:13 -04:00

test_raw_io.py

fix broken linting (#1541)

2024-04-19 01:03:04 -04:00

test_sharegpt.py

Allow "weight: 0" in messages to mask them (#1703)

2024-06-20 10:05:16 -04:00