+
+
+Conversation
+
+
+
+
+
+
+
+
+
+ Conversation format for supervised fine-tuning.
+
+Formats
+ +pygmalion
+
+
+
+
+
+data.jsonl+
{"conversations": [{"role": "...", "value": "..."}]}How to add custom prompts for instruction-tuning
+For a dataset that is preprocessed for instruction purposes:
+
+
+
+
+
+data.jsonl+
{"input": "...", "output": "..."}You can use this example in your YAML config:
+
+
+
+
+
+config.yaml+
datasets:
+ - path: repo
+ type:
+ system_prompt: ""
+ field_system: system
+ field_instruction: input
+ field_output: output
+ format: "[INST] {instruction} [/INST]"
+ no_input_format: "[INST] {instruction} [/INST]"See full config options under here.
+ + +