diff --git a/.nojekyll b/.nojekyll index 4c2dd3dae..5d13f3814 100644 --- a/.nojekyll +++ b/.nojekyll @@ -1 +1 @@ -5b444df2 \ No newline at end of file +e88ec05f \ No newline at end of file diff --git a/docs/api/prompt_strategies.chat_template.html b/docs/api/prompt_strategies.chat_template.html index 23c115eec..cb1066bc0 100644 --- a/docs/api/prompt_strategies.chat_template.html +++ b/docs/api/prompt_strategies.chat_template.html @@ -610,7 +610,8 @@ gtag('config', 'G-9KYCVJBNMQ', { 'anonymize_ip': true}); add_generation_prompt=False, images=None, tools=None, -) + real_last_index=None, +)

Build a prompt from a conversation.

Parameters
diff --git a/search.json b/search.json index 6eb44508f..1a59b4440 100644 --- a/search.json +++ b/search.json @@ -2623,14 +2623,14 @@ "href": "docs/api/prompt_strategies.chat_template.html", "title": "prompt_strategies.chat_template", "section": "", - "text": "prompt_strategies.chat_template\nHF Chat Templates prompt strategy\n\n\n\n\n\nName\nDescription\n\n\n\n\nChatTemplatePrompter\nPrompter for HF chat templates\n\n\nChatTemplateStrategy\nTokenizing strategy for instruction-based prompts.\n\n\nMistralPrompter\nMistral prompter for chat template.\n\n\nMistralStrategy\nMistral strategy for chat template.\n\n\nStrategyLoader\nLoad chat template strategy based on configuration.\n\n\n\n\n\nprompt_strategies.chat_template.ChatTemplatePrompter(\n tokenizer,\n chat_template,\n processor=None,\n max_length=2048,\n message_property_mappings=None,\n message_field_training=None,\n message_field_training_detail=None,\n field_messages='messages',\n field_system='system',\n field_tools='tools',\n field_thinking='reasoning_content',\n roles=None,\n template_thinking_key='reasoning_content',\n chat_template_kwargs=None,\n drop_system_message=False,\n)\nPrompter for HF chat templates\n\n\n\n\n\nName\nDescription\n\n\n\n\nbuild_prompt\nBuild a prompt from a conversation.\n\n\n\n\n\nprompt_strategies.chat_template.ChatTemplatePrompter.build_prompt(\n conversation,\n add_generation_prompt=False,\n images=None,\n tools=None,\n)\nBuild a prompt from a conversation.\n\n\n\n\n\n\n\n\n\n\n\nName\nType\nDescription\nDefault\n\n\n\n\nconversation\nlist[dict]\nA list of messages.\nrequired\n\n\nadd_generation_prompt\n\nWhether to add a generation prompt.\nFalse\n\n\nimages\n\nA list of images. (optional)\nNone\n\n\ntools\n\nA list of tools. (optional)\nNone\n\n\n\n\n\n\n\n\n\nprompt_strategies.chat_template.ChatTemplateStrategy(\n prompter,\n tokenizer,\n train_on_inputs,\n sequence_len,\n roles_to_train=None,\n train_on_eos=None,\n train_on_eot=None,\n eot_tokens=None,\n split_thinking=False,\n)\nTokenizing strategy for instruction-based prompts.\n\n\n\n\n\nName\nDescription\n\n\n\n\nfind_first_eot_token\nFind the first EOT token in the input_ids starting from start_idx.\n\n\nfind_turn\nLocate the starting and ending indices of the specified turn in a conversation.\n\n\ntokenize_prompt\nPublic method that can handle either a single prompt or a batch of prompts.\n\n\n\n\n\nprompt_strategies.chat_template.ChatTemplateStrategy.find_first_eot_token(\n input_ids,\n start_idx,\n)\nFind the first EOT token in the input_ids starting from start_idx.\n\n\n\nprompt_strategies.chat_template.ChatTemplateStrategy.find_turn(\n turns,\n turn_idx,\n tools=None,\n)\nLocate the starting and ending indices of the specified turn in a conversation.\n\n\n\nprompt_strategies.chat_template.ChatTemplateStrategy.tokenize_prompt(prompt)\nPublic method that can handle either a single prompt or a batch of prompts.\n\n\n\n\n\nprompt_strategies.chat_template.MistralPrompter(*args, **kwargs)\nMistral prompter for chat template.\n\n\n\nprompt_strategies.chat_template.MistralStrategy(\n prompter,\n tokenizer,\n train_on_inputs,\n sequence_len,\n roles_to_train=None,\n train_on_eos=None,\n train_on_eot=None,\n eot_tokens=None,\n split_thinking=False,\n)\nMistral strategy for chat template.\n\n\n\n\n\nName\nDescription\n\n\n\n\nfind_first_eot_token\nFind the first EOT token in the input_ids starting from start_idx.\n\n\n\n\n\nprompt_strategies.chat_template.MistralStrategy.find_first_eot_token(\n input_ids,\n start_idx,\n)\nFind the first EOT token in the input_ids starting from start_idx.\n\n\n\n\n\nprompt_strategies.chat_template.StrategyLoader()\nLoad chat template strategy based on configuration." + "text": "prompt_strategies.chat_template\nHF Chat Templates prompt strategy\n\n\n\n\n\nName\nDescription\n\n\n\n\nChatTemplatePrompter\nPrompter for HF chat templates\n\n\nChatTemplateStrategy\nTokenizing strategy for instruction-based prompts.\n\n\nMistralPrompter\nMistral prompter for chat template.\n\n\nMistralStrategy\nMistral strategy for chat template.\n\n\nStrategyLoader\nLoad chat template strategy based on configuration.\n\n\n\n\n\nprompt_strategies.chat_template.ChatTemplatePrompter(\n tokenizer,\n chat_template,\n processor=None,\n max_length=2048,\n message_property_mappings=None,\n message_field_training=None,\n message_field_training_detail=None,\n field_messages='messages',\n field_system='system',\n field_tools='tools',\n field_thinking='reasoning_content',\n roles=None,\n template_thinking_key='reasoning_content',\n chat_template_kwargs=None,\n drop_system_message=False,\n)\nPrompter for HF chat templates\n\n\n\n\n\nName\nDescription\n\n\n\n\nbuild_prompt\nBuild a prompt from a conversation.\n\n\n\n\n\nprompt_strategies.chat_template.ChatTemplatePrompter.build_prompt(\n conversation,\n add_generation_prompt=False,\n images=None,\n tools=None,\n real_last_index=None,\n)\nBuild a prompt from a conversation.\n\n\n\n\n\n\n\n\n\n\n\nName\nType\nDescription\nDefault\n\n\n\n\nconversation\nlist[dict]\nA list of messages.\nrequired\n\n\nadd_generation_prompt\n\nWhether to add a generation prompt.\nFalse\n\n\nimages\n\nA list of images. (optional)\nNone\n\n\ntools\n\nA list of tools. (optional)\nNone\n\n\n\n\n\n\n\n\n\nprompt_strategies.chat_template.ChatTemplateStrategy(\n prompter,\n tokenizer,\n train_on_inputs,\n sequence_len,\n roles_to_train=None,\n train_on_eos=None,\n train_on_eot=None,\n eot_tokens=None,\n split_thinking=False,\n)\nTokenizing strategy for instruction-based prompts.\n\n\n\n\n\nName\nDescription\n\n\n\n\nfind_first_eot_token\nFind the first EOT token in the input_ids starting from start_idx.\n\n\nfind_turn\nLocate the starting and ending indices of the specified turn in a conversation.\n\n\ntokenize_prompt\nPublic method that can handle either a single prompt or a batch of prompts.\n\n\n\n\n\nprompt_strategies.chat_template.ChatTemplateStrategy.find_first_eot_token(\n input_ids,\n start_idx,\n)\nFind the first EOT token in the input_ids starting from start_idx.\n\n\n\nprompt_strategies.chat_template.ChatTemplateStrategy.find_turn(\n turns,\n turn_idx,\n tools=None,\n)\nLocate the starting and ending indices of the specified turn in a conversation.\n\n\n\nprompt_strategies.chat_template.ChatTemplateStrategy.tokenize_prompt(prompt)\nPublic method that can handle either a single prompt or a batch of prompts.\n\n\n\n\n\nprompt_strategies.chat_template.MistralPrompter(*args, **kwargs)\nMistral prompter for chat template.\n\n\n\nprompt_strategies.chat_template.MistralStrategy(\n prompter,\n tokenizer,\n train_on_inputs,\n sequence_len,\n roles_to_train=None,\n train_on_eos=None,\n train_on_eot=None,\n eot_tokens=None,\n split_thinking=False,\n)\nMistral strategy for chat template.\n\n\n\n\n\nName\nDescription\n\n\n\n\nfind_first_eot_token\nFind the first EOT token in the input_ids starting from start_idx.\n\n\n\n\n\nprompt_strategies.chat_template.MistralStrategy.find_first_eot_token(\n input_ids,\n start_idx,\n)\nFind the first EOT token in the input_ids starting from start_idx.\n\n\n\n\n\nprompt_strategies.chat_template.StrategyLoader()\nLoad chat template strategy based on configuration." }, { "objectID": "docs/api/prompt_strategies.chat_template.html#classes", "href": "docs/api/prompt_strategies.chat_template.html#classes", "title": "prompt_strategies.chat_template", "section": "", - "text": "Name\nDescription\n\n\n\n\nChatTemplatePrompter\nPrompter for HF chat templates\n\n\nChatTemplateStrategy\nTokenizing strategy for instruction-based prompts.\n\n\nMistralPrompter\nMistral prompter for chat template.\n\n\nMistralStrategy\nMistral strategy for chat template.\n\n\nStrategyLoader\nLoad chat template strategy based on configuration.\n\n\n\n\n\nprompt_strategies.chat_template.ChatTemplatePrompter(\n tokenizer,\n chat_template,\n processor=None,\n max_length=2048,\n message_property_mappings=None,\n message_field_training=None,\n message_field_training_detail=None,\n field_messages='messages',\n field_system='system',\n field_tools='tools',\n field_thinking='reasoning_content',\n roles=None,\n template_thinking_key='reasoning_content',\n chat_template_kwargs=None,\n drop_system_message=False,\n)\nPrompter for HF chat templates\n\n\n\n\n\nName\nDescription\n\n\n\n\nbuild_prompt\nBuild a prompt from a conversation.\n\n\n\n\n\nprompt_strategies.chat_template.ChatTemplatePrompter.build_prompt(\n conversation,\n add_generation_prompt=False,\n images=None,\n tools=None,\n)\nBuild a prompt from a conversation.\n\n\n\n\n\n\n\n\n\n\n\nName\nType\nDescription\nDefault\n\n\n\n\nconversation\nlist[dict]\nA list of messages.\nrequired\n\n\nadd_generation_prompt\n\nWhether to add a generation prompt.\nFalse\n\n\nimages\n\nA list of images. (optional)\nNone\n\n\ntools\n\nA list of tools. (optional)\nNone\n\n\n\n\n\n\n\n\n\nprompt_strategies.chat_template.ChatTemplateStrategy(\n prompter,\n tokenizer,\n train_on_inputs,\n sequence_len,\n roles_to_train=None,\n train_on_eos=None,\n train_on_eot=None,\n eot_tokens=None,\n split_thinking=False,\n)\nTokenizing strategy for instruction-based prompts.\n\n\n\n\n\nName\nDescription\n\n\n\n\nfind_first_eot_token\nFind the first EOT token in the input_ids starting from start_idx.\n\n\nfind_turn\nLocate the starting and ending indices of the specified turn in a conversation.\n\n\ntokenize_prompt\nPublic method that can handle either a single prompt or a batch of prompts.\n\n\n\n\n\nprompt_strategies.chat_template.ChatTemplateStrategy.find_first_eot_token(\n input_ids,\n start_idx,\n)\nFind the first EOT token in the input_ids starting from start_idx.\n\n\n\nprompt_strategies.chat_template.ChatTemplateStrategy.find_turn(\n turns,\n turn_idx,\n tools=None,\n)\nLocate the starting and ending indices of the specified turn in a conversation.\n\n\n\nprompt_strategies.chat_template.ChatTemplateStrategy.tokenize_prompt(prompt)\nPublic method that can handle either a single prompt or a batch of prompts.\n\n\n\n\n\nprompt_strategies.chat_template.MistralPrompter(*args, **kwargs)\nMistral prompter for chat template.\n\n\n\nprompt_strategies.chat_template.MistralStrategy(\n prompter,\n tokenizer,\n train_on_inputs,\n sequence_len,\n roles_to_train=None,\n train_on_eos=None,\n train_on_eot=None,\n eot_tokens=None,\n split_thinking=False,\n)\nMistral strategy for chat template.\n\n\n\n\n\nName\nDescription\n\n\n\n\nfind_first_eot_token\nFind the first EOT token in the input_ids starting from start_idx.\n\n\n\n\n\nprompt_strategies.chat_template.MistralStrategy.find_first_eot_token(\n input_ids,\n start_idx,\n)\nFind the first EOT token in the input_ids starting from start_idx.\n\n\n\n\n\nprompt_strategies.chat_template.StrategyLoader()\nLoad chat template strategy based on configuration." + "text": "Name\nDescription\n\n\n\n\nChatTemplatePrompter\nPrompter for HF chat templates\n\n\nChatTemplateStrategy\nTokenizing strategy for instruction-based prompts.\n\n\nMistralPrompter\nMistral prompter for chat template.\n\n\nMistralStrategy\nMistral strategy for chat template.\n\n\nStrategyLoader\nLoad chat template strategy based on configuration.\n\n\n\n\n\nprompt_strategies.chat_template.ChatTemplatePrompter(\n tokenizer,\n chat_template,\n processor=None,\n max_length=2048,\n message_property_mappings=None,\n message_field_training=None,\n message_field_training_detail=None,\n field_messages='messages',\n field_system='system',\n field_tools='tools',\n field_thinking='reasoning_content',\n roles=None,\n template_thinking_key='reasoning_content',\n chat_template_kwargs=None,\n drop_system_message=False,\n)\nPrompter for HF chat templates\n\n\n\n\n\nName\nDescription\n\n\n\n\nbuild_prompt\nBuild a prompt from a conversation.\n\n\n\n\n\nprompt_strategies.chat_template.ChatTemplatePrompter.build_prompt(\n conversation,\n add_generation_prompt=False,\n images=None,\n tools=None,\n real_last_index=None,\n)\nBuild a prompt from a conversation.\n\n\n\n\n\n\n\n\n\n\n\nName\nType\nDescription\nDefault\n\n\n\n\nconversation\nlist[dict]\nA list of messages.\nrequired\n\n\nadd_generation_prompt\n\nWhether to add a generation prompt.\nFalse\n\n\nimages\n\nA list of images. (optional)\nNone\n\n\ntools\n\nA list of tools. (optional)\nNone\n\n\n\n\n\n\n\n\n\nprompt_strategies.chat_template.ChatTemplateStrategy(\n prompter,\n tokenizer,\n train_on_inputs,\n sequence_len,\n roles_to_train=None,\n train_on_eos=None,\n train_on_eot=None,\n eot_tokens=None,\n split_thinking=False,\n)\nTokenizing strategy for instruction-based prompts.\n\n\n\n\n\nName\nDescription\n\n\n\n\nfind_first_eot_token\nFind the first EOT token in the input_ids starting from start_idx.\n\n\nfind_turn\nLocate the starting and ending indices of the specified turn in a conversation.\n\n\ntokenize_prompt\nPublic method that can handle either a single prompt or a batch of prompts.\n\n\n\n\n\nprompt_strategies.chat_template.ChatTemplateStrategy.find_first_eot_token(\n input_ids,\n start_idx,\n)\nFind the first EOT token in the input_ids starting from start_idx.\n\n\n\nprompt_strategies.chat_template.ChatTemplateStrategy.find_turn(\n turns,\n turn_idx,\n tools=None,\n)\nLocate the starting and ending indices of the specified turn in a conversation.\n\n\n\nprompt_strategies.chat_template.ChatTemplateStrategy.tokenize_prompt(prompt)\nPublic method that can handle either a single prompt or a batch of prompts.\n\n\n\n\n\nprompt_strategies.chat_template.MistralPrompter(*args, **kwargs)\nMistral prompter for chat template.\n\n\n\nprompt_strategies.chat_template.MistralStrategy(\n prompter,\n tokenizer,\n train_on_inputs,\n sequence_len,\n roles_to_train=None,\n train_on_eos=None,\n train_on_eot=None,\n eot_tokens=None,\n split_thinking=False,\n)\nMistral strategy for chat template.\n\n\n\n\n\nName\nDescription\n\n\n\n\nfind_first_eot_token\nFind the first EOT token in the input_ids starting from start_idx.\n\n\n\n\n\nprompt_strategies.chat_template.MistralStrategy.find_first_eot_token(\n input_ids,\n start_idx,\n)\nFind the first EOT token in the input_ids starting from start_idx.\n\n\n\n\n\nprompt_strategies.chat_template.StrategyLoader()\nLoad chat template strategy based on configuration." }, { "objectID": "docs/api/utils.callbacks.qat.html", diff --git a/sitemap.xml b/sitemap.xml index 1a389c490..6d48aa59b 100644 --- a/sitemap.xml +++ b/sitemap.xml @@ -2,802 +2,802 @@ https://docs.axolotl.ai/src/axolotl/integrations/cut_cross_entropy/ACKNOWLEDGEMENTS.html - 2025-12-08T14:16:36.173Z + 2025-12-09T07:31:12.690Z https://docs.axolotl.ai/docs/mac.html - 2025-12-08T14:16:36.149Z + 2025-12-09T07:31:12.666Z https://docs.axolotl.ai/docs/cli.html - 2025-12-08T14:16:36.144Z + 2025-12-09T07:31:12.662Z https://docs.axolotl.ai/docs/mixed_precision.html - 2025-12-08T14:16:36.149Z + 2025-12-09T07:31:12.666Z https://docs.axolotl.ai/docs/installation.html - 2025-12-08T14:16:36.149Z + 2025-12-09T07:31:12.666Z https://docs.axolotl.ai/docs/dataset_loading.html - 2025-12-08T14:16:36.144Z + 2025-12-09T07:31:12.663Z https://docs.axolotl.ai/docs/sequence_parallelism.html - 2025-12-08T14:16:36.150Z + 2025-12-09T07:31:12.667Z https://docs.axolotl.ai/docs/optimizations.html - 2025-12-08T14:16:36.149Z + 2025-12-09T07:31:12.667Z https://docs.axolotl.ai/docs/gradient_checkpointing.html - 2025-12-08T14:16:36.145Z + 2025-12-09T07:31:12.663Z https://docs.axolotl.ai/docs/docker.html - 2025-12-08T14:16:36.145Z + 2025-12-09T07:31:12.663Z https://docs.axolotl.ai/docs/input_output.html - 2025-12-08T14:16:36.148Z + 2025-12-09T07:31:12.666Z https://docs.axolotl.ai/docs/multi-gpu.html - 2025-12-08T14:16:36.149Z + 2025-12-09T07:31:12.666Z https://docs.axolotl.ai/docs/dataset-formats/template_free.html - 2025-12-08T14:16:36.144Z + 2025-12-09T07:31:12.663Z https://docs.axolotl.ai/docs/dataset-formats/tokenized.html - 2025-12-08T14:16:36.144Z + 2025-12-09T07:31:12.663Z https://docs.axolotl.ai/docs/dataset-formats/pretraining.html - 2025-12-08T14:16:36.144Z + 2025-12-09T07:31:12.663Z https://docs.axolotl.ai/docs/dataset-formats/stepwise_supervised.html - 2025-12-08T14:16:36.144Z + 2025-12-09T07:31:12.663Z https://docs.axolotl.ai/docs/rlhf.html - 2025-12-08T14:16:36.150Z + 2025-12-09T07:31:12.667Z https://docs.axolotl.ai/docs/multi-node.html - 2025-12-08T14:16:36.149Z + 2025-12-09T07:31:12.666Z https://docs.axolotl.ai/docs/batch_vs_grad.html - 2025-12-08T14:16:36.143Z + 2025-12-09T07:31:12.662Z https://docs.axolotl.ai/docs/nd_parallelism.html - 2025-12-08T14:16:36.149Z + 2025-12-09T07:31:12.667Z https://docs.axolotl.ai/docs/fsdp_qlora.html - 2025-12-08T14:16:36.145Z + 2025-12-09T07:31:12.663Z https://docs.axolotl.ai/docs/quantize.html - 2025-12-08T14:16:36.150Z + 2025-12-09T07:31:12.667Z https://docs.axolotl.ai/docs/reward_modelling.html - 2025-12-08T14:16:36.150Z + 2025-12-09T07:31:12.667Z https://docs.axolotl.ai/docs/api/core.chat.format.llama3x.html - 2025-12-08T14:20:16.823Z + 2025-12-09T07:34:48.146Z https://docs.axolotl.ai/docs/api/monkeypatch.unsloth_.html - 2025-12-08T14:20:17.719Z + 2025-12-09T07:34:49.049Z https://docs.axolotl.ai/docs/api/integrations.kd.trainer.html - 2025-12-08T14:20:18.218Z + 2025-12-09T07:34:49.553Z https://docs.axolotl.ai/docs/api/integrations.grokfast.optimizer.html - 2025-12-08T14:20:18.209Z + 2025-12-09T07:34:49.544Z https://docs.axolotl.ai/docs/api/core.chat.format.chatml.html - 2025-12-08T14:20:16.821Z + 2025-12-09T07:34:48.144Z https://docs.axolotl.ai/docs/api/utils.callbacks.perplexity.html - 2025-12-08T14:20:18.344Z + 2025-12-09T07:34:49.680Z https://docs.axolotl.ai/docs/api/utils.callbacks.profiler.html - 2025-12-08T14:20:18.349Z + 2025-12-09T07:34:49.684Z https://docs.axolotl.ai/docs/api/cli.preprocess.html - 2025-12-08T14:20:17.013Z + 2025-12-09T07:34:48.340Z https://docs.axolotl.ai/docs/api/cli.utils.load.html - 2025-12-08T14:20:17.068Z + 2025-12-09T07:34:48.395Z https://docs.axolotl.ai/docs/api/cli.inference.html - 2025-12-08T14:20:16.979Z + 2025-12-09T07:34:48.305Z https://docs.axolotl.ai/docs/api/cli.args.html - 2025-12-08T14:20:16.924Z + 2025-12-09T07:34:48.249Z https://docs.axolotl.ai/docs/api/prompt_tokenizers.html - 2025-12-08T14:20:16.745Z + 2025-12-09T07:34:48.068Z https://docs.axolotl.ai/docs/api/cli.vllm_serve.html - 2025-12-08T14:20:17.027Z + 2025-12-09T07:34:48.354Z https://docs.axolotl.ai/docs/api/monkeypatch.data.batch_dataset_fetcher.html - 2025-12-08T14:20:17.730Z + 2025-12-09T07:34:49.061Z https://docs.axolotl.ai/docs/api/loaders.constants.html - 2025-12-08T14:20:17.213Z + 2025-12-09T07:34:48.540Z https://docs.axolotl.ai/docs/api/prompt_strategies.input_output.html - 2025-12-08T14:20:17.373Z + 2025-12-09T07:34:48.701Z https://docs.axolotl.ai/docs/api/core.trainers.trl.html - 2025-12-08T14:20:17.124Z + 2025-12-09T07:34:48.452Z https://docs.axolotl.ai/docs/api/models.mamba.modeling_mamba.html - 2025-12-08T14:20:18.253Z + 2025-12-09T07:34:49.589Z https://docs.axolotl.ai/docs/api/monkeypatch.stablelm_attn_hijack_flash.html - 2025-12-08T14:20:17.705Z + 2025-12-09T07:34:49.036Z https://docs.axolotl.ai/docs/api/prompt_strategies.alpaca_chat.html - 2025-12-08T14:20:17.317Z + 2025-12-09T07:34:48.645Z https://docs.axolotl.ai/docs/api/prompt_strategies.metharme.html - 2025-12-08T14:20:17.386Z + 2025-12-09T07:34:48.715Z https://docs.axolotl.ai/docs/api/utils.freeze.html - 2025-12-08T14:20:17.805Z + 2025-12-09T07:34:49.136Z https://docs.axolotl.ai/docs/api/logging_config.html - 2025-12-08T14:20:16.757Z + 2025-12-09T07:34:48.080Z https://docs.axolotl.ai/docs/api/monkeypatch.trainer_fsdp_optim.html - 2025-12-08T14:20:17.710Z + 2025-12-09T07:34:49.040Z https://docs.axolotl.ai/docs/api/cli.art.html - 2025-12-08T14:20:16.928Z + 2025-12-09T07:34:48.253Z https://docs.axolotl.ai/docs/api/utils.collators.mamba.html - 2025-12-08T14:20:18.282Z + 2025-12-09T07:34:49.617Z https://docs.axolotl.ai/docs/api/cli.utils.train.html - 2025-12-08T14:20:17.089Z + 2025-12-09T07:34:48.416Z https://docs.axolotl.ai/docs/api/integrations.base.html - 2025-12-08T14:20:18.204Z + 2025-12-09T07:34:49.539Z https://docs.axolotl.ai/docs/api/core.trainers.dpo.trainer.html - 2025-12-08T14:20:17.139Z + 2025-12-09T07:34:48.466Z https://docs.axolotl.ai/docs/api/cli.checks.html - 2025-12-08T14:20:16.935Z + 2025-12-09T07:34:48.261Z https://docs.axolotl.ai/docs/api/common.architectures.html - 2025-12-08T14:20:18.232Z + 2025-12-09T07:34:49.567Z https://docs.axolotl.ai/docs/api/utils.bench.html - 2025-12-08T14:20:17.795Z + 2025-12-09T07:34:49.126Z https://docs.axolotl.ai/docs/api/utils.data.streaming.html - 2025-12-08T14:20:17.900Z + 2025-12-09T07:34:49.232Z https://docs.axolotl.ai/docs/api/utils.chat_templates.html - 2025-12-08T14:20:17.778Z + 2025-12-09T07:34:49.109Z https://docs.axolotl.ai/docs/api/prompt_strategies.alpaca_w_system.html - 2025-12-08T14:20:17.333Z + 2025-12-09T07:34:48.662Z https://docs.axolotl.ai/docs/api/core.trainers.utils.html - 2025-12-08T14:20:17.168Z + 2025-12-09T07:34:48.496Z https://docs.axolotl.ai/docs/api/prompt_strategies.dpo.zephyr.html - 2025-12-08T14:20:17.439Z + 2025-12-09T07:34:48.768Z https://docs.axolotl.ai/docs/api/cli.evaluate.html - 2025-12-08T14:20:16.900Z + 2025-12-09T07:34:48.224Z https://docs.axolotl.ai/docs/api/monkeypatch.relora.html - 2025-12-08T14:20:17.649Z + 2025-12-09T07:34:48.979Z https://docs.axolotl.ai/docs/api/prompt_strategies.dpo.chatml.html - 2025-12-08T14:20:17.437Z + 2025-12-09T07:34:48.766Z https://docs.axolotl.ai/docs/api/cli.utils.fetch.html - 2025-12-08T14:20:17.061Z + 2025-12-09T07:34:48.388Z https://docs.axolotl.ai/docs/api/utils.schemas.datasets.html - 2025-12-08T14:20:17.984Z + 2025-12-09T07:34:49.318Z https://docs.axolotl.ai/docs/api/common.datasets.html - 2025-12-08T14:20:18.252Z + 2025-12-09T07:34:49.587Z https://docs.axolotl.ai/docs/api/utils.callbacks.mlflow_.html - 2025-12-08T14:20:18.355Z + 2025-12-09T07:34:49.691Z https://docs.axolotl.ai/docs/api/prompt_strategies.kto.chatml.html - 2025-12-08T14:20:17.463Z + 2025-12-09T07:34:48.792Z https://docs.axolotl.ai/docs/api/utils.schemas.model.html - 2025-12-08T14:20:17.954Z + 2025-12-09T07:34:49.287Z https://docs.axolotl.ai/docs/api/monkeypatch.llama_attn_hijack_xformers.html - 2025-12-08T14:20:17.641Z + 2025-12-09T07:34:48.971Z https://docs.axolotl.ai/docs/api/monkeypatch.llama_patch_multipack.html - 2025-12-08T14:20:17.698Z + 2025-12-09T07:34:49.029Z https://docs.axolotl.ai/docs/api/core.trainers.base.html - 2025-12-08T14:20:17.106Z + 2025-12-09T07:34:48.434Z https://docs.axolotl.ai/docs/api/cli.utils.args.html - 2025-12-08T14:20:17.055Z + 2025-12-09T07:34:48.381Z https://docs.axolotl.ai/docs/api/utils.schemas.trl.html - 2025-12-08T14:20:17.999Z + 2025-12-09T07:34:49.332Z https://docs.axolotl.ai/docs/api/core.builders.base.html - 2025-12-08T14:20:16.764Z + 2025-12-09T07:34:48.087Z https://docs.axolotl.ai/docs/api/monkeypatch.llama_attn_hijack_flash.html - 2025-12-08T14:20:17.639Z + 2025-12-09T07:34:48.969Z https://docs.axolotl.ai/docs/api/cli.cloud.modal_.html - 2025-12-08T14:20:17.039Z + 2025-12-09T07:34:48.366Z https://docs.axolotl.ai/docs/api/utils.optimizers.adopt.html - 2025-12-08T14:20:17.898Z + 2025-12-09T07:34:49.231Z https://docs.axolotl.ai/docs/api/integrations.spectrum.args.html - 2025-12-08T14:20:18.230Z + 2025-12-09T07:34:49.565Z https://docs.axolotl.ai/docs/api/cli.main.html - 2025-12-08T14:20:16.880Z + 2025-12-09T07:34:48.204Z https://docs.axolotl.ai/docs/api/kernels.lora.html - 2025-12-08T14:20:17.597Z + 2025-12-09T07:34:48.927Z https://docs.axolotl.ai/docs/api/utils.model_shard_quant.html - 2025-12-08T14:20:17.791Z + 2025-12-09T07:34:49.122Z https://docs.axolotl.ai/docs/api/utils.distributed.html - 2025-12-08T14:20:17.882Z + 2025-12-09T07:34:49.215Z https://docs.axolotl.ai/docs/api/loaders.model.html - 2025-12-08T14:20:17.180Z + 2025-12-09T07:34:48.507Z https://docs.axolotl.ai/docs/api/monkeypatch.mistral_attn_hijack_flash.html - 2025-12-08T14:20:17.643Z + 2025-12-09T07:34:48.973Z https://docs.axolotl.ai/docs/api/evaluate.html - 2025-12-08T14:20:16.670Z + 2025-12-09T07:34:47.993Z https://docs.axolotl.ai/docs/api/cli.delinearize_llama4.html - 2025-12-08T14:20:16.962Z + 2025-12-09T07:34:48.288Z https://docs.axolotl.ai/docs/api/utils.trainer.html - 2025-12-08T14:20:17.825Z + 2025-12-09T07:34:49.157Z https://docs.axolotl.ai/docs/api/cli.quantize.html - 2025-12-08T14:20:17.019Z + 2025-12-09T07:34:48.345Z https://docs.axolotl.ai/docs/api/common.const.html - 2025-12-08T14:20:18.234Z + 2025-12-09T07:34:49.569Z https://docs.axolotl.ai/docs/api/prompt_strategies.llama2_chat.html - 2025-12-08T14:20:17.358Z + 2025-12-09T07:34:48.687Z https://docs.axolotl.ai/docs/api/utils.collators.mm_chat.html - 2025-12-08T14:20:18.288Z + 2025-12-09T07:34:49.623Z https://docs.axolotl.ai/docs/api/core.datasets.chat.html - 2025-12-08T14:20:16.831Z + 2025-12-09T07:34:48.154Z https://docs.axolotl.ai/docs/api/prompt_strategies.bradley_terry.llama3.html - 2025-12-08T14:20:17.494Z + 2025-12-09T07:34:48.823Z https://docs.axolotl.ai/docs/api/core.trainers.mamba.html - 2025-12-08T14:20:17.131Z + 2025-12-09T07:34:48.458Z https://docs.axolotl.ai/docs/api/core.builders.causal.html - 2025-12-08T14:20:16.770Z + 2025-12-09T07:34:48.093Z https://docs.axolotl.ai/docs/api/kernels.geglu.html - 2025-12-08T14:20:17.610Z + 2025-12-09T07:34:48.939Z https://docs.axolotl.ai/docs/api/utils.schemas.utils.html - 2025-12-08T14:20:18.040Z + 2025-12-09T07:34:49.373Z https://docs.axolotl.ai/docs/custom_integrations.html - 2025-12-08T14:16:36.144Z + 2025-12-09T07:31:12.662Z https://docs.axolotl.ai/index.html - 2025-12-08T14:16:36.168Z + 2025-12-09T07:31:12.685Z https://docs.axolotl.ai/examples/colab-notebooks/colab-axolotl-example.html - 2025-12-08T14:16:36.155Z + 2025-12-09T07:31:12.671Z https://docs.axolotl.ai/FAQS.html - 2025-12-08T14:16:36.141Z + 2025-12-09T07:31:12.661Z https://docs.axolotl.ai/docs/inference.html - 2025-12-08T14:16:36.148Z + 2025-12-09T07:31:12.666Z https://docs.axolotl.ai/docs/api/core.datasets.transforms.chat_builder.html - 2025-12-08T14:20:16.840Z + 2025-12-09T07:34:48.163Z https://docs.axolotl.ai/docs/api/train.html - 2025-12-08T14:20:16.658Z + 2025-12-09T07:34:47.980Z https://docs.axolotl.ai/docs/api/utils.schemas.training.html - 2025-12-08T14:20:17.963Z + 2025-12-09T07:34:49.296Z https://docs.axolotl.ai/docs/api/kernels.quantize.html - 2025-12-08T14:20:17.631Z + 2025-12-09T07:34:48.961Z https://docs.axolotl.ai/docs/api/utils.dict.html - 2025-12-08T14:20:17.889Z + 2025-12-09T07:34:49.221Z https://docs.axolotl.ai/docs/api/utils.quantization.html - 2025-12-08T14:20:17.930Z + 2025-12-09T07:34:49.263Z https://docs.axolotl.ai/docs/api/utils.collators.batching.html - 2025-12-08T14:20:18.278Z + 2025-12-09T07:34:49.613Z https://docs.axolotl.ai/docs/api/monkeypatch.multipack.html - 2025-12-08T14:20:17.645Z + 2025-12-09T07:34:48.975Z https://docs.axolotl.ai/docs/api/cli.config.html - 2025-12-08T14:20:16.956Z + 2025-12-09T07:34:48.282Z https://docs.axolotl.ai/docs/api/core.trainers.mixins.optimizer.html - 2025-12-08T14:20:17.219Z + 2025-12-09T07:34:48.547Z https://docs.axolotl.ai/docs/api/utils.lora.html - 2025-12-08T14:20:17.784Z + 2025-12-09T07:34:49.115Z https://docs.axolotl.ai/docs/api/core.trainers.grpo.sampler.html - 2025-12-08T14:20:17.166Z + 2025-12-09T07:34:48.494Z https://docs.axolotl.ai/docs/api/prompt_strategies.orcamini.html - 2025-12-08T14:20:17.391Z + 2025-12-09T07:34:48.719Z https://docs.axolotl.ai/docs/api/monkeypatch.mixtral.html - 2025-12-08T14:20:17.732Z + 2025-12-09T07:34:49.062Z https://docs.axolotl.ai/docs/api/prompt_strategies.dpo.llama3.html - 2025-12-08T14:20:17.425Z + 2025-12-09T07:34:48.753Z https://docs.axolotl.ai/docs/api/index.html - 2025-12-08T14:20:16.580Z + 2025-12-09T07:34:47.902Z https://docs.axolotl.ai/docs/api/utils.ctx_managers.sequence_parallel.html - 2025-12-08T14:20:17.260Z + 2025-12-09T07:34:48.587Z https://docs.axolotl.ai/docs/api/cli.utils.html - 2025-12-08T14:20:17.041Z + 2025-12-09T07:34:48.367Z https://docs.axolotl.ai/docs/api/cli.merge_lora.html - 2025-12-08T14:20:16.989Z + 2025-12-09T07:34:48.315Z https://docs.axolotl.ai/docs/api/kernels.utils.html - 2025-12-08T14:20:17.633Z + 2025-12-09T07:34:48.962Z https://docs.axolotl.ai/docs/api/prompt_strategies.base.html - 2025-12-08T14:20:17.261Z + 2025-12-09T07:34:48.589Z https://docs.axolotl.ai/docs/api/utils.callbacks.comet_.html - 2025-12-08T14:20:18.359Z + 2025-12-09T07:34:49.695Z https://docs.axolotl.ai/docs/api/utils.schemas.multimodal.html - 2025-12-08T14:20:18.005Z + 2025-12-09T07:34:49.339Z https://docs.axolotl.ai/docs/api/prompt_strategies.chat_template.html - 2025-12-08T14:20:17.301Z + 2025-12-09T07:34:48.629Z https://docs.axolotl.ai/docs/api/utils.callbacks.qat.html - 2025-12-08T14:20:18.367Z + 2025-12-09T07:34:49.703Z https://docs.axolotl.ai/docs/api/utils.samplers.multipack.html - 2025-12-08T14:20:18.337Z + 2025-12-09T07:34:49.672Z https://docs.axolotl.ai/docs/api/prompt_strategies.orpo.chat_template.html - 2025-12-08T14:20:17.489Z + 2025-12-09T07:34:48.818Z https://docs.axolotl.ai/docs/api/core.chat.format.shared.html - 2025-12-08T14:20:16.825Z + 2025-12-09T07:34:48.148Z https://docs.axolotl.ai/docs/api/utils.collators.core.html - 2025-12-08T14:20:18.255Z + 2025-12-09T07:34:49.590Z https://docs.axolotl.ai/docs/api/integrations.lm_eval.args.html - 2025-12-08T14:20:18.226Z + 2025-12-09T07:34:49.561Z https://docs.axolotl.ai/docs/api/core.trainers.grpo.trainer.html - 2025-12-08T14:20:17.152Z + 2025-12-09T07:34:48.480Z https://docs.axolotl.ai/docs/api/prompt_strategies.dpo.chat_template.html - 2025-12-08T14:20:17.412Z + 2025-12-09T07:34:48.741Z https://docs.axolotl.ai/docs/api/monkeypatch.btlm_attn_hijack_flash.html - 2025-12-08T14:20:17.697Z + 2025-12-09T07:34:49.027Z https://docs.axolotl.ai/docs/api/utils.schemas.enums.html - 2025-12-08T14:20:18.033Z + 2025-12-09T07:34:49.366Z https://docs.axolotl.ai/docs/api/utils.schemas.config.html - 2025-12-08T14:20:17.946Z + 2025-12-09T07:34:49.279Z https://docs.axolotl.ai/docs/api/prompt_strategies.dpo.passthrough.html - 2025-12-08T14:20:17.443Z + 2025-12-09T07:34:48.772Z https://docs.axolotl.ai/docs/api/convert.html - 2025-12-08T14:20:16.694Z + 2025-12-09T07:34:48.017Z https://docs.axolotl.ai/docs/api/utils.schemas.integrations.html - 2025-12-08T14:20:18.022Z + 2025-12-09T07:34:49.356Z https://docs.axolotl.ai/docs/api/prompt_strategies.kto.llama3.html - 2025-12-08T14:20:17.453Z + 2025-12-09T07:34:48.782Z https://docs.axolotl.ai/docs/api/prompt_strategies.dpo.user_defined.html - 2025-12-08T14:20:17.441Z + 2025-12-09T07:34:48.770Z https://docs.axolotl.ai/docs/api/core.trainers.mixins.scheduler.html - 2025-12-08T14:20:17.231Z + 2025-12-09T07:34:48.559Z https://docs.axolotl.ai/docs/api/core.chat.messages.html - 2025-12-08T14:20:16.819Z + 2025-12-09T07:34:48.142Z https://docs.axolotl.ai/docs/api/prompt_strategies.user_defined.html - 2025-12-08T14:20:17.343Z + 2025-12-09T07:34:48.671Z https://docs.axolotl.ai/docs/api/prompt_strategies.messages.chat.html - 2025-12-08T14:20:17.404Z + 2025-12-09T07:34:48.733Z https://docs.axolotl.ai/docs/api/monkeypatch.lora_kernels.html - 2025-12-08T14:20:17.685Z + 2025-12-09T07:34:49.015Z https://docs.axolotl.ai/docs/api/prompt_strategies.stepwise_supervised.html - 2025-12-08T14:20:17.378Z + 2025-12-09T07:34:48.707Z https://docs.axolotl.ai/docs/api/prompt_strategies.completion.html - 2025-12-08T14:20:17.366Z + 2025-12-09T07:34:48.694Z https://docs.axolotl.ai/docs/api/core.trainers.mixins.rng_state_loader.html - 2025-12-08T14:20:17.223Z + 2025-12-09T07:34:48.551Z https://docs.axolotl.ai/docs/api/cli.train.html - 2025-12-08T14:20:16.890Z + 2025-12-09T07:34:48.214Z https://docs.axolotl.ai/docs/api/cli.merge_sharded_fsdp_weights.html - 2025-12-08T14:20:17.003Z + 2025-12-09T07:34:48.330Z https://docs.axolotl.ai/docs/api/loaders.adapter.html - 2025-12-08T14:20:17.198Z + 2025-12-09T07:34:48.526Z https://docs.axolotl.ai/docs/api/core.training_args.html - 2025-12-08T14:20:16.791Z + 2025-12-09T07:34:48.114Z https://docs.axolotl.ai/docs/api/utils.callbacks.lisa.html - 2025-12-08T14:20:18.351Z + 2025-12-09T07:34:49.686Z https://docs.axolotl.ai/docs/api/loaders.processor.html - 2025-12-08T14:20:17.191Z + 2025-12-09T07:34:48.519Z https://docs.axolotl.ai/docs/api/core.builders.rl.html - 2025-12-08T14:20:16.775Z + 2025-12-09T07:34:48.098Z https://docs.axolotl.ai/docs/api/monkeypatch.utils.html - 2025-12-08T14:20:17.695Z + 2025-12-09T07:34:49.025Z https://docs.axolotl.ai/docs/api/prompt_strategies.kto.user_defined.html - 2025-12-08T14:20:17.464Z + 2025-12-09T07:34:48.793Z https://docs.axolotl.ai/docs/api/integrations.cut_cross_entropy.args.html - 2025-12-08T14:20:18.208Z + 2025-12-09T07:34:49.543Z https://docs.axolotl.ai/docs/api/kernels.swiglu.html - 2025-12-08T14:20:17.622Z + 2025-12-09T07:34:48.952Z https://docs.axolotl.ai/docs/api/monkeypatch.gradient_checkpointing.offload_disk.html - 2025-12-08T14:20:17.768Z + 2025-12-09T07:34:49.099Z https://docs.axolotl.ai/docs/api/cli.cloud.base.html - 2025-12-08T14:20:17.031Z + 2025-12-09T07:34:48.358Z https://docs.axolotl.ai/docs/api/prompt_strategies.alpaca_instruct.html - 2025-12-08T14:20:17.319Z + 2025-12-09T07:34:48.647Z https://docs.axolotl.ai/docs/api/prompt_strategies.pygmalion.html - 2025-12-08T14:20:17.399Z + 2025-12-09T07:34:48.728Z https://docs.axolotl.ai/docs/api/utils.schemas.peft.html - 2025-12-08T14:20:17.995Z + 2025-12-09T07:34:49.328Z https://docs.axolotl.ai/docs/api/integrations.liger.args.html - 2025-12-08T14:20:18.222Z + 2025-12-09T07:34:49.557Z https://docs.axolotl.ai/docs/api/loaders.patch_manager.html - 2025-12-08T14:20:17.211Z + 2025-12-09T07:34:48.538Z https://docs.axolotl.ai/docs/api/monkeypatch.transformers_fa_utils.html - 2025-12-08T14:20:17.717Z + 2025-12-09T07:34:49.048Z https://docs.axolotl.ai/docs/api/utils.data.sft.html - 2025-12-08T14:20:17.907Z + 2025-12-09T07:34:49.240Z https://docs.axolotl.ai/docs/api/monkeypatch.gradient_checkpointing.offload_cpu.html - 2025-12-08T14:20:17.736Z + 2025-12-09T07:34:49.067Z https://docs.axolotl.ai/docs/api/monkeypatch.llama_expand_mask.html - 2025-12-08T14:20:17.651Z + 2025-12-09T07:34:48.981Z https://docs.axolotl.ai/docs/api/loaders.tokenizer.html - 2025-12-08T14:20:17.190Z + 2025-12-09T07:34:48.517Z https://docs.axolotl.ai/docs/api/utils.tokenization.html - 2025-12-08T14:20:17.776Z + 2025-12-09T07:34:49.107Z https://docs.axolotl.ai/docs/api/datasets.html - 2025-12-08T14:20:16.678Z + 2025-12-09T07:34:48.001Z https://docs.axolotl.ai/docs/api/cli.utils.sweeps.html - 2025-12-08T14:20:17.075Z + 2025-12-09T07:34:48.402Z https://docs.axolotl.ai/docs/api/utils.schedulers.html - 2025-12-08T14:20:17.858Z + 2025-12-09T07:34:49.190Z https://docs.axolotl.ai/docs/optimizers.html - 2025-12-08T14:16:36.150Z + 2025-12-09T07:31:12.667Z https://docs.axolotl.ai/docs/torchao.html - 2025-12-08T14:16:36.150Z + 2025-12-09T07:31:12.667Z https://docs.axolotl.ai/docs/dataset_preprocessing.html - 2025-12-08T14:16:36.145Z + 2025-12-09T07:31:12.663Z https://docs.axolotl.ai/docs/faq.html - 2025-12-08T14:16:36.145Z + 2025-12-09T07:31:12.663Z https://docs.axolotl.ai/docs/ray-integration.html - 2025-12-08T14:16:36.150Z + 2025-12-09T07:31:12.667Z https://docs.axolotl.ai/docs/multimodal.html - 2025-12-08T14:16:36.149Z + 2025-12-09T07:31:12.666Z https://docs.axolotl.ai/docs/config-reference.html - 2025-12-08T14:20:32.647Z + 2025-12-09T07:35:04.120Z https://docs.axolotl.ai/docs/dataset-formats/index.html - 2025-12-08T14:16:36.144Z + 2025-12-09T07:31:12.663Z https://docs.axolotl.ai/docs/dataset-formats/inst_tune.html - 2025-12-08T14:16:36.144Z + 2025-12-09T07:31:12.663Z https://docs.axolotl.ai/docs/dataset-formats/conversation.html - 2025-12-08T14:16:36.144Z + 2025-12-09T07:31:12.662Z https://docs.axolotl.ai/docs/debugging.html - 2025-12-08T14:16:36.145Z + 2025-12-09T07:31:12.663Z https://docs.axolotl.ai/docs/amd_hpc.html - 2025-12-08T14:16:36.143Z + 2025-12-09T07:31:12.662Z https://docs.axolotl.ai/docs/lora_optims.html - 2025-12-08T14:16:36.149Z + 2025-12-09T07:31:12.666Z https://docs.axolotl.ai/docs/streaming.html - 2025-12-08T14:16:36.150Z + 2025-12-09T07:31:12.667Z https://docs.axolotl.ai/docs/multipack.html - 2025-12-08T14:16:36.149Z + 2025-12-09T07:31:12.666Z https://docs.axolotl.ai/docs/qat.html - 2025-12-08T14:16:36.150Z + 2025-12-09T07:31:12.667Z https://docs.axolotl.ai/docs/lr_groups.html - 2025-12-08T14:16:36.149Z + 2025-12-09T07:31:12.666Z https://docs.axolotl.ai/docs/getting-started.html - 2025-12-08T14:16:36.145Z + 2025-12-09T07:31:12.663Z https://docs.axolotl.ai/docs/nccl.html - 2025-12-08T14:16:36.149Z + 2025-12-09T07:31:12.667Z https://docs.axolotl.ai/docs/telemetry.html - 2025-12-08T14:16:36.150Z + 2025-12-09T07:31:12.667Z https://docs.axolotl.ai/docs/unsloth.html - 2025-12-08T14:16:36.151Z + 2025-12-09T07:31:12.667Z https://docs.axolotl.ai/src/axolotl/integrations/LICENSE.html - 2025-12-08T14:16:36.173Z + 2025-12-09T07:31:12.689Z