diff --git a/.nojekyll b/.nojekyll index e6e5fa901..916320585 100644 --- a/.nojekyll +++ b/.nojekyll @@ -1 +1 @@ -1f4d504e \ No newline at end of file +2350d419 \ No newline at end of file diff --git a/docs/multimodal.html b/docs/multimodal.html index a52e36bd5..57779810d 100644 --- a/docs/multimodal.html +++ b/docs/multimodal.html @@ -442,6 +442,7 @@ pre > code.sourceCode > span > a:first-child::before { text-decoration: underlin
base_model: meta-llama/Llama-4-Scout-17B-16E-Instruct
+
+chat_template: llama4base_model: mistralai/Pixtral-12B-2409
-
-chat_template: pixtralbase_model: mistralai/Pixtral-12B-2409
+
+chat_template: pixtralbase_model: llava-hf/llava-1.5-7b-hf
-
-chat_template: llavabase_model: llava-hf/llava-1.5-7b-hf
+
+chat_template: llavabase_model: mistralai/Mistral-Small-3.1-24B-Instruct-2503
-
-chat_template: mistral_v7_tekkenbase_model: mistralai/Mistral-Small-3.1-24B-Instruct-2503
+
+chat_template: mistral_v7_tekkenFor multi-modal 4B/12B/27B models, use the following config:
-base_model: google/gemma-3-4b-it
-
-chat_template: gemma3base_model: google/gemma-3-4b-it
+
+chat_template: gemma3base_model: Qwen/Qwen2-VL-7B-Instruct
-
-chat_template: qwen2_vlbase_model: Qwen/Qwen2-VL-7B-Instruct
+
+chat_template: qwen2_vlbase_model: Qwen/Qwen2.5-VL-7B-Instruct
-
-chat_template: qwen2_vl # same as qwen2-vlbase_model: Qwen/Qwen2.5-VL-7B-Instruct
+
+chat_template: qwen2_vl # same as qwen2-vlHere is an example of a multi-modal dataset:
-[
- {
- "messages": [
- {
- "role": "system",
- "content": [
- {"type": "text", "text": "You are a helpful assistant."}
- ]
- },
- {
- "role": "user",
- "content": [
- {"type": "image", "image": "https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/bee.jpg"},
- {"type": "text", "text": "Describe this image in detail."}
- ]
- },
- {
- "role": "assistant",
- "content": [
- {"type": "text", "text": "The image is a bee."}
- ]
- }
- ]
- }
-][
+ {
+ "messages": [
+ {
+ "role": "system",
+ "content": [
+ {"type": "text", "text": "You are a helpful assistant."}
+ ]
+ },
+ {
+ "role": "user",
+ "content": [
+ {"type": "image", "image": "https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/bee.jpg"},
+ {"type": "text", "text": "Describe this image in detail."}
+ ]
+ },
+ {
+ "role": "assistant",
+ "content": [
+ {"type": "text", "text": "The image is a bee."}
+ ]
+ }
+ ]
+ }
+]