tocmo0nlord/axolotl
1
0
Fork 0
Code Issues Pull Requests Actions 2 Packages Projects Releases Wiki Activity

suport sampling params/max new tokens

Browse Source
This commit is contained in:
Wing Lian
2025-05-25 17:00:12 -04:00
parent 505009b454
commit 9899c924f9
1 changed files with 3 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

3
src/axolotl/integrations/kd/collator_online_teacher.py
View File

@@ -231,6 +231,9 @@ class OnlineTeacherCollator(KDBatchSamplerDataCollatorForSeq2Seq):
"max_new_tokens": 0, "max_new_tokens": 0,
"skip_special_tokens": False, "skip_special_tokens": False,
"temperature": self.kd_temperature, "temperature": self.kd_temperature,
"sampling_params": {
"max_tokens": 0,
},
} }
# Initialize with empty lists, so if API call fails, these are returned. # Initialize with empty lists, so if API call fails, these are returned.