diff --git a/.nojekyll b/.nojekyll index f7e10d058..0892b5282 100644 --- a/.nojekyll +++ b/.nojekyll @@ -1 +1 @@ -ef64af50 \ No newline at end of file +7ef13619 \ No newline at end of file diff --git a/docs/api/loaders.patch_manager.html b/docs/api/loaders.patch_manager.html index 79975b4fb..14f4fb75f 100644 --- a/docs/api/loaders.patch_manager.html +++ b/docs/api/loaders.patch_manager.html @@ -588,9 +588,17 @@ gtag('config', 'G-9KYCVJBNMQ', { 'anonymize_ip': true}); Apply post plugin-pre_model_load load patches based on config. +apply_pre_config_load_patches +Apply patches that must be set up before config loading. + + apply_pre_model_load_patches Apply pre-model load patches based on config. + +apply_pre_tokenizer_load_patches +Apply patches that must be set up before tokenizer loading. +
@@ -603,10 +611,77 @@ gtag('config', 'G-9KYCVJBNMQ', { 'anonymize_ip': true}); 
loaders.patch_manager.PatchManager.apply_post_plugin_pre_model_load_patches()

Apply post plugin-pre_model_load load patches based on config.

+
+
apply_pre_config_load_patches
+
loaders.patch_manager.PatchManager.apply_pre_config_load_patches(cfg)
+

Apply patches that must be set up before config loading. +This is for patches that intercept remote code loading from HuggingFace, +which needs to be in place before AutoConfig.from_pretrained() is called.

+
+
Parameters
+ ++++++ + + + + + + + + + + + + + + + + +
NameTypeDescriptionDefault
cfgDictDefaultConfiguration dictionary with model and training settings.required
+
+
apply_pre_model_load_patches
-
loaders.patch_manager.PatchManager.apply_pre_model_load_patches()
+
loaders.patch_manager.PatchManager.apply_pre_model_load_patches()

Apply pre-model load patches based on config.

+
+
+
apply_pre_tokenizer_load_patches
+
loaders.patch_manager.PatchManager.apply_pre_tokenizer_load_patches(cfg)
+

Apply patches that must be set up before tokenizer loading. +This is for patches that intercept remote code loading from HuggingFace, +which needs to be in place before AutoTokenizer.from_pretrained() is called.

+
+
Parameters
+ ++++++ + + + + + + + + + + + + + + + + +
NameTypeDescriptionDefault
cfgDictDefaultConfiguration dictionary with model and training settings.required
@@ -614,6 +689,7 @@ gtag('config', 'G-9KYCVJBNMQ', { 'anonymize_ip': true});
+