tocmo0nlord/axolotl
1
0
Fork 0
Code Issues Pull Requests Actions 2 Packages Projects Releases Wiki Activity

Add seq length

Browse Source
This commit is contained in:
NanoCode012
2023-05-25 09:50:43 +09:00
parent e1a91b0918
commit 5417824b31
1 changed files with 7 additions and 1 deletions
Download Patch File Download Diff File Expand all files Collapse all files

8
README.md
View File

@@ -121,6 +121,7 @@ See sample configs in [configs](configs) folder or [examples](examples) for quic
datasets: datasets:
- path: vicgalle/alpaca-gpt4 # local or huggingface repo - path: vicgalle/alpaca-gpt4 # local or huggingface repo
type: alpaca # format from earlier type: alpaca # format from earlier
sequence_len: 2048 # max token length / prompt
``` ```
- loading - loading
@@ -333,7 +334,12 @@ Add below flag to train command above
## Common Errors 🧰 ## Common Errors 🧰
- Cuda out of memory: Please reduce `micro_batch_size` and/or `eval_batch_size` > Cuda out of memory
Please reduce any below
- `micro_batch_size`
- `eval_batch_size`
- `sequence_len`
## Contributing 🤝 ## Contributing 🤝