From 5417824b31de71fa85a071ade59020628e7e2025 Mon Sep 17 00:00:00 2001
From: NanoCode012 <kevinvong@rocketmail.com>
Date: Thu, 25 May 2023 09:50:43 +0900
Subject: [PATCH] Add seq length

---
 README.md | 8 +++++++-
 1 file changed, 7 insertions(+), 1 deletion(-)

diff --git a/README.md b/README.md
index 91678f849..75e573a52 100644
--- a/README.md
+++ b/README.md
@@ -121,6 +121,7 @@ See sample configs in [configs](configs) folder or [examples](examples) for quic
   datasets:
     - path: vicgalle/alpaca-gpt4 # local or huggingface repo
       type: alpaca # format from earlier
+  sequence_len: 2048 # max token length / prompt
   ```
 
 - loading
@@ -333,7 +334,12 @@ Add below flag to train command above
 
 ## Common Errors 🧰
 
-- Cuda out of memory: Please reduce `micro_batch_size` and/or `eval_batch_size` 
+> Cuda out of memory
+
+Please reduce any below
+  - `micro_batch_size`
+  - `eval_batch_size`
+  - `sequence_len`
 
 ## Contributing 🤝