From 93cdf56325d1c318ab0b87cf2384541e6024b212 Mon Sep 17 00:00:00 2001
From: Emily Haw <haw.emily@gmail.com>
Date: Tue, 1 Mar 2022 14:54:38 +0000
Subject: [PATCH] add todo list

---
 README.md | 26 ++++++++++++++++++++++++++
 1 file changed, 26 insertions(+)

diff --git a/README.md b/README.md
index 6eeae68..39b691d 100644
--- a/README.md
+++ b/README.md
@@ -9,6 +9,32 @@
     - back translation (ella)
     - feature space synonym replacemnet (emily)
 
+# hyperparameter
+simple transformers.ai
+- learning rate
+- train_batch_size
+- num_train_epochs
+- early stopping (only req for longer epochs)
+- optimizer on (adam w and ada factor)
+- scheduler
+- logging_steps
+- model (each try one model)
+
+
+# for augmentation
+- percentage of word embeddings replaced in BERT (em)
+    - how much percentage of all sentences
+
+- synonym (azhara)
+    - percentage of words replacing
+
+- back translation ()
+    - which languages, and amount of languages
+
+
+- evaluate 
+
+
 # one other newer model than roberta
 
 
-- 
GitLab