Skip to content
Snippets Groups Projects
Commit 93cdf563 authored by Emily Haw's avatar Emily Haw
Browse files

add todo list

parent 1f538890
No related branches found
No related tags found
No related merge requests found
......@@ -9,6 +9,32 @@
- back translation (ella)
- feature space synonym replacemnet (emily)
# hyperparameter
simple transformers.ai
- learning rate
- train_batch_size
- num_train_epochs
- early stopping (only req for longer epochs)
- optimizer on (adam w and ada factor)
- scheduler
- logging_steps
- model (each try one model)
# for augmentation
- percentage of word embeddings replaced in BERT (em)
- how much percentage of all sentences
- synonym (azhara)
- percentage of words replacing
- back translation ()
- which languages, and amount of languages
- evaluate
# one other newer model than roberta
......
0% Loading or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment