taehoon222 commited on
Commit
5eb383b
ยท
verified ยท
1 Parent(s): db5bf1d

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +2 -1
README.md CHANGED
@@ -110,4 +110,5 @@ Test Set (์ตœ์ข… ํ‰๊ฐ€์šฉ): test.json (๋ณ„๋„ ๋ฐ์ดํ„ฐ)
110
 
111
  ๊ฐ€์ค‘์น˜ ์ˆœ์„œ (๋ผ๋ฒจ): ['๊ธฐ์จ', '๋‹นํ™ฉ', '๋ถ„๋…ธ', '๋ถˆ์•ˆ', '์ƒ์ฒ˜', '์Šฌํ””']
112
 
113
- ์Šค์ผ€์ค„๋Ÿฌ (Scheduler): cosine ํ•™์Šต๋ฅ  ์Šค์ผ€์ค„๋Ÿฌ๋ฅผ ์ ์šฉํ–ˆ์Šต๋‹ˆ๋‹ค.
 
 
110
 
111
  ๊ฐ€์ค‘์น˜ ์ˆœ์„œ (๋ผ๋ฒจ): ['๊ธฐ์จ', '๋‹นํ™ฉ', '๋ถ„๋…ธ', '๋ถˆ์•ˆ', '์ƒ์ฒ˜', '์Šฌํ””']
112
 
113
+ ์Šค์ผ€์ค„๋Ÿฌ (Scheduler): cosine ํ•™์Šต๋ฅ  ์Šค์ผ€์ค„๋Ÿฌ๋ฅผ ์ ์šฉํ–ˆ์Šต๋‹ˆ๋‹ค.
114
+ 3. ์ฃผ์š” ํ•˜์ดํผํŒŒ๋ผ๋ฏธํ„ฐ (Hyperparameters)HyperparameterValuebase_model_nameklue/roberta-basenum_train_epochs10learning_rate1e-5train_batch_size16eval_batch_size64weight_decay0.01max_length128warmup_ratio0.1lr_scheduler_typecosine