SequentialLearning
/

SuperLinear

mixture-of-experts

Model card Files Files and versions

razmars commited on May 14

Commit

dccc04f

·

verified ·

1 Parent(s): 5b960c5

Update full_shot/config.json

Files changed (1) hide show

full_shot/config.json +1 -1

full_shot/config.json CHANGED Viewed

@@ -30,7 +30,7 @@
   "pred_len": 96,
   "seq_len": 512,
   "moe_norm": 0,
-  "top_k_experts": 20,
   "torch_dtype": "float32",
   "transformers_version": "4.40.1",
   "use_fft": 1,

   "pred_len": 96,
   "seq_len": 512,
   "moe_norm": 0,
+  "top_k_experts": 10,
   "torch_dtype": "float32",
   "transformers_version": "4.40.1",
   "use_fft": 1,