SequentialLearning
/

SuperLinear

mixture-of-experts

Model card Files Files and versions

razmars commited on May 12

Commit

f5892e3

·

verified ·

1 Parent(s): 00425d5

Update config.json

Files changed (1) hide show

config.json +1 -0

config.json CHANGED Viewed

@@ -18,6 +18,7 @@
   "linear_checkpoints_dir": "checkpoints5",
   "linear_checkpoints_path": "/cs/azencot_fsas/MoE/",
   "load_linear": 0,
   "max_horizon": 96,
   "misc_moe": 10,
   "mlp_gating": 0,

   "linear_checkpoints_dir": "checkpoints5",
   "linear_checkpoints_path": "/cs/azencot_fsas/MoE/",
   "load_linear": 0,
+  "load_weights" :0,
   "max_horizon": 96,
   "misc_moe": 10,
   "mlp_gating": 0,