SequentialLearning
/

SuperLinear

mixture-of-experts

Model card Files Files and versions

razmars commited on Apr 23

Commit

ee03db0

·

verified ·

1 Parent(s): 7987a05

Update config.json

Files changed (1) hide show

config.json +1 -1

config.json CHANGED Viewed

@@ -19,7 +19,7 @@
   "layer_type": "RLinear",
   "linear_checkpoints_dir": "checkpoints5",
   "linear_checkpoints_path": "/cs/azencot_fsas/MoE/",
-  "load_linear": 1,
   "manual_moe": 0,
   "max_horizon": 96,
   "misc_moe": 1,

   "layer_type": "RLinear",
   "linear_checkpoints_dir": "checkpoints5",
   "linear_checkpoints_path": "/cs/azencot_fsas/MoE/",
+  "load_linear": 0,
   "manual_moe": 0,
   "max_horizon": 96,
   "misc_moe": 1,