Update README.md

README.md

@@ -8,29 +8,12 @@ tags:
 - merge
 
 ---
-# gemma-ln
+Hparams:
 
-This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit).
+- LR: 1e-5
+- Weight Decay: 0.02
+- grad-clip: 0.2
 
-## Merge Details
-### Merge Method
+pretrained on a buncha LNs, books, etc.
+Used for a base for Pascal.
 
-This model was merged using the Passthrough merge method using [unsloth/gemma-3-12b-it](https://huggingface.co/unsloth/gemma-3-12b-it) + [NewEden/Gemma-LN-Lora](https://huggingface.co/NewEden/Gemma-LN-Lora) as a base.
-
-### Models Merged
-
-The following models were included in the merge:
-
-
-### Configuration
-
-The following YAML configuration was used to produce this model:
-
-```yaml
-base_model: unsloth/gemma-3-12b-it+NewEden/Gemma-LN-Lora
-dtype: bfloat16
-merge_method: passthrough
-models:
-  - model: unsloth/gemma-3-12b-it+NewEden/Gemma-LN-Lora
-
-```