kernelpool commited on
Commit
741ef77
·
verified ·
1 Parent(s): ef556e9

Add files using upload-large-folder tool

Browse files
Files changed (3) hide show
  1. .gitattributes +1 -0
  2. README.md +9 -0
  3. minimax_3e-7_mmlu.png +3 -0
.gitattributes CHANGED
@@ -34,3 +34,4 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
36
  tokenizer.json filter=lfs diff=lfs merge=lfs -text
 
 
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
36
  tokenizer.json filter=lfs diff=lfs merge=lfs -text
37
+ minimax_3e-7_mmlu.png filter=lfs diff=lfs merge=lfs -text
README.md CHANGED
@@ -23,6 +23,15 @@ This model was quantized to 3-bit using DWQ with mlx-lm version **0.28.4**.
23
 
24
  <img src="minimax_3e-7.png" width="600" alt="Training loss curve">
25
 
 
 
 
 
 
 
 
 
 
26
  ## Use with mlx
27
 
28
  ```bash
 
23
 
24
  <img src="minimax_3e-7.png" width="600" alt="Training loss curve">
25
 
26
+ ## MMLU-PRO Benchmark
27
+
28
+ | Model | Score |
29
+ |-------|:-----:|
30
+ | 3-bit DWQ | **66.1** |
31
+ | 3-bit | 62.0 |
32
+
33
+ <img src="minimax_3e-7_mmlu.png" width="600" alt="MMLU-Pro Benchmark">
34
+
35
  ## Use with mlx
36
 
37
  ```bash
minimax_3e-7_mmlu.png ADDED

Git LFS Details

  • SHA256: bf91eefd52e66396a7c81bd235a251561bb514d7575980f5ecceb37d0ef814f8
  • Pointer size: 131 Bytes
  • Size of remote file: 258 kB