Update README.md
Browse files
README.md
CHANGED
|
@@ -49,9 +49,9 @@ You can read more about the methodology behind SQLEval here.
|
|
| 49 |
Results
|
| 50 |
We classified each generated question into one of 6 categories. The table displays the percentage of questions answered correctly by each model, broken down by category.
|
| 51 |
```bash
|
| 52 |
-
|
| 53 |
-
count
|
| 54 |
compare etype exec
|
| 55 |
-
=====================
|
| 56 |
-
|
| 57 |
```
|
|
|
|
| 49 |
Results
|
| 50 |
We classified each generated question into one of 6 categories. The table displays the percentage of questions answered correctly by each model, broken down by category.
|
| 51 |
```bash
|
| 52 |
+
easy medium hard extra all
|
| 53 |
+
count 250 440 174 170 1034
|
| 54 |
compare etype exec
|
| 55 |
+
===================== EXECUTION ACCURACY =====================
|
| 56 |
+
exec 0.732 0.495 0.368 0.224 0.486
|
| 57 |
```
|