Update README.md
Browse files
README.md
CHANGED
|
@@ -50,25 +50,21 @@ TODO
|
|
| 50 |
|
| 51 |
**MultiModal Benchmark**
|
| 52 |
|
| 53 |
-
|
|
| 54 |
-
|
|
| 55 |
-
|
|
| 56 |
-
|
| 57 |
-
| model | MMMU<sub>val/test</sub> | CMMMU<sub>val/test</sub> | Tiny<sub>LVLM</sub> | LLaVA<sub>bench</sub> |
|
| 58 |
-
| --------------------------------------------------------------------------------- | ----------------------- | ------------------------ | ------------------- | --------------------- |
|
| 59 |
-
| [InternVL-Chat-V1.1](https://huggingface.co/OpenGVLab/InternVL-Chat-Chinese-V1.1) | 39.1 / 35.3 | | 344.5 | 76.3 |
|
| 60 |
|
| 61 |
**Visual Question Answering**
|
| 62 |
|
| 63 |
-
|
|
| 64 |
-
|
|
| 65 |
-
|
|
| 66 |
|
| 67 |
**Image Captioning**
|
| 68 |
|
| 69 |
-
|
|
| 70 |
-
|
|
| 71 |
-
|
|
| 72 |
|
| 73 |
|
| 74 |
## Citation
|
|
|
|
| 50 |
|
| 51 |
**MultiModal Benchmark**
|
| 52 |
|
| 53 |
+
| MME | MMB<sub>dev/test</sub> | MMB-CN<sub>dev/test</sub> | POPE | MMMU<sub>val/test</sub> | CMMMU<sub>val/test</sub> | Tiny<sub>LVLM</sub> | LLaVA<sub>bench</sub> |
|
| 54 |
+
| -------------- | ---------------------- | ------------------------- | ---- | ----------------------- | ------------------------ | ------------------- | --------------------- |
|
| 55 |
+
| 1672.3 / 341.1 | 76.6 / 75.4 | 71.5 / 70.1 | 87.2 | 39.1 / 35.3 | TODO | 344.5 | 76.3 |
|
|
|
|
|
|
|
|
|
|
|
|
|
| 56 |
|
| 57 |
**Visual Question Answering**
|
| 58 |
|
| 59 |
+
| VQAv2<sub>test</sub> | OKVQA<sub>val</sub> | TextVQA<sub>val</sub> | VizWiz<sub>val/test</sub> | AI2D<sub>test</sub> | GQA<sub>test</sub> | SQA<sub>test</sub> |
|
| 60 |
+
| -------------------- | ------------------- | --------------------- | ------------------------- | ------------------- | ------------------ | ------------------ |
|
| 61 |
+
| 80.9 | 64.2 | 65.8 | 58.3 / 57.3 | 70.23 | 62.4 | 91.2 |
|
| 62 |
|
| 63 |
**Image Captioning**
|
| 64 |
|
| 65 |
+
| COCO<sub>test</sub> | Flickr30K<sub>test</sub> | NoCaps<sub>val</sub> |
|
| 66 |
+
| ------------------- | ------------------------ | -------------------- |
|
| 67 |
+
| 141.8 | 84.3 | 120.4 |
|
| 68 |
|
| 69 |
|
| 70 |
## Citation
|