Update README.md
Browse files
README.md
CHANGED
|
@@ -181,7 +181,7 @@ Accuracy-norm score*
|
|
| 181 |
| Infery LLM | 2,029.6 |
|
| 182 |
|
| 183 |
- Throughput (tokens/sec) - Measured with optimal batch - PyTorch BS 64, Infery LLM BS 128
|
| 184 |
-
-
|
| 185 |
|
| 186 |
|
| 187 |
## How to Cite
|
|
|
|
| 181 |
| Infery LLM | 2,029.6 |
|
| 182 |
|
| 183 |
- Throughput (tokens/sec) - Measured with optimal batch - PyTorch BS 64, Infery LLM BS 128
|
| 184 |
+
- In order to replicate the results of the PyTorch benchmark, use this [code example](https://huggingface.co/Deci/DeciLM-6b/blob/main/hf_benchmark_example.py)
|
| 185 |
|
| 186 |
|
| 187 |
## How to Cite
|