Update README.md
Browse files
README.md
CHANGED
|
@@ -47,16 +47,16 @@ Efficient inference project: https://github.com/BlinkDL/Albatross
|
|
| 47 |
|
| 48 |
RWKV APP: https://github.com/RWKV-APP/RWKV_APP (local inference on Android/iOS)
|
| 49 |
|
| 50 |
-
Please use **latest G#
|
| 51 |
|
| 52 |
```
|
| 53 |
Gxx = Data Version
|
| 54 |
|
| 55 |
G0x = less than 1 epoch, as training 1 epoch for a large model is expensive :(
|
| 56 |
-
G0 G0a G0b ... = adding more (newer and better) data, so G0a has better quality (but less) data than G1
|
| 57 |
|
| 58 |
G1x = more than 1 epoch
|
| 59 |
-
G1 G1a G1b ... = adding more (newer and better) data, note G1a has better quality (and more) data than G0a
|
| 60 |
```
|
| 61 |
|
| 62 |
Decoding (note: this is for RWKV pip pkg, which apply temp after topp):
|
|
|
|
| 47 |
|
| 48 |
RWKV APP: https://github.com/RWKV-APP/RWKV_APP (local inference on Android/iOS)
|
| 49 |
|
| 50 |
+
Please always use **latest G#a# models** (better at everything).
|
| 51 |
|
| 52 |
```
|
| 53 |
Gxx = Data Version
|
| 54 |
|
| 55 |
G0x = less than 1 epoch, as training 1 epoch for a large model is expensive :(
|
| 56 |
+
G0 G0a G0a2 G0a3 ... G0b ... = adding more (newer and better) data, so G0a has better quality (but less) data than G1
|
| 57 |
|
| 58 |
G1x = more than 1 epoch
|
| 59 |
+
G1 G1a G1a2 G1a3 ... G1b ... = adding more (newer and better) data, note G1a has better quality (and more) data than G0a
|
| 60 |
```
|
| 61 |
|
| 62 |
Decoding (note: this is for RWKV pip pkg, which apply temp after topp):
|