Hugging Face's logo

Girinath11
/
MixtureofRecursionwithRouter

Text Generation
Transformers
PyTorch
mixture_of_recursions
feature-extraction
recursive-transformer
technical-content
code-generation
math
conversation
bpe-tokenizer
adaptive-routing
custom_code
Model card Files
xet
Community
Girinath11 commited on
Commit
d6178fe
·
verified ·
1 Parent(s): db4b758

Upload ultra_fast_results (1).json

Browse files
Files changed (1) hide show
  1. ultra_fast_results (1).json +92 -0
ultra_fast_results (1).json ADDED
@@ -0,0 +1,92 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ [
2
+ {
3
+ "epoch": 1,
4
+ "train_loss": 5.904081931531553,
5
+ "train_ppl": 366.5305711150301,
6
+ "epoch_time_min": 3.736004670461019
7
+ },
8
+ {
9
+ "epoch": 2,
10
+ "train_loss": 4.782037754045692,
11
+ "train_ppl": 119.34730287095881,
12
+ "epoch_time_min": 3.8931448221206666
13
+ },
14
+ {
15
+ "epoch": 3,
16
+ "train_loss": 4.346468383242228,
17
+ "train_ppl": 77.20532128691357,
18
+ "epoch_time_min": 3.921374297142029
19
+ },
20
+ {
21
+ "epoch": 4,
22
+ "train_loss": 4.018676786895952,
23
+ "train_ppl": 55.627450135490534,
24
+ "epoch_time_min": 3.985279401143392
25
+ },
26
+ {
27
+ "epoch": 5,
28
+ "train_loss": 3.7450198261266245,
29
+ "train_ppl": 42.30984605088766,
30
+ "epoch_time_min": 3.9397004723548887
31
+ },
32
+ {
33
+ "epoch": 6,
34
+ "train_loss": 3.489572767386512,
35
+ "train_ppl": 32.77194347185351,
36
+ "epoch_time_min": 3.9274261832237243
37
+ },
38
+ {
39
+ "epoch": 7,
40
+ "train_loss": 3.2404102570923503,
41
+ "train_ppl": 25.54419928688797,
42
+ "epoch_time_min": 3.9699341615041095
43
+ },
44
+ {
45
+ "epoch": 8,
46
+ "train_loss": 3.02185961955338,
47
+ "train_ppl": 20.529433144193597,
48
+ "epoch_time_min": 3.9765639464060465
49
+ },
50
+ {
51
+ "epoch": 9,
52
+ "train_loss": 2.8062185044949173,
53
+ "train_ppl": 16.54722649664141,
54
+ "epoch_time_min": 4.011128667990366
55
+ },
56
+ {
57
+ "epoch": 10,
58
+ "train_loss": 2.614807206790748,
59
+ "train_ppl": 13.664581685370322,
60
+ "epoch_time_min": 4.025792515277862
61
+ },
62
+ {
63
+ "epoch": 11,
64
+ "train_loss": 2.449191606102279,
65
+ "train_ppl": 11.578982555927084,
66
+ "epoch_time_min": 4.044950878620147
67
+ },
68
+ {
69
+ "epoch": 12,
70
+ "train_loss": 2.286392891267347,
71
+ "train_ppl": 9.83938187261486,
72
+ "epoch_time_min": 4.032349860668182
73
+ },
74
+ {
75
+ "epoch": 13,
76
+ "train_loss": 2.1751735476606227,
77
+ "train_ppl": 8.803712853387184,
78
+ "epoch_time_min": 4.048110489050547
79
+ },
80
+ {
81
+ "epoch": 14,
82
+ "train_loss": 2.1039459013593844,
83
+ "train_ppl": 8.198456471422684,
84
+ "epoch_time_min": 4.049738196531932
85
+ },
86
+ {
87
+ "epoch": 15,
88
+ "train_loss": 2.0712672462141324,
89
+ "train_ppl": 7.934872185920158,
90
+ "epoch_time_min": 4.0435048540433245
91
+ }
92
+ ]