Seems like `chat(stream=True)` is broken — requires `do_sample=True` + `num_beams=1`, then crashes with `AttributeError: 'dict' object has no attribute 'sequences'`
#13 opened 1 day ago
by
Volotat
Guidance on ONNX / ONNX Runtime GenAI?
1
#11 opened 12 days ago
by
EAFA0
my discussion
1
#10 opened 12 days ago
by
0xwumade
inquery for code to evaluate on LiveCC
1
#4 opened 14 days ago
by
LeeLi4704
The effect is quite good
👍
3
4
#3 opened 15 days ago
by
JiaaiJ