Article
Differential Transformer V2
•
6
Li Dong
unilm
AI & ML interests
Language Model Pre-Training
Recent Activity
authored
a paper
about 14 hours ago
MoE-CAP: Benchmarking Cost, Accuracy and Performance of Sparse Mixture-of-Experts Systems
authored
a paper
about 14 hours ago
Towards Stable and Effective Reinforcement Learning for Mixture-of-Experts
authored
a paper
about 14 hours ago
Multiplex Thinking: Reasoning via Token-wise Branch-and-Merge
Organizations
published
an
article
about 21 hours ago