Article
The Heterogeneous Feature of RoPE-based Attention in Long-Context LLMs
•
11
Xiaoran Liu (SII)
SII-xrliu
AI & ML interests
None yet
Recent Activity
published
a model
about 1 hour ago
SII-xrliu/FoPE-DCLM-776M-4k
liked
a model
19 days ago
OpenMOSS-Team/DiRL-8B-Instruct
published
an
article
23 days ago
The Heterogeneous Feature of RoPE-based Attention in Long-Context LLMs
Organizations
None yet
published
an
article
23 days ago