Article
A failed experiment: Infini-Attention, and why we should keep trying?
- +1
neuralink, lvwerra, thomwolf
• • 76neuralink
neuralink
AI & ML interests
distributed training @nous research. ex-nanotron @huggingface
Recent Activity
published a Space 13 days ago
neuralink/distill-blog-phuc upvoted a paper about 2 months ago
Shortcut-connected Expert Parallelism for Accelerating
Mixture-of-Experts liked a model 4 months ago
NousResearch/nomos-1Organizations
published an article over 1 year ago
published an article over 1 year ago
Article
A failed experiment: Infini-Attention, and why we should keep trying?
- +1
neuralink, lvwerra, thomwolf
• • 76