Submitted by xiaol 24 ARWKV: Pretrain is not what we need, an RNN-Attention-Based Language Model Born from Transformer · 4 authors 41 2
Submitted by HarryHe 17 Emilia: A Large-Scale, Extensive, Multilingual, and Diverse Dataset for Speech Generation · 14 authors 2
Submitted by akhaliq 12 iFormer: Integrating ConvNet and Transformer for Mobile Application · 1 authors 67 2
Submitted by eliebak 11 Parameters vs FLOPs: Scaling Laws for Optimal Sparsity for Mixture-of-Experts Language Models · 6 authors 2
Submitted by Bradley 10 CodeMonkeys: Scaling Test-Time Compute for Software Engineering · 6 authors 59 2
Submitted by akhaliq 9 Mixture-of-Mamba: Enhancing Multi-Modal State-Space Models with Modality-Aware Sparsity · 6 authors 53 1
Submitted by nielsr 8 Are Vision Language Models Texture or Shape Biased and Can We Steer Them? · 8 authors 30 2
Submitted by xywang1 6 OpenCharacter: Training Customizable Role-Playing LLMs with Large-Scale Synthetic Personas · 6 authors 2
Submitted by melfeki11 5 Return of the Encoder: Maximizing Parameter Efficiency for SLMs · 3 authors 32 2