EMO: Pretraining mixture of experts for emergent modularity
AI2 releases EMO, a new MoE model pretrained to enable emergent modularity, allowing users to selectively use just 12.5% of experts for a task while maintaining near full-model performance.
Hugging Face Blog · May 9, 2026