Pull down to refresh stories

EMO: Pretraining mixture of experts for emergent modularity

The AI subscription race is moving out of demo mode and into practical use. When a vendor adds more storage, unlocks stronger models, or folds research and creation into the same plan without blowing up the price, readers have a reason to rethink what they are paying for. This piece sits on 1 source layers, but the real value is showing why the story should not be skimmed past too quickly. Benchmark results What are expert subsets specializing to?

Models Datasets Spaces Buckets new Docs Enterprise Pricing --[0--> --]--> Back to Articles EMO: Pretraining mixture of experts for emergent modularity Team Article Published May 8, 2026 Upvote 19 +13 Kyle Wiggers Ai2Comms Follow allenai Ryan Wang ryanyxw Follow allenai How do we get modularity to emerge? The useful read is not just the monthly price or storage number, but which model tier gets unlocked, which tools are bundled, how the data is protected, and whether the plan actually removes the need for extra side subscriptions. Even when the core is settled, the next useful read is still the rollout speed, the real impact, and the switching cost for users or teams. Benchmark results What are expert subsets specializing to?

Verified The story is backed by strong or official sources.
Reference image for: EMO: Pretraining mixture of experts for emergent modularity
Reference image from Hugging Face Blog. Hugging Face Blog

Models Datasets Spaces Buckets new Docs Enterprise Pricing --[0--> --]--> Back to Articles EMO: Pretraining mixture of experts for emergent modularity Team Article Published May 8, 2026 Upvote 19 +13 Kyle Wiggers Ai2Comms Follow allenai Ryan Wang ryanyxw Follow allenai How do we get modularity to emerge? major AI vendors are pulling the AI plan race into practical use: price, storage, stronger models, and bundle rights that land in everyday work. Hugging Face Blog is strong enough to treat the story as verified, but the useful part still lies in the context and practical impact.

Featured offer

Patrick Tech Store Open the AI plans, tools, and software currently getting the push Jump straight into the store to see what Patrick Tech is pushing right now.

The upgrade worth noting

Models Datasets Spaces Buckets new Docs Enterprise Pricing --[0--> --]--> Back to Articles EMO: Pretraining mixture of experts for emergent modularity Team Article Published May 8, 2026 Upvote 19 +13 Kyle Wiggers Ai2Comms Follow allenai Ryan Wang ryanyxw Follow allenai How do we get modularity to emerge? Benchmark results What are expert subsets specializing to? What we're releasing 🧠 Models: https://huggingface. co/collections/allenai/emo | 📄 Tech report: https://allenai. org/papers/emo | 💻 Code: https://github. com/allenai/EMO | 📊 Visualization: https://emovisualization. netlify. app/. Hugging Face Blog is strong enough to treat the story as verified, but the useful part still lies in the context and practical impact.

Where to look at price and bundle value

Models Datasets Spaces Buckets new Docs Enterprise Pricing --[0--> --]--> Back to Articles EMO: Pretraining mixture of experts for emergent modularity Team Article Published May 8, 2026 Upvote 19 +13 Kyle Wiggers Ai2Comms Follow allenai Ryan Wang ryanyxw Follow allenai How do we get modularity to emerge? On AI plans, the critical read is not just the extra terabytes on paper, but whether pricing stays stable, which model tier is actually unlocked, how tight the regional limits remain, and how clearly data privacy is promised.

Featured offer

Patrick Tech Store Open the AI plans, tools, and software currently getting the push Jump straight into the store to see what Patrick Tech is pushing right now.

Which AI layers are lifting the plan

Benchmark results What are expert subsets specializing to? What we're releasing 🧠 Models: https://huggingface. co/collections/allenai/emo | 📄 Tech report: https://allenai. org/papers/emo | 💻 Code: https://github. com/allenai/EMO | 📊 Visualization: https://emovisualization. netlify. app/. What makes this worth opening is that the bundled AI touches real tools like mail, docs, research, image generation, video, or note-taking instead of sitting as a standalone demo.

Who should pay attention

The readers who should watch most closely are the ones already paying for storage, docs, meetings, content creation, and AI at the same time. If one plan truly bundles those layers, the value will surface quickly. Readers using AI only for occasional prompts may still be fine on lighter or free tiers.

Patrick Tech Media take

Patrick Tech Media reads moves like this as a race for practical value. The plan that removes the need for extra side services, reduces switching between tools, and keeps AI quality stable will hold an advantage longer than the launch buzz. From 1 early signals, the piece keeps 1 references that are useful for locking the main details in place.

Context Worth Keeping

Models Datasets Spaces Buckets new Docs Enterprise Pricing --[0--> --]--> Back to Articles EMO: Pretraining mixture of experts for emergent modularity Team Article Published May 8, 2026 Upvote 19 +13 Kyle Wiggers Ai2Comms Follow allenai Ryan Wang ryanyxw Follow allenai How do we get modularity to emerge? major AI vendors are pulling the AI plan race into practical use: price, storage, stronger models, and bundle rights that land in everyday work. Hugging Face Blog is strong enough to treat the story as verified, but the useful part still lies in the context and practical impact. The part worth holding onto is how a product change can ripple through the way a small team works, shares, and follows up. The floor is firmer here because the story is anchored by an official source, not only by second-hand reaction.

Source notes

From Patrick Tech

Contextual tools

Related stories