Llama 4 Scout: Meta's Multimodal MoE Model with Massive Context
Meta's multimodal model, Llama 4 Scout, combines 109 billion parameters with a Mixture-of-Experts (MoE) architecture and a 10-million token context window for self-hosted operations.

What happened?
Meta has unveiled technical specifications for Llama 4 Scout, an open-weight multimodal model designed for text and image analysis. It employs a Mixture-of-Experts architecture comprising 109 billion total parameters, with 17 billion parameters activated during each inference. Additionally, Llama 4 Scout supports a context window of up to 10 million tokens.
Key facts
| Totalt antal parametrar | 109 miljarder |
|---|---|
| Aktiva parametrar vid inferens | 17 miljarder |
| Kontextfönster | Upp till 10 miljoner tokens |
Why it matters
Llama 4 Scout facilitates the multimodal analysis of exceptionally large datasets locally, eliminating reliance on proprietary APIs. The MoE architecture maintains low computational costs per inference while retaining the substantial capacity of the overall model.
Who is affected?
The model is primarily aimed at product teams, AI engineers, and organisations developing proprietary systems that require self-hosted multimodal model infrastructure. Users must adhere to the terms specified in Meta's community licence.
Impact on the EU
Not applicable to EU status. The source does not cite any specific regulatory hurdles or adjustments for the European market.
What else you should know
The model is built on early fusion between text and imagery, meaning visual information is integrated throughout the architecture. For product teams, however, the 109-billion parameter total requires high-performance infrastructure for local hosting.
Quick answers about this story
Vad har hänt?
När hände det?
Varför spelar det roll?
Hur fungerar MoE-arkitekturen i Llama 4 Scout?
The link opens in a new window and leads to the publisher's own site.
Källan har spårats automatiskt från utgivaren via Aheadlines signalkedja.
AI-verktyg i artikeln
Topics
Get similar news straight to your inbox
The reader's room
Send in a question or an addition. The newsroom reads everything before it's published and replies when relevant. No AI-generated text – just people.
Sign in to submit a comment or question.
Read the article through your role
- Decide whether this affects strategy over 6–12 months or is just noise.
- Discuss with leadership: do we own the right question or does ownership need to move?
- Ask: what risk are we taking by NOT acting on this this quarter?
Generated angle — not editorial analysis of "Llama 4 Scout: Meta's Multimodal MoE Model with Massive Cont"