Bonsai 27B: Largest Model to Run on Mobile to Date
Researchers have demonstrated Bonsai 27B, a large language model, successfully running locally on a mobile device. This marks an advancement for AI on consumer hardware, with direct applications for smartphones and similar devices.
What happened?
Bonsai 27B, a large language model (LLM) with 27 billion parameters, has been demonstrated running locally on a mobile device, specifically a Steam Deck. The model required approximately 26 GB of RAM for this operation. This demonstration indicates that LLMs of this size are now technically feasible to run on commercial off-the-shelf consumer hardware.
Key facts
| Modell | Bonsai 27B |
|---|---|
| Antal parametrar | 27 miljarder |
| RAM-krav (Steam Deck) | Cirka 26 GB |
| Demoenhet | Steam Deck |
”Bonsai 27B: The First 27B-Class Model to Run on a Phone”
Why it matters
The ability to run such large language models locally on consumer hardware like mobile phones reduces reliance on cloud-based solutions. This can improve data protection, reduce latency, and enable AI applications without a constant internet connection. Performance that previously required high-end servers is now becoming available on personal devices.
Who is affected?
Developers working with on-device AI and mobile applications are primarily affected. Users of smartphones and handheld devices may in the future gain access to more powerful AI functionality directly on their devices. Companies investing in edge AI and offline capabilities are also positively impacted.
Impact on the EU
Not directly applicable to EU status. However, running LLMs locally on devices can contribute to compliance with GDPR principles regarding data minimisation and local processing of personal data, as less data needs to be sent to cloud services.
What else you should know
The demonstration of Bonsai 27B on a Steam Deck is significant as it practically shows what is possible with current technology. Although the Steam Deck is a gaming device, it shares many architectural similarities with modern smartphones and tablets regarding system-on-chip (SoC) design and memory management. This demonstration pushes the boundaries of what is considered practically feasible on mobile devices.
Quick answers about this story
Vad har hänt?
När hände det?
Varför spelar det roll?
Vilka enheter kan köra Bonsai 27B?
The link opens in a new window and leads to the publisher's own site.
Källan har spårats automatiskt från utgivaren via Aheadlines signalkedja.
AI-verktyg i artikeln
Topics
Get similar news straight to your inbox
The reader's room
Send in a question or an addition. The newsroom reads everything before it's published and replies when relevant. No AI-generated text – just people.
Sign in to submit a comment or question.
Read the article through your role
- Decide whether this affects strategy over 6–12 months or is just noise.
- Discuss with leadership: do we own the right question or does ownership need to move?
- Ask: what risk are we taking by NOT acting on this this quarter?
Generated angle — not editorial analysis of "Bonsai 27B: Largest Model to Run on Mobile to Date"