Open-source AI models with advanced architectural innovations like Kimi Delta attention and attention residuals can achieve competitive performance against premium closed-source models while offering significantly lower costs, demonstrating that open-source AI development is becoming increasingly viable for developers seeking high-performance models without premium pricing.
Deep Dive
Prerequisite Knowledge
- No data available.
Where to go next
- No data available.
Deep Dive
China's Kimi K3 Just Humiliated Fable 5 (For Half the Price)
Added:A Chinese startup just built the biggest open AI model on the planet and [music] it's beating Anthropic and Open AI at their own game for a fraction of the price.
Meet Kimi K3 from Moonshot AI in Beijing. It landed on July 16th and the numbers are hard to believe. 2.8 [music] trillion parameters. That's not a typo.
It's roughly 75% bigger than DeepSeek's V4 Pro >> [music] >> and more than double the size of Moonshot's own previous model K2.6.
Moonshot is calling it the world's first open 3 trillion class model and full weights [music] dropped to the public on July 27th, meaning anyone will be able to download it, modify it, >> [music] >> run it themselves. Here's what makes it actually work at that scale. Two new pieces of architecture.
>> [music] >> The first is called Kimi Delta attention. It lets the model decode up to 6.3 times faster when you're working with million token contexts.
The second is attention residuals, which Moonshot says delivers about 25% higher training efficiency for less [music] than 2% extra cost. Combine that with a technique called stable latent MoE and the model only activates 16 out of 896 experts at any given time.
That's how you get a 2.8 [music] trillion parameter model that doesn't need a small power plant to run.
But specs are one thing.
What's got developers losing their minds is [music] what K3 can actually do. On the front end code arena, K3 didn't just rank well. It jumped from 18th place all the way to number one, scoring 1,679 points and passing Claude's Fable 5 model.
It topped six out of seven categories [music] from brand and marketing work to data analytics to simulations.
The only place it lost was gaming, and even there it came in second.
Then there's the price.
One developer cloned Apple's homepage with a single prompt using both K3 and Fable 5.
K3 did it for 44 cents. Fable 5 cost 94 cents for the exact [music] same result.
Zoom out and the gap gets even bigger.
Fable 5 charges $10 per million input tokens [music] and $50 per million output tokens, making it one of the most expensive models on the market.
K3 charges $3 and $15.
Another creator built a CSGO and Portal mashup game using about 600,000 tokens.
Total cost with K3, $3.24.
The same job would have cost $10.80 on [music] Fable 5 and $6 on GPT 5.6 Soul.
And people are stress testing it in wild directions. A Game Boy Advance emulator built from scratch. A full Mac OS style operating system interface done in about 15 minutes from one prompt. A Wuxia style RPG.
A Cyberpunk web swinging game. One developer even claims K3 is rewriting and optimizing its own kernel stack.
>> [music] >> Whether or not you believe every viral claim, the pattern is clear.
People are using K3 for things they never bothered trying with closed models because the [music] cost of failing and retrying is basically nothing. Now, Moonshot isn't claiming total victory.
In its own [music] release notes, the company admits K3 still trails Fable 5 and GPT 5.6 Soul in overall performance.
This is a coding and agent focused model, not a universal replacement. But the trajectory matters more than the snapshot. 18 months ago, Moonshot's market position had eroded badly after Deep Seek's rise. Now, they're back, timed almost perfectly with the World Artificial Intelligence Conference in Shanghai, and their annual revenue has reportedly crossed [music] $200 million.
The bigger story here isn't just one model, it's that the gap between American closed-source labs and Chinese open-source labs keeps shrinking, and it's shrinking on price as much as on performance. That should worry every company charging premium rates for frontier intelligence.
>> [music] >> Subscribe to AI Front Page for all the latest AI and tech news and updates. Hit that subscribe button, it's free, and we'll see you in the next one.
Related Videos

Expanding Stikbot thumbnails
leopoldshorts
2K views•2023-09-24

Digital Discrimination: Cognitive Bias in Machine Learning
redmonktechevents2974
4K views•2019-12-18

Evolutionary Approach to Clustering by Ujjwal Maulik
ICTStalks
279 views•2019-06-26

Rose Yu "Learning from Large-Scale Spatiotemporal Data"
networkscienceinstitute
2K views•2019-03-04

Stanford Seminar - Generalization through Task Representations with Foundation Models
stanfordonline
4K views•2025-07-14

Satellite-Based Wheat Yield Forecasting using GEE & Transformer Neural Network
gisrsinstitute
634 views•2025-06-15

Paradigm Shifts in Data Processing for the Generative AI Era: Robert Nishihara of Anyscale & Ray.io
GradientFlow
2K views•2025-01-02

How to Build Your Own GenAI-Based Knowledge Management System
2150GmbH
360 views•2025-06-03
Trending

WOW! Judge TURNS THE TABLES on Trump in His OWN $10B LAWSUIT!!!
MeidasTouch
197K views•2026-07-23

Playstation NO DISC/NO BUY Fight Is Over...
DavidJaffeGames
4K views•2026-07-23

Steam and Xbox Just Dropped The Hammer On PlayStation
OhNoItsAlexx
9K views•2026-07-23

Americans Confused in Australia for 17 Minutes Straight
IWrocker
17K views•2026-07-23