The Bitter Lesson principle states that in machine learning, scaling data and compute power is more effective than hand-crafted features, as performance improvements follow a quadratic relationship where increasing data by 10x typically yields only about 2x improvement, meaning diminishing returns are reached relatively quickly and large-scale data providers have a significant advantage.
Inmersión profunda
Prerrequisito
- No hay datos disponibles.
Próximos pasos
- No hay datos disponibles.
Inmersión profunda
Data vs. Compute. The Bitter Lesson Strikes Again.Añadido:
It's the bitter lesson, right? Which is that like okay data, how much data do you really need to train the horizontal model? You know, often these things are quadratic. You go like 10 times up more data to get like two times more performance or whatever it is. And so, you know, people climb that curve pretty fast. You can kind of get enough data to get to diminishing returns and more data pretty fast. We even see that when we do post training with Finn. You you need you need like you need a lot of data, but you don't need like billions of data points. you can get pretty far with like tens of millions of data points basically. And so I do think that the large providers definitely do have a hand to play um and I think a really strong one. But we have a hand to play
Videos Relacionados
OpenHuman VS Hermes AI: Who Wins?
JulianGoldieSEO
285 views•2026-05-29
BREAKING: Microsoft’s New Image Generating Model Beat Out GPT 1.5 and Nano Banana 2
aimmediahouse
122 views•2026-06-03
Long-Running Agents — Build an Agent That Never Forgets with Google ADK
suryakunju
142 views•2026-05-30
This computer is made from real human brain cells. And you can buy it.
Talktmsmedia
3K views•2026-05-28
I Made the Same Anime Fight Scene in Every AI Video Generator
NobleGooseAnime
295 views•2026-05-30
Nvidia Bets Big On AI PCs | New Chip To Power Windows Laptops | Technology | AI Updates | N18S
cnnnews18
3K views•2026-06-01
I Tested NEW Opus 4.8 on Four Projects (Updated LLM Leaderboard)
AICodingDaily
298 views•2026-05-29
3D Platformer Update - NO CAPES
SolarLune
294 views•2026-05-30











