Data vs. Compute. The Bitter Lesson Strikes Again.

Hinzugefügt: 2026-05-28

[00:00:00]It's the bitter lesson, right? Which is that like okay data, how much data do you really need to train the horizontal model? You know, often these things are quadratic. You go like 10 times up more data to get like two times more performance or whatever it is. And so, you know, people climb that curve pretty fast. You can kind of get enough data to get to diminishing returns and more data pretty fast. We even see that when we do post training with Finn. You you need you need like you need a lot of data, but you don't need like billions of data points. you can get pretty far with like tens of millions of data points basically. And so I do think that the large providers definitely do have a hand to play um and I think a really strong one. But we have a hand to play