Determinism

追加: 2026-05-23

[00:00:00]Grant, LLMs are not deterministic. If users are using natural language to ask AI questions about data, then does that mean the query results are not deterministic?

[00:00:13]If you have something that's not deterministic, then the results you get out of it are not deterministic.

[00:00:24]So, I'm going to rephrase your question again. Hey, I'm using something that's not deterministic. Does that mean it's not deterministic?

[00:00:32]Yes.

[00:00:33]That is what that means.

[00:00:36]Continues with, "If I ask for month-over-month earnings, then will I always receive the same query result?"

[00:00:42]No.

[00:00:43]That's what non-deterministic means is that it can build the query in different ways at different times, depending on which model you use, depending on whether you get cheap with the model or whether you get expensive.

[00:00:57]And I have absolutely seen that case.

[00:00:59]Even with my own queries during some of my training classes, I use AI on screen, and I will ask the same question multiple times to different models and get different results. Like the cheapo model gives me different results than the expensive model. So, welcome to the age of non-determinism.