The Challenge of Evaluating "Black Box" AI Systems #machinelearning #llm #genai

Added: 2026-05-16

[00:00:00]The issue here is how do we know what we are building will work correctly. Is it going to produce the right results? So, that's why we started building what we call the GenAI evaluation platform because earlier with code it was deterministic, more rule-based. You know what the code did or at least most of the time. And then you wrote these unit tests around the code to make sure it worked the way it did.

[00:00:25]But then with AI, it's a black box to us as well, right? We don't know how it's working underneath. We are not the owners of the code inside it. So, we have to figure out another way to kind of evaluate the surface.