evals are literally just like the reverse of training ML models, which is pretty cool because you can tune your model based on how good it is. But your eval data better be really good, which is why running it on real data is so valuable. Theres gotta be a company who is selling eval data? like a scale.ai type company that sells high quality eval data? or even hires people to write real world commands to test ability.