News for hackers. Stuff that matters.

xyortuc

Re:Simulation for Agentic Evaluation on Saturday February 28, 2026 @06:51PM (#47201888)
That is cool but this seems to be only for simulating user behavior. Form the docs: `Test real agent behavior by simulating users in different scenarios and edge cases`.

What I mean by simulation is more on simulating a situation an agent may come accross in production. All read-only tool calls return simulated responses based on the environment state. Write actions change the environment according to scenario.

Re:Simulation for Agentic Evaluation on Saturday February 28, 2026 @01:17PM (#47198504)
any thoughts on how to scale agent simulations?
Hi, that's a great tool. It gave me great inspiration, I am working on my tool now. Let's see how it goes