Hands-on notes on evals, red-teaming and shipping
October 5, 2026 · Judgeworthy
A voice agent is your text agent behind a noisy channel. Here is how to perturb transcripts the way ASR actually fails, assert on the tool calls, and measure barge-in and latency separately.
Read moreSeptember 28, 2026 · Judgeworthy
Your injection suite watches tool calls. The easiest way out of an agent is a rendered markdown image that the browser fetches before anyone reads the answer. Here is a channel inventory, a canary, and a pytest suite that asserts on destinations rather than payloads.
Read moreSeptember 21, 2026 · Judgeworthy
Agent SDKs fire tool calls in parallel by default, which turns ordering assumptions into intermittent bugs. Here is a deterministic interleaving harness and four pytest evals that make those failures reproducible.
Read moreSeptember 21, 2026 · Judgeworthy
A research agent's report reads well whether or not it is true. Here is a harness that pulls every claim-citation pair, refetches the source, and scores support, so you get three numbers instead of an impression.
Read moreSeptember 21, 2026 · Judgeworthy
Every dataset tutorial assumes you already have traces. Before launch you have none. Here is how we generate, deduplicate and human-review a starter eval set from the agent's tool schemas and a failure taxonomy.
Read more