FAI Newsletter

A Production-Readiness Checklist for AI Behavior

Most readiness reviews check whether the service will stay up. An AI feature needs a second pass for what it decides, and for the changes that reach those decisions without a deploy.

Diagnosing an Agent Decision Without an ML Team

Most of what a diagnosis needs isn't model expertise. It's knowing which parts of the explanation were seen, which were said, and which were guessed.

From Trace to Behavior: Instrumenting the Signals That Matter

The Decision-Context Pack: What to Capture Before Something Breaks

An investigation can only use what existed before it started. The way to know what to keep is to run the investigation backwards.

"Why Did It Do That?": A 15-Minute Decision Investigation

One agent decision, a stopwatch, and only the artifacts you already keep.

The Senior-Engineer Tax: What an AI Incident Actually Costs to Diagnose

Four numbers from your last AI incident. The first is the one everyone reaches for, and the least useful of the four.